Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Support Mutual Reachability distance for ANN index types #304

Open
cjnolet opened this issue Aug 27, 2024 · 0 comments
Open

[FEA] Support Mutual Reachability distance for ANN index types #304

cjnolet opened this issue Aug 27, 2024 · 0 comments
Labels
feature request New feature or request

Comments

@cjnolet
Copy link
Member

cjnolet commented Aug 27, 2024

Mutual reachability distance is an important post-processing data mining computation that unfortunately needs to be computed during the distance computation. Because RAFT is header only, we exposed this capability as a distance epilogue function that could be applied in place just after the actual distance is computed for brute force (and more recently for nn-descent).

CuVS is not header only, and so this poses additional challenges in specifying mutual reachability using a generalized epilogue.

Our solution is to have cuVS support the mutual reachability distance directly, since it's pretty general. The difference between mutual reachability and other more common distance types is that it requires having an array of "the distance to the kth neighbor" available (referred to formally as core distances).

We should be able to support this distance type without too much trouble, but will probably need to figure out what the API should look like. I'm marking this as a placeholder feature, since @benfred plans to take a look at migrating this to cuVS so we can formally move cuML over to using cuVs Instead of RAFT for nearest neighbors things.

@cjnolet cjnolet added the feature request New feature or request label Aug 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant