Skip to content

Add support for reading L1/L2 cache sizes for different platforms(Windows, Linux, MacOS) for our efficient cache aware multi-vector distance functions. #1062

Description

We might be able to take some reference from - https://github.com/ciresnave/hardware-query/blob/main/src/cpu.rs

We have the type TileBudget type which we need to wire by reading cache sizes from the machine.

Think more on how we can do minimal system calls and reuse the cache sizes across all distance computations.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions