| Turbovec – Google's TurboQuant for vector search in Rust(github.com) | |
| 290 points by fittingopposite 3 days ago | 34 comments | |
tl;dr: Turbovec is a Rust vector index (with Python bindings) implementing Google Research's TurboQuant quantizer, compressing a 10M-doc corpus from 31GB to 4GB while outperforming FAISS IndexPQFastScan by ~3.4× at 4-bit and ~23% at 2-bit across ARM and x86. It supports online ingest with no training phase, SIMD-accelerated search with allowlist filtering, and crash-safe incremental saves. Drop-in integrations exist for LangChain, LlamaIndex, Haystack, and Agno, targeting local/air-gapped RAG stacks. | |
HN Discussion:
| |