ChronosDB: Bi-temporal versioning for vector embeddings
DiscussionComments
If this thing balloons in size, how are we actually supposed to deploy it? I want to know if this can run on a standard NVMe drive or if it requires a massive SAN to handle that versioning bloat.
We saw a similar attempt to use OpenRaft for a high-throughput state store a few years back. The consistency overhead usually kills the very latency gains vector search is supposed to provide.
That makes sense... especially since adding a temporal dimension to an HNSW graph usually requires a full re-scan or a complex filtering layer... it could really tank the QPS!
The latency is one issue. The real concern is storage amplification; keeping every version of a high-dimensional vector will bloat the disk usage exponentially.
This isn't a database update. It is a play for the AI audit market where companies need to prove why a model gave a specific answer on a specific Tuesday.