Index 1,600,000,000 Keys with Automata and Rust (2015)
26 points by lorddimwit
26 points by lorddimwit
This is a classic. The FST crate is a pleasure to work with, thanks for making it BurntSushi!
When I started learning about FSTs it made me realize that “compressed” data isn’t necessarily “unusable”. In other words even though the data is compressed you can still perform queries on it without uncompressing it.
Love this article! So interesting in terms of memory management and compression.
We use the FST crate from BurtSushi at Meilisearch and it's a pleasure to work with. We store the word dictionary and, this week, we will try to split it with some predicate to be able to parallelize their modifications. Yes, FSTs are immutable data structures.