Tantivy is a full text search engine library written in rust.
It is strongly inspired by Lucene's design.
- Tiny startup time (<10ms), perfect for command line tools
- tf-idf scoring
- Basic query language
- Phrase queries
- Incremental indexing
- Multithreaded indexing (indexing English Wikipedia takes < 3 minutes on my desktop)
- Mmap directory
- optional SIMD integer compression
- Single valued and multivalued u64 and i64 fast fields (equivalent of doc values in Lucene)
- LZ4 compressed document store
- Range queries
- Faceting
- configurable indexing (optional term frequency and position indexing
- Cheesy logo with a horse
Tantivy supports Linux, MacOS and Windows.
- tantivy's usage example
- tantivy-cli and its tutorial. It will walk you through getting a wikipedia search engine up and running in a few minutes.
- [reference doc]
Tantivy requires Rust Nightly because it uses requires the features box_syntax, optin_builtin_traits, conservative_impl_trait,
and simd.
To check out and run test, you can simply run :
git clone [email protected]:tantivy-search/tantivy.git
cd tantivy
cargo +nightly build
If your project depends on tantivy, for better performance, make sure to enable
sse3 instructions using a RUSTFLAGS. (This instruction set is likely to
be available on most x86_64 CPUs you will encounter).
For instance,
RUSTFLAGS='-C target-feature=+sse3'
Or, if you are targetting a specific cpu
RUSTFLAGS='-C target-cpu=native' build --release
Regardless of the flags you pass, by default tantivy will contain SSE3 instructions.
If you want to disable those, you can run the following command :
cargo build --no-default-features
Alternatively, if you are trying to compile tantivy without simd compression,
you can disable this functionality. In this case, this submodule is not required
and you can compile tantivy by using the --no-default-features flag.
cargo build --no-default-features
Send me an email (paul.masurel at gmail.com) if you want to contribute to tantivy.