Three transformer models, downloaded once and executed in this tab via WebAssembly. Semantic similarity, cross-encoder reranking, and keyword vs semantic search. No server, no API key, and nothing you type leaves your machine.
Everything on this page runs client-side. The model is all-MiniLM-L6-v2 quantised to int8, executed by Kjarni compiled to WebAssembly with SIMD.
There is no inference server behind this page. Open your network tab: after the initial model download, ranking a query makes zero requests.
all-MiniLM-L6-v2, quantised to int8 — 23 MB. It downloads once and runs entirely on this page. Nothing you type is sent anywhere.
Every sentence becomes a 384-dimension vector. Ranking is the cosine angle between the query vector and each of the others.
A different model and a different shape of computation. The similarity tab encodes each sentence separately and compares the vectors. A cross-encoder reads the query and one document together and scores that pair directly. Slower, since it is one forward pass per document, and considerably sharper at the top.
An index is built in this tab from the text below, then queried three ways. BM25 matches literal words. Semantic matches meaning and misses exact tokens. Hybrid combines them, which is why it is the default.