Documentation · Documentation
Offline use and the model cache
Where models are cached, how to move the cache, and how to ship models with an application.
Models download on first use and are cached in ~/.cache/kjarni on Linux and macOS and
%LOCALAPPDATA%\kjarni on Windows. Once a model is cached, no network is used. Set
KJARNI_CACHE_DIR to move the cache, or pass a cache directory per model in the binding.
A pre-filled cache folder can ship with an application, read-only, so it never needs the
network at all. Set HF_TOKEN for gated HuggingFace models.
Kjarni runs the same engine on every platform: