The local AI app built for the Mac. Runs models far bigger than your Mac's memory.
Download · Website · Benchmarks · Discussions
TUFF runs language models on Apple Silicon Macs, including mixture-of-experts models far bigger than your memory, by streaming experts from the SSD. It's open source, and nothing you type leaves your Mac unless you turn on web search.
brew install --cask tuff-app/tap/tuff| Repository | What's in it |
|---|---|
| TUFF | The Mac app, the tuff command and the inference engines |
| sandbox | The Linux VM that runs web and file search in isolation |
| homebrew-tap | The Homebrew cask |
| tuff-app.github.io | The website and benchmark leaderboard |
| .github | This README |
They're one project and share one contributing guide, maintainer roles, security policy and code of conduct.