Pelica

Run huge AI models on the PC you already have.

Pelica is a free, open-source app for Windows. It runs models much larger than your graphics card by splitting them across your GPU, RAM and SSD, so a 164 GB model works on a 16 GB card. Nothing leaves your computer.

Windows 10 and 11, 64-bit · MIT license

The Pelica app: a chat where Qwen3 30B, running locally, writes a PowerShell script that sorts photos into folders by date.
Pelica 1.0 with Qwen3 30B, running on an RTX 5060 Ti at about 78 tokens a second.

How it works

The biggest open models, like DeepSeek V4 and Qwen3, are mixtures of experts. They're split into thousands of small expert networks, and each word only uses a few of them. So the whole model never has to sit in fast memory at once.

Pelica keeps the parts every word needs on the GPU, along with the experts the model reaches for most. The next tier waits in RAM. Everything else stays on your SSD and is read just in time: Pelica runs the next layer's router early to guess which experts are coming, and gets the top pick right about 99% of the time.

Experts move up as they're used and drop down when they go quiet, so the fast memory keeps working on whatever your conversation needs right now. None of this changes the model's answers. Every speedup is checked to produce exactly the same words.

Speed

Measured on a mid-range gaming PC: Ryzen 5 8400F, 32 GB of DDR5, an RTX 5060 Ti with 16 GB, and one PCIe 4 NVMe drive.

ModelSizeRuns onTokens/s
OLMoE 1B-7B4.2 GBGPU180
gpt-oss-20b12.3 GBGPU112–141
Qwen3 30B A3B18.6 GBGPU + RAM78
Qwen3.8 Flash Next94 GBGPU + RAM + SSD16.5
DeepSeek V4 Flash164 GBGPU + RAM + SSD4.5

A token is a word or part of one. For comparison, Colibrì runs GLM-5.3-Flash (320B) at 0.76 tokens/s on the same PC; Pelica runs it at 3.2.

# the engine also works on its own, from a terminal
pelica --model Qwen3-30B-A3B-Q4_K_M.gguf -p "Why is the sky blue?"

What else it does

Works in your folders

Point it at a folder and it can read, write and edit files and run commands. It asks before every command and shows every change.

Finds models that fit

The model library searches Hugging Face and tells you which models your PC can run before you download anything.

Projects and memory

Group chats with shared instructions and files, and have Pelica remember things about you between chats. You can see and edit all of it.

Web search and connectors

Any model can look things up online. Add MCP connectors for other tools, or bring over the ones you set up in Claude, Cursor or VS Code.

Your phone, your other PCs

Follow and answer a chat from your phone over Wi-Fi. Sign in with Google to sync chats between computers through your own Drive.

For developers

An OpenAI-compatible API on localhost, a pelica command for the terminal, and a second PC's RAM over the network for models that don't fit in one.

Privacy

Pelica is an app, not a service. Models run on your computer, your chats are saved on your computer, and there's no Pelica server, account system or analytics. It only goes online when you ask it to: downloading a model, searching the web, checking for updates, or syncing through your own Google Drive if you turn that on.

All of the code is on GitHub, so you can check this for yourself. The privacy policy has the details.

New in 1.0

Released November 1, 2026 · All releases

  • Projects: keep related chats together, with shared instructions, files and a folder.
  • Memory: ask Pelica to remember something and it will, in every chat after that.
  • Import: bring your chats over from a ChatGPT or Claude data export.
  • Pelica on your phone: scan a QR code and follow the open chat from your phone.
  • Connector sign-in: online connectors that need an account now sign in through your browser.

Questions

What do I need to run it?

Windows 10 or 11 (64-bit), a processor with AVX2 (Intel from 2013, AMD from 2015 onward) and a graphics card with Vulkan drivers. Small models run on most gaming PCs. For the very large ones you'll want 12–16 GB of graphics memory, 32 GB of RAM and a fast NVMe SSD.

Is it free?

Yes, and open source under the MIT license. There's no paid version. The models come with their own licenses, set by the people who made them.

Does it work offline?

Once a model is downloaded, yes. Chatting needs no internet at all.

Do I need CUDA or Python?

No. The installer has everything. Pelica talks to the graphics card through Vulkan, and the engine is a single program written in Rust.

Mac or Linux?

Not yet. Pelica is Windows-only for now.

Something's broken. Where do I report it?

Open an issue on GitHub. Include your graphics card and the model you were using if you can.

Download Pelica

Free for Windows 10 and 11.

Download for Windows