# llama.cpp: Raw Local Performance

llama.cpp provides the fastest local inference. Ishi connects directly for zero overhead.

## Why llama.cpp?

- **Maximum Speed** — No wrapper overhead
- **Full Control** — All quantization options
- **Minimal Resources** — Efficient memory usage
- **GGUF Support** — Industry-standard format

## Setup

Run llama.cpp server:

```bash
./server -m model.gguf --port 8080
```

Configure Ishi:

```json
{
  "provider": "llamacpp",
  "baseUrl": "http://localhost:8080"
}
```

* * *

_Get started: [Download Ishi](/content/download/index.html) \| [llama.cpp Docs](https://docs.ishi.so/providers/#llamacpp)_

## Try Ishi Today

Download Ishi and start automating your workflow with the Glass Box philosophy.

[Download Free](/content/download/index.html)