Run AI agents safely with Ollama and Fly.io

Ollama Cloud now works inside full Linux computers designed for agents using Fly.io Sprites.

A Sprite is a sandbox from Fly.io. Each one is a full Linux virtual machine with its own disk that stays around between sessions. Claude Code, Codex and Gemini CLI are supported out of the box and will let agents run in a sandbox to securely run commands.

With the new Ollama Connector, your Sprites can use Ollama’s cloud models like kimi-k3, glm-5.3 and deepseek-v4.1-flash.

You add your Ollama API key to your Fly.io organization, and Fly.io encrypts it and never returns it through the API.

When code inside a Sprite calls Ollama, it goes through a Fly.io gateway. The gateway checks which Sprite is calling and adds your key to the request. The Sprite itself only knows a gateway URL and a connection ID.

You’ll need an Ollama API key and at least one Sprite.

The connector page shows this command with your connection ID filled in. There’s no Authorization header because the gateway adds your key.

Any OpenAI SDK works. Set base_url to the gateway and use any value for api_key:

Ollama’s native /api/* routes work through the gateway too.

Fly.io Sprites come with a skill that tells Claude Code, Cursor, Codex and Gemini CLI about Ollama. If the Sprite has access, the agent can use Ollama models without any setup.

Fly.io has a guide that uses several models together. A small model like nemotron-3-nano:30b writes malformed inputs, a Sprite runs them against your program, and a larger model like kimi-k3 looks at the crashes. To switch models, change the model field. See the Ollama Connector quickstart.

Thank you to the Fly.io team for building this with us.