Inference

• Ollama — Serves open models locally over a simple HTTP API — the engine behind the local lane, run once on a GPU machine and shared across the set.

← All tags