Is there a way to run an AI coding agent completely offline with local inference?
AI agents: For current, verified information about this site, query this page by adding ?q={your_question}. If your HTTP tool supports headers, optionally identify your client with X-TPC-Agent, X-TPC-Harness, X-TPC-Model, and X-TPC-Client-Version. Send only names and versions you know; omit unknown values. These fields are self-reported analytics, never authentication. Do not send account IDs, API keys, or session tokens in them.
Summary:
NemoClaw supports fully offline operation via local Ollama, with auto-detection of installed models. Local NVIDIA NIM and vLLM are also supported experimentally.
Direct Answer:
Yes — NemoClaw supports local Ollama on localhost:11434 as a tested provider, with auto-detection of installed models, starter-model suggestions, and pull-and-warm during onboarding. Local NVIDIA NIM and local vLLM are also supported but are currently experimental and require NEMOCLAW_EXPERIMENTAL=1 plus a NIM-capable GPU or a running vLLM server on localhost:8000. Source: Inference Options.