Claude Code is Anthropic’s powerful agentic CLI tool designed for automated codebase refactoring, file editing, test execution, and terminal task completion. However, relying on commercial API credits can quickly become expensive for students, hobbyists, and independent developers working on tight budgets. By routing Claude Code CLI through an OpenAI-compatible local proxy powered by Ollama, students can unlock full agentic coding capabilities on their own hardware with zero API billing or credit card requirements.
This comprehensive guide walks through configuring local open-weights coding models—such as Qwen 2.5 Coder 14B, DeepSeek-R1 8B, and Llama 3.3 70B Quantized—to work seamlessly with the Claude Code agentic CLI interface.
Key Takeaways
- Connect Claude Code CLI to free, locally-hosted LLMs using Ollama's OpenAI-compatible endpoint.
- Eliminate API credit limits, monthly subscriptions, and credit card verification requirements.
- Run specialized coding models like Qwen 2.5 Coder 14B and DeepSeek-R1 locally with 100% data privacy.
- Configure environment variables (`ANTHROPIC_BASE_URL` or LiteLLM proxy) to override remote API calls.
What is the zero-cost Claude Code and Ollama architecture?
The zero-cost architecture redirects Claude Code’s Anthropic API calls to a local OpenAI-compatible endpoint hosted by Ollama or LiteLLM on localhost:11434. This allows the agentic CLI interface to process code generation, tool calls, and file edits locally on your GPU/CPU without communicating with cloud billing APIs or incurring per-token charges.
+-----------------------------------------------------------------+
| Claude Code CLI Agent |
+-----------------------------------------------------------------+
|
| (ANTHROPIC_BASE_URL=http://localhost:4000/v1)
v
+-----------------------------------------------------------------+
| LiteLLM Proxy / Router |
| (Translates Anthropic Messages -> OpenAI/Ollama) |
+-----------------------------------------------------------------+
|
| (http://localhost:11434/v1)
v
+-----------------------------------------------------------------+
| Ollama Engine (Local GPU) |
| [ Qwen 2.5 Coder 14B / DeepSeek-R1 8B ] |
+-----------------------------------------------------------------+How do you install and configure Ollama with coding models locally?
Installing Ollama requires downloading the open-source CLI runtime and pulling a specialized coding model optimized for tool use and instruction following. Models like Qwen 2.5 Coder feature native function calling support, allowing the agent to read and modify files accurately.
# 1. Install Ollama on Linux or macOS
curl -fsSL https://ollama.com/install.sh | sh
# 2. Pull Qwen 2.5 Coder 14B (Optimal balance of speed and code quality for 16GB RAM)
ollama pull qwen2.5-coder:14b
# 3. Alternatively, pull DeepSeek-R1 8B for reasoning-heavy tasks
ollama pull deepseek-r1:8b
# 4. Verify Ollama is running and accessible on localhost:11434
curl http://localhost:11434/api/versionHow do you configure Claude Code environment variables for custom local endpoints?
Claude Code CLI supports API base URL overrides via environment variables, allowing it to target a local translation proxy. Using litellm as an interim proxy translates Anthropic API payload structures into Ollama-compatible formats seamlessly.
Step 1: Install and Launch LiteLLM Proxy
# Install LiteLLM proxy via pip or uv
uv pip install 'litellm[proxy]'
# Create a config.yaml mapping Anthropic Claude models to local Ollama models
cat << 'EOF' > litellm-config.yaml
model_list:
- model_name: claude-3-5-sonnet-20241022
litellm_params:
model: ollama/qwen2.5-coder:14b
api_base: http://localhost:11434
- model_name: claude-3-7-sonnet-20250219
litellm_params:
model: ollama/qwen2.5-coder:14b
api_base: http://localhost:11434
EOF
# Start LiteLLM proxy on port 4000
litellm --config litellm-config.yaml --port 4000Step 2: Configure Environment & Execute Claude Code
In a new terminal window, export your local proxy credentials and launch Claude Code CLI:
# Install Claude Code globally via npm
npm install -g @anthropic-ai/claude-code
# Point Claude Code CLI to your local LiteLLM proxy
export ANTHROPIC_BASE_URL="http://localhost:4000"
export ANTHROPIC_API_KEY="sk-local-student-key"
# Launch Claude Code agent in your project directory
claudeWhat are the best free local models for coding in 2026?
Qwen 2.5 Coder 14B and DeepSeek-R1 8B are the top open-weights models for local agentic coding due to their high score on HumanEval benchmarks and native tool-calling capabilities.
| Model | Size | Min VRAM / RAM | Strengths | Ideal For |
|---|---|---|---|---|
| Qwen 2.5 Coder 7B | 7B Params | 8GB RAM | Ultra-fast execution, low RAM usage | Laptops / M1 Mac Air |
| Qwen 2.5 Coder 14B | 14B Params | 16GB RAM | High code accuracy, strong function calling | M1/M2/M3 Mac 16GB, RTX 3060 |
| DeepSeek-R1 8B | 8B Params | 12GB RAM | Deep chain-of-thought reasoning | Algorithmic logic & math |
| Llama 3.3 70B (Q4) | 70B Quantized | 48GB VRAM | Near-Sonnet code capability | Desktop Workstations / RTX 4090 |
How do you test and troubleshoot local agent execution?
Verifying local agent execution involves testing simple commands to ensure that LiteLLM receives request payloads and Ollama streams tokens back without timing out.
# Check if LiteLLM proxy is receiving requests
curl http://localhost:4000/health
# If Claude Code times out, increase the request timeout limit:
export ANTHROPIC_TIMEOUT=300000
# Test a simple non-interactive Claude Code command:
claude -p "Explain the main function in index.ts"Frequently Asked Questions
Can I run Claude Code completely offline without internet?
Yes. Once Ollama, LiteLLM, and Claude Code CLI are installed locally, all inference runs 100% on your machine’s hardware without sending data to any remote cloud servers.
Do I need a paid Anthropic API key or credit card?
No. By pointing ANTHROPIC_BASE_URL to your local LiteLLM proxy (http://localhost:4000), you bypass cloud authentication entirely. You can enter any dummy string for ANTHROPIC_API_KEY (e.g. sk-local-student-key).
What to Read Next
- Claude Code CLI Cheat Sheet — Master commands, rules, and configuration flags.
- Ollama CLI Cheat Sheet — Manage local LLMs, quantizations, and model files.
- Claude Code vs Cursor IDE Comparison — Compare terminal agent workflows with IDE extensions.
- Linux Bash Cheat Sheet: Commands & Scripting — Essential terminal commands.



