1. The Big Idea — One Format to Rule Them All
Almost every AI server today speaks the exact same standard protocol: OpenAI-compatible REST API.
Whether it's Ollama on your laptop, LM Studio on your desktop, Groq's ultra-fast cloud, OpenRouter with 200+ models behind one key, Mistral, DeepSeek API, or local vLLM / LocalAI instances — they all answer at an HTTP endpoint ending in /v1/chat/completions and expect:
Accelerated Logic AI allows you to configure unlimited custom endpoints. Once added, they behave identically to built-in models: you can equip them, activate them, hot-swap mid-chat, or include them in fallback chains.
2. Ollama — Run Models on Your Own Hardware (100% Private)
What it is: Ollama executes open-weight models directly on your local CPU or GPU. Zero data leaves your machine. Free, uncapped, and works completely offline.
- Download and install from ollama.com (Mac, Windows, Linux).
- Open your terminal and pull a model:
ollama pull llama3.2ollama pull qwen2.5-coder:7bollama pull llava
Browsers prevent web applications from connecting to local ports by default. If you run default ollama serve without CORS enabled, Accelerated Logic AI will show "Disconnected".
Start Ollama with CORS origins enabled:
If socket in use: Right-click Ollama llama icon in system tray -> Quit Ollama, then run command again.
Verify: Open http://127.0.0.1:11434 in your browser. It should say "Ollama is running".
- Open Model Organizer -> Select Provider Ollama.
- Click View Local Models. Connected indicator turns green when detected.
- Your installed models (e.g.
qwen2.5-coder:7b) appear in the list. Click Equip. - You can also type any model name and click Pull to download directly within Accelerated Logic AI with real-time progress indicators.
3. LM Studio — Desktop GUI for Local Models
LM Studio offers a rich visual desktop interface for running GGUF local models.
- Download LM Studio and load a model (e.g. Llama 3.2 3B Instruct).
- Go to the Local Server tab on the left.
- Ensure CORS is enabled in settings (toggle Enable CORS on).
- Click Start Server (default runs at
http://localhost:1234/v1). - In Accelerated Logic AI: Go to Model Organizer -> OpenAI Compatible -> Base URL:
http://localhost:1234/v1-> enter exact Model ID -> Add.
4. OpenRouter — One Key for 200+ Frontier Models
OpenRouter provides unified proxy routing to Claude, GPT-4o, Llama 405B, DeepSeek, Qwen, and Mistral through a single API key.
- Create an API key at openrouter.ai.
- In Accelerated Logic AI: Open Model Organizer -> OpenAI Compatible -> select provider preset OpenRouter.
- Base URL auto-fills to
https://openrouter.ai/api/v1. - Paste your API key (
sk-or-v1-...). - Click Fetch Models to dynamically load 200+ available models in a dropdown, or enter Model IDs like
anthropic/claude-3.5-sonnetordeepseek/deepseek-r1.
5. Groq — Ultra-Fast Hardware Inference
Groq delivers high-speed inference (300-800 tokens/sec) on Llama and Qwen open models.
- Get a free key from console.groq.com (
gsk_...). - Select preset Groq in Model Organizer (Base URL:
https://api.groq.com/openai/v1). - Enter Model IDs such as
llama-3.3-70b-versatileorqwen/qwen3-32band save.
6. Other Compatible Endpoints & URL Cleaning
- Together AI: Base URL
https://api.together.xyz/v1 - Mistral API: Base URL
https://api.mistral.ai/v1 - DeepSeek API: Base URL
https://api.deepseek.com/v1 - Custom vLLM / LocalAI: Select Custom Endpoint, enter your URL (e.g.
http://192.168.1.10:8000/v1).
💡 Automatic URL Cleaning: If you accidentally paste a full endpoint like .../v1/chat/completions, Accelerated Logic AI automatically strips redundant path segments and trailing slashes.
7. Managing Custom Models (Equip, Duplicate, Edit, Delete)
All custom providers appear in the Configured Custom Models manager.
Clicking Equip adds the model to your active toolbox and sets it as active in your composer.
Duplicate any custom endpoint configuration to quickly adjust provider keys or test secondary endpoints.
8. Privacy & Cost Comparison
| Provider Type | Privacy Level | Cost | Best Used For |
|---|---|---|---|
| Ollama / LM Studio | 100% Air-Gapped (Local RAM) | Free | Confidential code, offline work |
| Groq / Mistral | Encrypted Cloud Transit | Pay per token / Free tier | Ultra-fast agent loops |
| OpenRouter | Unified Router Proxy | Unified Account Billing | Model comparison & rare models |
9. Mixed Content & CORS Gotchas — Troubleshooting
Hosted HTTPS apps cannot directly fetch unencrypted http://localhost endpoints in some browser security policies.
Fix: Enable CORS properly, run local development server with npm run dev, or use cloud endpoints (Groq/OpenRouter) when on hosted previews.
Server rejected request origin header.
Fix: For Ollama, launch with OLLAMA_ORIGINS="*" ollama serve. For LM Studio, turn on "Enable CORS".
Ensure API key has no trailing spaces. For model IDs, verify exact tag (e.g. qwen2.5-coder:7b) via ollama list.
10. Practical Power-User Stack & Fallback Chains
ollama:qwen2.5-coder:7b— Private local codinggroq:llama-3.3-70b— High-speed general assistantopenrouter:claude-3.5-sonnet— Complex reasoning when stuckputer:deepseek-v4-flash— Free backup
In Settings -> Model Organizer -> Fallback Chains: Set Primary: Claude via OpenRouter -> Fallback 1: Groq Llama -> Fallback 2: Local Ollama.
If your primary key hits rate limits, Accelerated Logic AI seamlessly retries downstream models automatically.