https://ai-blog.noorshomelab.dev/tags/offline/Recent content in Offline on AI VOIDHugoenTue, 30 Dec 2025 00:00:00 +0000https://ai-blog.noorshomelab.dev/any-llm-guide-2025/local-llms-ollama/Tue, 30 Dec 2025 00:00:00 +0000https://ai-blog.noorshomelab.dev/any-llm-guide-2025/local-llms-ollama/<h2 id="introduction-bringing-llms-home">Introduction: Bringing LLMs Home</h2> <p>Welcome back, future AI architect! So far in our <code>any-llm</code> journey, we&rsquo;ve largely focused on interacting with powerful cloud-based LLMs like OpenAI, Anthropic, or Mistral. These services are incredible for their scale and performance, but what if you need more privacy, lower latency, or simply want to experiment without incurring API costs?</p> <p>This chapter is all about bringing the power of Large Language Models directly to your machine. We&rsquo;ll dive into the exciting world of <strong>Local LLMs</strong> and learn how to run them efficiently using a fantastic tool called <strong>Ollama</strong>. Best of all, we&rsquo;ll see how <code>any-llm</code> seamlessly integrates with Ollama, allowing you to switch between local and cloud models with minimal code changes. Pretty neat, right?</p>