InfoWorld AI
2026-09-15 09:00 UTC
Score 74.0
USR-0126-20260915-global-ai-ne-744e724f
If you like the idea of running an LLM on your own computer but tried awhile ago and were disappointed, it may be time to give it another chance. “A few months ago, any LLM that I could run on my Macbook scored 0% on an agentic coding eval I put together,” Simon P. Couch, senior software engineer at Posit, posted on Bluesky this spring. “[The April] Qwen 3.5 and Gemma 4 releases both scored 90%.” A model running on your laptop still won’t come close to what a state-of-the-art LLM from Anthropic or OpenAI can do in the cloud. But for defined tasks like answering coding questions, writing functions, or summarizing documents, they can be surprisingly capable. “Laptop-available models, while a lot weaker than the frontier, have started wildly outperforming expectations,” open-source developer Simon Willison, who follows the AI industry closely, said in his PyCon US 2026 lightning talk in May. There are many ways to run local models on a PC or Mac. Ollama , while perhaps not the fastest, is among the most popular and easy to set up. It’s also supported out of the box by many mainstream programming tools such as Visual Studio Code , JetBrains AI Assistant , Zed , and Posit Assistant . Ollama also can launch Claude Code or Codex with the option to use a local LLM. I’ll be focusing on Ollama here, but many other tools are available for running LLMs locally, such as LM Studio , Jan , Unsloth , Simon Willison’s LLM , and llama.cpp . You can download Ollama and install it as a conventi…