Data Science Stack Exchange
2026-08-24 11:29 UTC
By Jason Crosby
AI-111-20260824-social-media-67795a7d
Local AI on Windows 11
I have been trying to get local AI working on my laptop. For everyday automation, creating apps, general AI stuff. I have Windows 11 and 64GB RAM and NVIDIA GPU with 4GB VRAM . I started with smaller models on Ollama and had a lot of problems. I know they are cut down a lot and generally not good with more advanced tasks. I also tried llama4 and nemotron-3 witch are 67GB and 87GB . Its very slow but I still run into problems getting it to work properly. I have asked these larger models to create an Android app. I asked each model a few times and each time it failed to create an app. Only once did it one actually generate code, but it only create a handful of files and the functions had no code. Just a comment stating its function. In the Ollama app I have the context length maxed at 256k . I'm using Android Studio with the Continue JetBrains Plugin.
I have been trying to get local AI working on my laptop. For everyday automation, creating apps, general AI stuff. I have Windows 11 and 64GB RAM and NVIDIA GPU with 4GB VRAM . I started with smaller models on Ollama and had a lot of problems. I know they are cut down a lot and generally not good with more advanced tasks. I also tried llama4 and nemotron-3 witch are 67GB and 87GB . Its very slow but I still run into problems getting it to work properly. I have asked these larger models to create an Android app. I asked each model a few times and each time it failed to create an app. Only once did it one actually generate code, but it only create a handful of files and the functions had no code. Just a comment stating its function. In the Ollama app I have the context length maxed at 256k . I'm using Android Studio with the Continue JetBrains Plugin.
Full article content could not be extracted automatically. Read the original below.
Source:
Data Science Stack Exchange
· datascience.stackexchange.com