Lately I’ve been juggling a few practical challenges while experimenting with offline AI models, and it’s been more insightful than I expected.
1. System-level friction
I ran into issues with symlinks breaking unexpectedly and model transfers bet...
1. Why I tried this.
2. My setup.
3. The problems I faced.
4. The tweaks I discovered.
5. Results.
6. Lessons.
THE WHY:
I’ve always wanted to explore deep conversations with AI and understand how these systems work. For a long time, that dre...
I had this idea to run AI locally on my own laptop. Just to see if I could. Ended up going with Ollama.
At first it was brutal — all CPU, no GPU, super slow. But I messed around, tweaked some stuff, and finally got it to actually run okay. Not fast,...