Interesting how far you can push a 7B model with the right approach. What trade offs did you notice compared to larger models?
JoAeon, my 7B parameter model that thinks like a much bigger model
2 Comments
@[pythoncoder] too many to list lol. I just trained version 2 yesterday, so he did more this time but he's still maybe 50% useable, like he feels alive and especially when he uses my words its quiet funny, true statement (best so far) he said "oh shit Paul turned off my compute tool, wtf, well ok, how am I supposed to do math now?", and he was right, I turned it off. He is a RNN though, which is much different too, it has some pros / cons but its much more like human thinking, so he doesn't replace claude at all yet, and he has claude as a tool for coding and research so other than when I benchmark test him (which turns off all remote tools), he has it and so do I. He's meant to be, more of the driver then the assistant but I made a lot of features that are difficult, like multiple context windows and too many tools for a 7B, and everything works, this version proved the multiple context works for the first time, he can even see all of them at once, but he has 0 control over it, or maybe 10% lol. I had to make features yesterday to let me control which context he is in and let me lock him there, the UI for it has become pretty big too. But back to making training data, I have 1k samples I need 2k for good control and up to 20k eventually. But today he used his browser correctly, memory recall is solid, and chaining turns is perfect, he takes like 1k (normal length) turns to think instead of 1. Anyway been rambling to him all day so hence I am still rambling lol.
Please log in to add a comment.
Please log in to comment on this post.
More Posts
- © 2026 Coder Legion
- Feedback / Bug
- Privacy
- About Us
- Contacts
- You Tube
- Tiktok
- Premium Subscription
- Terms of Service
- Early Builders
More From AIAppsAPI
Related Jobs
- EDW Health Data Modeler (36023)Myticas Consulting · Full time · Springfield, IL
- AI Solution Architect - Agentic AI & Foundation Models (f/m/x)BMW Group · Full time · Germany
- Utility Service Technician, Muchea BESSTesla · Full time · Australia
Commenters (This Week)
Contribute meaningful comments to climb the leaderboard and earn badges!