hey hey )
I hope u have had a good time these days,
if not, don't get upset - there's still a whole year ahead ;)
there will be no friday release, but I have great news - an announcement: I found a way to integrate a local model along with kobold into the desktop build (wow), it will work out of the box, without any additional steps
I need help finding the best starting model.
currently testing L3.1-EtherealRainbow-v1.0-rc1-8B-Q4_K_M.gguf
if u know something better, drop it in the comments or private messages, if nothing better is found - it will be included in the release version
how it will be:
two builds, one with embedded koboldcpp and the model (~5.5gb), the second as usual, resulting in a lite version (but i am considering embedding koboldcpp into it as well, it weighs 500mb, doesn't seem too much)
when:
I think I can finish integration in 4-5 days, fix the issues with local models in the game (action/event triggers) and release the beta
have a nice weekend 😏

Latis
2025-01-03 20:10:41 +0000 UTC