XaiJu
Multiic
Multiic

patreon


•ᴗ•

hey hey )
I hope u have had a good time these days,
if not, don't get upset - there's still a whole year ahead ;)

there will be no friday release, but I have great news - an announcement: I found a way to integrate a local model along with kobold into the desktop build (wow), it will work out of the box, without any additional steps

I need help finding the best starting model.
currently testing L3.1-EtherealRainbow-v1.0-rc1-8B-Q4_K_M.gguf 
if u know something better, drop it in the comments or private messages, if nothing better is found - it will be included in the release version

how it will be: 
two builds, one with embedded koboldcpp and the model (~5.5gb), the second as usual, resulting in a lite version (but i am considering embedding koboldcpp into it as well, it weighs 500mb, doesn't seem too much)

when: 
I think I can finish integration in 4-5 days, fix the issues with local models in the game (action/event triggers) and release the beta

have a nice weekend 😏

•ᴗ• •ᴗ•

Comments

Hi ! On my side, I'm trying this one : https://huggingface.co/TheDrummer/Moistral-11B-v3-GGUF/blob/main/Moistral-11B-v3-Q8_0.gguf I think this one is better, except for event, hints and display some source-code in a purple box... There is Q6 and Q4 in case the size is too much and need a powerful PC. RP is nicely supported and uncensored (tried: porn, sci-phy, horror, tentacles, rape, romance...) and well written. Can support french, it's approximative but understandable.

Latis


More Creators