I'll start off saying it will need retraining lol,
I was finally able to finish the data set for this, but it still needs tweaking, however it did occasionally generate much better results than I have had in the past.
It'll probably take me a couple of more weeks to fine tune everything, but I thought I'd share to let people know and see how it's coming along!
I'll have some updates on the TF lora soon!