DAINAPP

Sketch2Color

Some Patrons may remember that some time ago I posted a few pictures of a sketch 2 drawing.

The project was sleeping for some time, but I been studying since then to improve Rife-App and learned a bunch of stuff during this time.

The new Rife-App (in training) use some stuff that I managed to use on this AI of mine as well.
So I have a few plans for this new AI. I want it to add shades and color as well. If the results are good enough, I'm planing to make it into a paid Softwar...

Clip-App 1.2

Here we go, fixed some stuff from the closed build.

Two new models. Diffusion V1 and V2.

They are both pretty good. V2 may be a little better, but who can tell with art?

Guidance Scale: Only used on Diffusion models, it affect how "Creative" the final output is. If you render images bigger than 512X512 you may want to make this value bigger. How big? You will need to test and see what you like. This value don't affect Vram.

Don't use F...

Clip-App command prompt working.

Clip-App is already working on the command prompt, for those who want to create some script around it.

The interface is also saving all the configuration, so you can close and open it without losing info.

Fixed some bugs that my fellow Patrons reported on the closed Build. The new build should be working very soon. Just want to try to improve a little more the memory usage for Diffusion, it really enjoy eating the Vram.

Also been training new mode...

Going full speed again.

After a slow January, I'm already working to release some stuff in a few days.

Clip-App: Got the new algorithm working, just fixing/improving some stuff on the GUI now. Bad news, my computer barely work with it, so I need someone willing to test the new build with a decent enough card? 8vram should work with a small resolution, more than that is welcomed

Dain-App: New algorithm is ready, animation model is already trained. I'm currently...

Clip-App information.

I been fighting a little with the implementation of the new algorithm for Clip-App.

The main reason is that it require JAX and it don't really like windows that much:

There is some initial native Windows support, but since it is still somewhat immature, there are no binary releases and it must be built from source.

On top of that, it need to work on a compiled version of PyInstaller, so i...

Working on a new Clip-App update.

I been experimenting with some new scripts for Clip-App. Plus I'm also doing a side project using it with a buddy. Here are some results from it. 

I got a server for this month so I could do some better renders with Clip, since my computer can't really handle it. Since it's December and everyone want to chill, I will pretty much take the advantage on the rent server and spend most of the time testing Clip Renders so later on I can add it to the build.

Rife-App 2.80

Here we go, the new update.

It have new models for animation and RL.

It have an alpha channel option for PNG seq. and gif output

A few minor fixes, like a filename with a dot in its name.

A lot of the memory improvements are kinda of experimental, so let me know if you find any error and I will fix asap.

Rife-App update later today.

Look at those models. Horray!

While I'm constantly working on the quality of the models, I think they are good enough for a release.

Gif is also improved.

Alpha option is back, for PNG sequence, and gif also get the alpha if both are turned on.

Anime Sharp give more detail on the edges, but the motion flow can look stiff, the smooth give worse edges, but the flow feel more natural.

Finally a somewhat decent Real-Life Model for Rife.

It seen than finally I am understanding the secrets to train a RL model, it also give me more freedom to the the results I prefer. This one is still training, but it's looking pretty nice.

The model for animation and RL should be ready til the end of the week.

Gaugan is cool and you should check it out.

It work on your browser, its the paintbrush of the future, paint some stuff or write some text and generate a landscape from it.

http://gaugan.org/gaugan2/

New Rife-App model looking so fly

Been working really hard to make Rife-App a somewhat stable application.

Fixed alpha export, plus now gif work with alpha (if turned on) and it should create crisp results overall.

The new model is looking really good. It is still in training for animation and still need to train for RL, but I have a good feeling it will work nicely for RL.

The editor for the InPaiting App is improving nicely, plus I can take some of the stuff I been improving on Rife-App and putt...

Got lama to work locally

Original

Mask

Result

The Ui is also starting to take shape, being able to drawn the mask directly on the UI and getting the result near real time. Still a lot of work to do, but this wil...

Interpolation video from Patron Owen Davies

A great video from Patron Owen Davies using the new Rife animation model and Topaz for upscale.

Rife-App 2.7

Here is the new version. Horray!

• 3 new animation models
• 2 new very WIP Real Life Models. 
• I'm still gonna try to improve all models, but RL need more work than animation.
• Improvements on bugs/memory usage
• The app now save your configurations once you hit Interpolate. You can put the default values again by hitting "Restore default App Values"

Feel free to drop any feedback on any of the models.

Rife-App updating later today.

There is 3 new Animation models and 1 new RL model.

RL have a bunch of stuff I need to worry that don't happen on animation, so it's been a really pain in the ass to make a good model, but it's fun, so I don't mind that much.

I also fixed a a lot of bugs to try to improve memory and remove flickering color from the final output.

There is also some new options. In this new version, once you hit "Interpolate" it save all your settings, if you close and open the app,...

Rife-App models update

• Anime Lite: 100%
• Anime Regular: 100%
• Anime Heavy: 100%
• RL Lite: 0%
• RL Regular: 100%
• RL Heavy: 70%

Real Life mode is interpreting better the shapes of new frames than older models, but Real Life is tricky, sometimes you want some blur to create a credible new frame, so perfect shapes can generate weird movements.

For this first version I will try to make the new frames as clean as possible, if the feedba...

Another thing

With the current development in the AI area, there is some new interesting libraries. So i'm starting to explore some stuff to make the projects work on AMD cards. Horray! Still to soon to know how well it will work.

Rife-App New models and next update.

I been testing and mixing a lot of ideas for models, putting it to the test and training, training and training it.

So far I have 3 models for animations.

• Fast: Similar to the one already released, give a little better results. For RealTime or just to test something really fast.
• Regular: Is faster than the current release and give better results, somewhat fast.
• Big Chungus (not really): The slower model, bu...
  2021-11-01 13:10:59 +0000 UTC View Post

Starting GUI for Interactive Mask Drawing.

Starting a GUI so you can mask photos and stuff on the APP using Lama:

https://github.com/saic-mdal/lama

It should be a small/medium size project using the codes I already have ready from the other projects.

In the future I will try to make it a Gimp Plugin, but since I don't have experience with this, it will have to wait a little.

If I make the animated animatio...

Would you use a AI tool to create simple animations?

I have a few ideas in mind, it would not be a tool that could create "Professional animations" or anything like that, it would be more of silly animations just to play a little and have fun.

It would work something like this:

• Select the eyes of a picture. Eyes start to blink
• Select the hair of a picture. It animate some wind on the hair.
• Select the body, start doing a little dance or something.

It's would be mostly a project for fun, ...

Newer versions of Rife-App soon.

It's been a little more than two months since I began training my own model for Rife-App, since then it's easily been a model training at least half of each week.

So let's say, 12h of training per day, for 60 days. That give more or less 720h of training.

The hardest part of training a model is that I need around 1:30h to see if a test will work, and sometimes need 8h of training to discover that a change is bad to the model.

While all this study about algorithm a...

Rife-App 2.60

Ok, I kinda of rushed this version, because on 2.50 there is a annoying bug. If you are using batch size != 1 it may crash at the end of the render.

• Bug fix if batch != 1
• Animation model have a Fast version and Quality Version
• Changed how color is handled. So if you feel like the colors are better/worse on RGB/YUV/10BIT, send me a message.

I didn't had the time to train the new models for RL, so in this one I just mad...

Rife Lite Model

1920X1080

Animation mode, around 4X frames

06:48 to render, but my CPU was the bottleneck, CUDA was around 20%

Not the best quality, but great for casual interpolations, can easily run in real-time on a decent computer.

Tom & Jerry with unreleased new model.

Preview on my new model.

Look how the subtitle is almost perfect, the last model messed it put a lot.

The last model is also slower than Rife Models, this new one is as fast or faster than Rife.

I'm also improving the YUV and 10bit color code to see if it will fix the weird colors here and there. YUV is already fixed, still need to test 10bit.

Also, working on a new update for Real-ESRGAN App.

For the Clip-App lovers, I'm working from time to time on the next u...

Rife-App 2.5 Released.

Here we go, after so many updates about it.

There is the new two models, hope they are good. For now they are a little slower from the default models, since I already had a hard time making they somewhat decent to use. In the future I can try to optimize them more.

• Fast Interpolation. This is a improved version of "Alternated Interpolation". For RL it usually not great, but it can work well on some animations. The advantage is that you can interpo...
  2021-10-09 00:32:06 +0000 UTC View Post

A little delay on the Rife-APP release.

Some personal issues made me delay a little the next update. I'm gonna try to release it today or tomorrow. 

Also I'm playing around with making a AI sketch2grayscale. My model algorithm isreally stupid, I'm surprised they work at all. lol

My methodology is pretty much this.

Very close to release the next Rife Update.

Animation model is complete. If my RL training goes well today, it should be finished tomorrow. The app changes also are pretty much complete. If everything goes well, I may be able to release the update tomorrow. 

A few examples using the full model of animation Rife.

The last few examples was using only the first part of the model, those are using all the model.

It's far from perfect, but I'm sure it can be improved with time. Some stuff like the subtitle letters will be hard to fix, since the AI sometimes try to priority the background animation.

https://streamable.com/158cc7

https://streamable.com/tba4...

Rife-App Wip Layout

For the next update. Also a bunch of bug fixes.