Comfyui and Daz

2»

Comments

  • charlescharles Posts: 846

    marble said:

    I wish there was a Thank-you button for these posts, but thank you anyway.

    I have an RTX 4080 with 16GB - that will have to do because I can't afford to change up now.

    On reading your workflow I think I might have installed the wrong setup and maybe should delete it all and start again. I have downloaded several Flux packages but not yet installed them. I also have Pinokio but I'm not sure what that gives me over and above the stand-alone versions. I have Comfyui but it is a portable version - self-contained. So do you think I should dump it all and start over? All of it has been free downloads so I'm not losing anything.

    I am open to a comfyUI workflow, but currently am only using A1111, Forge has some issues that make it a no go for me, basically the authoer by integrating ControlNet does not have it up to date enough. Checkout my new thread above for my current workflow. I would just reinstall A1111's and go wtih that. 

  • SnowSultanSnowSultan Posts: 3,595
    edited October 10

    Could you explain a little about why Flux is not as useful at the moment as A1111? I was thinking of reinstalling an AI setup (I used A111 and Forge, then Comfy a little, then removed them all), and was planning on trying Flux. Thank you for the very detailed tutorials, these are pages well worth bookmarking.

    Post edited by SnowSultan on
  • marblemarble Posts: 7,500

    I'm working through a few YouTube tutorials at the moment trying to get my head around what all these strangely named things actaully do. I find this guy quite easy to follow and he seems to be a big fan of Flux and Forge ...

  • charlescharles Posts: 846
    edited October 11

    marble said:

    I'm working through a few YouTube tutorials at the moment trying to get my head around what all these strangely named things actaully do. I find this guy quite easy to follow and he seems to be a big fan of Flux and Forge ...

    You can not do my workflow currently in ForgeUI, because it does not use the latest Control Net, where in A1111, ControlNet is managed by a third part and is an extension addon. In ForgeUI it is built in, and is not up to date, and does not support control nets with Multi-Input for images.

    I wrote an etension that will inject multi-input, but still there is other issues going on inside Forge's CN that doesn't work well with the process.

    ForgeUI would be nice, because it does have the strength of being more resource friendly then A1111, kind of, when it works. Because it doesn't always..and actually can be more of a hog when it breaks..which I can go into more but it's a lengthy technical post..just when using it watch your GPU RAM inside TaskManager. But this could be because I don't have the right VAE's setup, I basically was just using what I used in A1111. SInce I already decided not ot use it I haven't spent anymore time looking into it.

    The request for this has been going on for a while, see this thread in Forge's discussions: https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/178

    If the developer for Forge ever wants to fix this I will return and give it a try again.

     

    Post edited by charles on
  • charlescharles Posts: 846
    edited October 11

    SnowSultan said:

    Could you explain a little about why Flux is not as useful at the moment as A1111? I was thinking of reinstalling an AI setup (I used A111 and Forge, then Comfy a little, then removed them all), and was planning on trying Flux. Thank you for the very detailed tutorials, these are pages well worth bookmarking.

    I tested Flux the first time the other night. If you just want to create with it great, especially when it comes to Txt2Img. If you are wanting to convert your Daz scenes and character and bring them to life using Flux and Img2Img, well I wasn't impressed. This is mainly because the model's I recommend such as PhotoGasm are SD1.5 that have been further trained on large amounts of quality photos only. cartoonish and anime stuff has been surpressed.  So it's more of a niche model set. Where there are lots of niche model sets, some like ony trained in anime, or Asian women. These styles depend on what you want to achieve with your work, my workflow is for photo realism.

    People are working right now on doing the same thing with Flux, but good training on large sets to niche it out will take time.

    https://www.daz3d.com/forums/discussion/704766/chuck-s-ai-bumping-thread

    Post edited by charles on
  • SnowSultanSnowSultan Posts: 3,595

    Thank you for the explanation. Have you tried SwarmUI? I downloaded that, but have not installed it yet. It seems to be a very good updated system that can handle SD 1.5, XL, Flux, and has an optional ComfyUI you can access for more precise workflows.

  • marblemarble Posts: 7,500
    edited October 11

    charles said:

    marble said:

    I'm working through a few YouTube tutorials at the moment trying to get my head around what all these strangely named things actaully do. I find this guy quite easy to follow and he seems to be a big fan of Flux and Forge ...

     

    You can not do my workflow currently in ForgeUI, because it does not use the latest Control Net, where in A1111, ControlNet is managed by a third part and is an extension addon. In ForgeUI it is built in, and is not up to date, and does not support control nets with Multi-Input for images.

    I wrote an etension that will inject multi-input, but still there is other issues going on inside Forge's CN that doesn't work well with the process.

    ForgeUI would be nice, because it does have the strength of being more resource friendly then A1111, kind of, when it works. Because it doesn't always..and actually can be more of a hog when it breaks..which I can go into more but it's a lengthy technical post..just when using it watch your GPU RAM inside TaskManager. But this could be because I don't have the right VAE's setup, I basically was just using what I used in A1111. SInce I already decided not ot use it I haven't spent anymore time looking into it.

    The request for this has been going on for a while, see this thread in Forge's discussions: https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/178

    If the developer for Forge ever wants to fix this I will return and give it a try again.

     

     

    Yes, sorry - I wasn't trying to suggest the video describes a better method. I was just saying that I am looking at several tutorials to try to understand what each do. 

    Post edited by marble on
  • charlescharles Posts: 846
    edited October 11

    SnowSultan said:

    Thank you for the explanation. Have you tried SwarmUI? I downloaded that, but have not installed it yet. It seems to be a very good updated system that can handle SD 1.5, XL, Flux, and has an optional ComfyUI you can access for more precise workflows.

    I have not heard of it, it will depend if it meets the current requirements, Up to date ControlNet that fully supports all IpAdapters and Multi-Input images. If it also has a compatible extensions system with A1111, which ForgeUI actually does, my FacePop, Overlay work very well with both.

    FacePop: https://github.com/TheCodeSlinger/FacePop

    Overlay: https://github.com/TheCodeSlinger/SD-WebUI-Overlay-PNG

    If it doesn't, if it's some crazy new process that requires too much rework for such extensions I don't know if it will be right for me.

    Keep in mind I'm sharing my workflow, which I am open to new ideas, but at the same time not willing to go back to the drawing board from scratch.

    A1111 can handle not just SD but SDXL as well, and does well, I see a post about Flux, which knowing how Flux is setup, A1111 should be able to handle it fine, Flux is just another model, it won't work with the current control nets, but there seems to already be CN's and even an IpAdapter adjustment for it....eager to try those soon.

     

     

     

     

    Post edited by charles on
  • charlescharles Posts: 846
    edited October 11

    marble said:

    charles said:

    marble said:

    I'm working through a few YouTube tutorials at the moment trying to get my head around what all these strangely named things actaully do. I find this guy quite easy to follow and he seems to be a big fan of Flux and Forge ...

     

    You can not do my workflow currently in ForgeUI, because it does not use the latest Control Net, where in A1111, ControlNet is managed by a third part and is an extension addon. In ForgeUI it is built in, and is not up to date, and does not support control nets with Multi-Input for images.

    I wrote an etension that will inject multi-input, but still there is other issues going on inside Forge's CN that doesn't work well with the process.

    ForgeUI would be nice, because it does have the strength of being more resource friendly then A1111, kind of, when it works. Because it doesn't always..and actually can be more of a hog when it breaks..which I can go into more but it's a lengthy technical post..just when using it watch your GPU RAM inside TaskManager. But this could be because I don't have the right VAE's setup, I basically was just using what I used in A1111. SInce I already decided not ot use it I haven't spent anymore time looking into it.

    The request for this has been going on for a while, see this thread in Forge's discussions: https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/178

    If the developer for Forge ever wants to fix this I will return and give it a try again.

     

     

    Yes, sorry - I wasn't trying to suggest the video describes a better method. I was just saying that I am looking at several tutorials to try to understand what each do. 

    Absolutely, I have been a sub for that guys channel for a long time and watch most of his stuff. I find his puns very entertaining.

    It is a bit overwhelming, I grant that. There is a lot of independent players from billion dollar coporations calling themselves opensource when they are nothing of the sort to indie 1 person dudes like me doing it as a hobby.

     

    Post edited by charles on
Sign In or Register to comment.