StreamDiffusionTD 0.1.8 🚀🖼️ [ Changelog ]
Added 2024-04-21 22:22:39 +0000 UTCGet the TOX - www.patreon.com/posts/102788463
Important ! This version of StreamDiffusionTD replaces NDI + Spout with a faster solution for improved performance. However, I am planning to reintegrate ndi in the next version in a way that makes it easier to run non locally. 0.1.8 will only work locally on a single machine, but will be expanding support for non local.
[ EDIT - 0.1.9 Version fixes possible error when switching resolutions + issues with finding shared memory ]
Changelog:
Less latency, higher fps, and improved diffusion quality by replacing ndi+spout with direct memory buffer.
All handled inside of operator for you. If there are errors, perhaps change the 'Stream Out Name' in Stream Settings 2 and restart the stream.
You might notice a different curve on the denoising step sliders / T Index LIst.
It should be a bit more even through the steps and will better resemble input mage at higher values.
Improved input image coherence after diffusion
Added logic to automatically handle the memory i/o
Operator should handle loading output from StreamDiffusion better. No more disable/reenable needed.
In the works:
Many things I am testing / building with StreamDiffusion backend ... including tensorrt sdxl-turbo, prompt weighting, ip adapter images, controlnet, and also experimenting with stable diffusion + diffusers directly inside of TD. If you have any experience with any of these things and want to jam on some diffusers stuff, let me know !!
Enjoy ! 🧪
Comments
It is working currently. I've been using the 4 step lora as a Custom LCM lora. I've done a bit of work on the model loading process as well. will be posting update soon. also dm me on discord and can share latest
dotsimulate
2024-05-04 02:56:06 +0000 UTCHey! Any plans to incorporate Hyper-SD?
melt.immersive
2024-05-03 11:27:01 +0000 UTCthanks <3
melt.immersive
2024-04-22 22:17:37 +0000 UTCJust posted a fix for the resolution ! Found what was causing the issue definitely and tested across many resolutions. Note : will change resolution to multiplier of 8 pixels due to pipeline requirements.
dotsimulate
2024-04-22 19:10:59 +0000 UTCtry this one ! https://www.patreon.com/posts/102788463
dotsimulate
2024-04-22 19:08:04 +0000 UTCwill post one soon with a fix. I thought I had logic to catch that.
dotsimulate
2024-04-22 18:06:49 +0000 UTCwill post one soon with a fix. I thought I had logic to catch that.
dotsimulate
2024-04-22 18:06:46 +0000 UTCI can confirm - no resolution other than 512x512 works :/
melt.immersive
2024-04-22 16:44:17 +0000 UTC"Error in extracting image data: cannot reshape array of size 790528 into shape (800,800,3)"
Wingto
2024-04-22 08:47:18 +0000 UTCAny resolution different to 512x512 is not working. Acceleration is disabled.
Mikhail Kozlov
2024-04-22 07:52:35 +0000 UTCme too ! :(
Juan Jiménez
2024-04-22 05:13:52 +0000 UTCi have errors if i change the resolution to something different of 512x512 :/
Michele Di Pasquale
2024-04-21 22:42:11 +0000 UTCThanks! Excited to try this version.
Ethan Alloway
2024-04-21 22:26:36 +0000 UTC
