@armando
Hey there,
I am going into a deep dive over in TouchDesigner land to try and get good results from dotSimulate's implementation of realtime Image Diffusion with his "Stream DiffusionTD" project.
So far I've been able to get it to work on my M3 MacBook Pro @ ~4-7fps and on a Windows computer ~18-20 fps with an Nvidia graphics card.
I'm still very new to all of this but I think that I can confidently answer at least your first question "Question Does this means that I might end up with multiple virtual environments that might contain mumpy for instance ?":
1) - Yes, you might end up with multiple VENV(ironments) for different instances of something you are working on. I have ended up with between over 5 different attempted installations of StreamDiffusion on my computer as I've tried to get it to work. I just added a new installation recently because there was an update from DotSimulate and I didn't want to accidentally break my previous installation so I just made a new one and now have both in a working state.
In terms of all the common libraries. . . . I know that NumPy was one of the ones I had to struggle with getting the correct version installed of to make this work . . .
Here is a video describing the install process for StreamDiffusionTD: