Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 diffusion Open-Source Projects
-
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
-
Scout Monitoring
Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
-
easydiffusion
Easiest 1-click way to create beautiful artwork on your PC using AI, with no tech knowledge. Provides a browser UI for generating images from text prompts and images. Just enter your text prompt, and see the generated image.
-
mmagic
OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic 🪄: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, for text-to-image generation, image/video restoration/enhancement, etc.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
Rerender_A_Video
[SIGGRAPH Asia 2023] Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation
-
minisora
MiniSora: A community aims to explore the implementation path and future development direction of Sora.
-
sd-webui-inpaint-anything
Inpaint Anything extension performs stable diffusion inpainting on a browser UI using masks from Segment Anything.
-
Pallaidium
Generative AI for the Blender VSE: Text, video or image to video, image and audio in Blender Video Sequence Editor.
-
stable-diffusion-docker
Run the official Stable Diffusion releases in a Docker container with txt2img, img2img, depth2img, pix2pix, upscale4x, and inpaint.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Show HN: I made an app to use local AI as daily driver | news.ycombinator.com | 2024-02-27* LLaVA model: I'll add more documentation. You are right Llava could not generate images. For image generation I don't have immediate plans, but checkout these projects for local image generation.
- https://diffusionbee.com/
- https://github.com/comfyanonymous/ComfyUI
- https://github.com/AUTOMATIC1111/stable-diffusion-webui
Stable diffusion because it's free and has tons of customization, EasyDiffusion is the simplest to install. But you should download custom models from Civit.ai because the default one is bad.
Diffusion unet has an "extended" version nowadays that applies to the resnet part as well as the cross-attention: https://github.com/cloneofsimo/lora
Project mention: You know what I REALLY want? Something like img2img but for sound/music. | /r/StableDiffusion | 2023-12-04Why don’t you try Riffusion? https://github.com/riffusion/riffusion The general idea is convert your audio waveform into an image (spectrogram).
Project mention: List of Stable Diffusion research softwares that I don't think gotten widespread adoption. | /r/StableDiffusion | 2023-12-10https://github.com/williamyang1991/Rerender_A_Video -
Project mention: New Kandinsky 2.2 was released. Now with controlnets and code for lora fine-tuning. | /r/StableDiffusion | 2023-07-13
Project mention: Show HN: Offline sketch to image geneartor in a whiteboard | news.ycombinator.com | 2024-05-26TLDR: Miniconda + Diffusers + Electron + Excalidraw
One of the most important aspects of creating this tool was finding a stable diffusion locally inference solution. There are many solutions available, such as https://github.com/leejet/stable-diffusion.cpp and https://github.com/apple/ml-stable-diffusion. I tested the C++ version, but the inference speed was very slow, and Metal GPU support still had issues (you can find relevant issues in their repo). Ultimately, I decided to use python to run it because PyTorch is mature and MPS support is well-established. And I chose Miniconda, because it can create a small, isolated Python environment to run the program.
The AI model should run in the background so that we can continuously produce images while you draw. We need to find an RPC method to enable communication between the Python process and Electron's Node.js process. The easiest way is to run a Python HTTP server, but the memory usage is too high. We need a more lightweight solution, so I used xmlrpc for memory efficiency, although there might be better alternatives that I'm unaware of. The AI inference part is handled by diffusers, which is great, but I had to apply some custom patches to make it work in this situation. This can be a bit challenging if you're not familiar with Python.
For the frontend, I initially used a low-level canvas library and tried to implement a drawing pad from scratch. However, it had too many details, so I chose a more mature option: Excalidraw. It's fantastic, with the only shortcoming being limited API support.
Finally, I combined all these technologies in Electron, ensuring they work smoothly on both the main process and the renderer process.
Ok, Is DrawingPics free to use?
Project mention: Stable Diffusion implemented by ncnn framework based on C++, supported txt2img and img2img! | /r/StableDiffusion | 2023-06-08
Hey everyone,Today I installed inpaint-anything extension from github(https://github.com/Uminosachi/sd-webui-inpaint-anything) to Stable Diffusion. It works perfectly.
Project mention: FastSD CPU beta 21 - SDXL Turbo OpenVINO support (2.5 seconds on CPU) | /r/StableDiffusion | 2023-12-02Release : https://github.com/rupeshs/fastsdcpu/releases/tag/v1.0.0-beta.21
Project mention: Würstchen is here! A game changing, fastest high-resolution image generation model | /r/StableDiffusion | 2023-09-16Get Pallaidium for free here: https://github.com/tin2tin/Pallaidium
diffusion related posts
-
Diffusion Models
-
Intelli framework orchestrates multi-model collaboration as a graph
-
You can now train a 70B language model at home
-
LoftQ: LoRA-fine-tuning-aware Quantization
-
Can anyone suggest an AI model that can help me enhance a poorly drawn logo?
-
Seeking out an experienced and empathetic coding buddy.
-
can't get it working with an AMD gpu
-
A note from our sponsor - InfluxDB
www.influxdata.com | 1 Jun 2024
Index
What are some of the best open-source diffusion projects? This list will help you:
Project | Stars | |
---|---|---|
1 | stable-diffusion-webui | 132,386 |
2 | diffusers | 23,148 |
3 | peft | 14,341 |
4 | easydiffusion | 9,196 |
5 | lora | 6,690 |
6 | mmagic | 6,641 |
7 | discoart | 3,838 |
8 | riffusion | 3,235 |
9 | Rerender_A_Video | 2,905 |
10 | Kandinsky-2 | 2,703 |
11 | stable-diffusion.cpp | 2,702 |
12 | riffusion-app | 2,540 |
13 | opendream | 1,659 |
14 | sd-akashic | 1,595 |
15 | awesome-stable-diffusion | 1,433 |
16 | minisora | 1,057 |
17 | Stable-Diffusion-NCNN | 944 |
18 | sd-webui-inpaint-anything | 965 |
19 | tango | 937 |
20 | fastsdcpu | 942 |
21 | Pallaidium | 825 |
22 | Adan | 728 |
23 | stable-diffusion-docker | 715 |
Sponsored