bark.cpp
sam.cpp
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bark.cpp
- Show HN: I ported Suno AI's Bark model in C for fast realistic audio generation
- Bark.cpp: Port of Suno AI's Bark in C/C++ for fast inference
- I've open sourced my Flutter plugin to run on-device LLMs on any platform. TestFlight builds available now.
-
Meta's Segment Anything written with C++ / GGML
Another GGML model port that I'm pretty excited about is https://github.com/PABannier/bark.cpp.
The Bark python model is very compute intensive and require a powerful GPU to get bearable inference speed. I really hope that bark.cpp with GPU/Metal support and quanticized model can bring useful inference speed on a laptop in the near future.
sam.cpp
What are some alternatives?
Queryable - Run OpenAI's CLIP model on iOS to search photos.
aub.ai - AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
llm - An ecosystem of Rust libraries for working with large language models
StyleTTS2 - StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models
vit.cpp - Inference Vision Transformer (ViT) in plain C/C++ with ggml
stable-diffusion.cpp - Stable Diffusion in pure C/C++
whisper.cpp - Port of OpenAI's Whisper model in C/C++