I've open sourced my Flutter plugin to run on-device LLMs on any platform. TestFlight builds available now.

• stable-diffusion.cpp

  11 2,702 8.8 C++

  Stable Diffusion in pure C/C++

And more stuff I’m often checking back on: - https://github.com/staghado/vit.cpp - https://github.com/serp-ai/bark-with-voice-clone - https://github.com/leejet/stable-diffusion.cpp (generate images) - etc … there’s too much fun stuff out there. Wish I had more free time haha.

• aub.ai

  5 168 7.5 Dart

  AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• whisper.cpp

  187 32,188 9.8 C

  Port of OpenAI's Whisper model in C/C++

Usage 1: Good to transcribe audio. An example use case could be to summarize YouTube videos or long courses. Usage 2: You talk with voice to your AI that responds with text (later with audio too). - https://github.com/ggerganov/whisper.cpp

• StyleTTS2

  7 4,192 8.6 Python

  StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models

• bark.cpp

  4 590 8.2 C++

  Suno AI's Bark model in C/C++ for fast text-to-speech

• vit.cpp

  2 184 8.8 C++

  Inference Vision Transformer (ViT) in plain C/C++ with ggml

And more stuff I’m often checking back on: - https://github.com/staghado/vit.cpp - https://github.com/serp-ai/bark-with-voice-clone - https://github.com/leejet/stable-diffusion.cpp (generate images) - etc … there’s too much fun stuff out there. Wish I had more free time haha.

• bark-with-voice-clone

  19 2,892 3.9 Python

  🔊 Text-prompted Generative Audio Model - With the ability to clone voices

  

And more stuff I’m often checking back on: - https://github.com/staghado/vit.cpp - https://github.com/serp-ai/bark-with-voice-clone - https://github.com/leejet/stable-diffusion.cpp (generate images) - etc … there’s too much fun stuff out there. Wish I had more free time haha.

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• web_ffi

  1 19 0.0 JavaScript

  Translates dart:ffi calls on the web to WebAssembly using dart:js

  

I leverage ffi and ffigen, but they don’t support web yet. I rely on them at the moment. But a quick search tells me there’s a decent chance to get this to work, there’s this package for example https://github.com/EP-u-NW/web_ffi (not maintained, but good nonetheless for inspiration).

Suggest a related project