Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 Rust AI Projects
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
postgresml
The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models.
-
aichat
All-in-one AI-Powered CLI Chat & Copilot that integrates 20+ AI platforms, including OpenAI, Azure-OpenAI, Gemini, Claude, Mistral, Cohere, VertexAI, Bedrock, Ollama, Ernie, Qianwen, Deepseek...
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
-
-
llama-node
Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.
-
ezkl
ezkl is an engine for doing inference for deep learning models and other computational graphs in a zk-snark (ZKML). Use it from Python, Javascript, or the command line.
-
-
-
-
-
LangHelper
Striving to create a great Application with full functions of learning languages by ChatGPT, TTS, STT and other awesome AI models, supports talking, speaking assessment, memorizing words with contexts, Listening test, so on.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Two other tools emerging in this category are SuperMaven and TabbyML, both use fast and secure LLM for code completion and recommendations.
Project mention: Open-sourcing a simple automation/agent workflow builder | /r/ChatGPTPro | 2023-10-07We're open-sourcing a project that lets you build simple automations/agent workflows that use LLMs for different tasks. Kinda like Zapier or IFTTT but focused on using natural language to accomplish your tasks.It's super early but we'd love to start getting feedback to steer it in the right direction. It currently supports OpenAI and local models through llm.
That way I can use any aichat backend as necessary, I actually have time to verify the output myself, and all the commands get saved to my history.
The prompt that runs is the following: "Based on the following user description, generate a corresponding Fish shell command. Focus solely on interpreting the requirements and translating them into a single, executable Fish command. Ensure accuracy and relevance to the user's description. The output should be a valid Fish command that directly aligns with the user's intent, ready for execution in a command-line environment. Do not output anything except for the command. No code block, no English explanation, no newlines, and no start/end tags."
[1] - https://github.com/sigoden/aichat
Project mention: HuggingFace text-generation-inference is reverting to Apache 2.0 License | news.ycombinator.com | 2024-04-08Worth noting that this also impacts the great https://github.com/huggingface/text-embeddings-inference, which allows anyone to run state of the art embeddings with great performance.
To me, context caching is only a subset of what is possible with full control over the model. I consider this a more complete list: https://github.com/microsoft/aici?tab=readme-ov-file#flexibi...
Context caching only gets you “forking generation into multiple branches” (i.e. sharing work between multiple generations)
Project mention: Smartgpt: A program that provides LLMs ability with complex tasks using plugins | news.ycombinator.com | 2023-08-28
Project mention: Chidori – Declarative Framework for AI Agents (Rust, Python, and Node.js) | news.ycombinator.com | 2023-07-26
It is pretty good. I am working on an application that uses SVGs as a way to draw a workflow editor UI with Dioxus: https://github.com/floneum/floneum
Project mention: Lingua 1.5.0 - The most accurate natural language detection library for Rust, now with support for detecting multiple languages in mixed-language text | /r/rust | 2023-06-15How does it compare to whatlang?
You can practice your Rust skills by writing performant and/or gluey extensions for higher-level language such as NodeJS (checkout napi-rs) and Python or complementing JS in the browser if you target Webassembly.
For instance, checkout Llama-node https://github.com/Atome-FE/llama-node for an involved Rust-based NodeJS extension. Python has PyO3, a Rust-Python extension toolset: https://github.com/PyO3/pyo3.
They can help you leverage your Rust for writing cool new stuff.
Project mention: Show HN: Turn ML/AI models into zero-knowledge proofs | news.ycombinator.com | 2023-10-14
To solve this, we built a native extension in Edge Runtime that enables using ONNX runtime via the Rust interface. This was made possible thanks to an excellent Rust wrapper called Ort:
Was looking at existing StateMachine and BehaviorTree examples recently and I found the following Behavior Tree crates https://github.com/PistonDevelopers/ai_behavior https://github.com/Sollimann/bonsai
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Rust AI related posts
-
Noi: an AI-enhanced, customizable browser
-
Google Gemini: Context Caching
-
Show HN: A shell CLI tool to predict your next command enhanced by LLM and RAG
-
AI Inference Now Available in Supabase Edge Functions
-
Dioxus 0.5: Web, Desktop, Mobile Apps in Rust
-
Show HN: Kalosm an embeddable framework for pre-trained models in Rust
-
Show HN: Mistral LLM w Assistants API and Action tool 4 autonomous requests
-
A note from our sponsor - InfluxDB
www.influxdata.com | 20 May 2024
Index
What are some of the best open-source AI projects in Rust? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | ChatGPT | 48,007 |
| 2 | tabby | 17,534 |
| 3 | llm | 5,954 |
| 4 | postgresml | 5,483 |
| 5 | aichat | 2,962 |
| 6 | text-embeddings-inference | 2,073 |
| 7 | chat-ai-desktop | 1,961 |
| 8 | aici | 1,771 |
| 9 | smartgpt | 1,732 |
| 10 | chidori | 1,200 |
| 11 | floneum | 987 |
| 12 | whatlang-rs | 954 |
| 13 | llama-node | 849 |
| 14 | ezkl | 848 |
| 15 | ort | 596 |
| 16 | blindai | 490 |
| 17 | chess-engine | 397 |
| 18 | ai00_server | 398 |
| 19 | Pleco | 349 |
| 20 | LangHelper | 308 |
| 21 | bonsai | 262 |
| 22 | asteroids-genetic | 219 |
| 23 | L2 | 184 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com