Rust AI

Open-source Rust projects categorized as AI
Edit details
Topics: Rust llm openai Machine Learning chatgpt
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 23 Rust AI Projects

  • ChatGPT

    đź”® ChatGPT Desktop Application (Mac, Windows and Linux)

    • Project mention: What AI assistants are already bundled for Linux? | news.ycombinator.com | 2024-03-01

    > I wouldn't hold my breath waiting for a native Linux AI-assisted assistant.

    On Mac when I press Command + Space, it brings up Spotlight search

    That can't easily be added to be the equivalent of some kind of LLM prompt on GNOME/KDE/XFCE?

    I don't quite know what you'd ask it/do with it that would be of much value? Seems like a quicker way/a wrapper around either asking an LLM questions via CLI or basically Electron wrapping HTML (like this https://github.com/lencx/ChatGPT)?

  • tabby

    Self-hosted AI coding assistant

    • Project mention: IBM Granite: A Family of Open Foundation Models for Code Intelligence | news.ycombinator.com | 2024-05-07

    https://github.com/TabbyML/tabby can run self-hosted AI coding assistants. I tried it a while ago and it worked with Nvim pretty easily. There is a VS code extension too. The extension will just sort of "read" with you and provide suggestions from time to time. Anytime the suggestion is good you can press some key ( by default) to accept it. It's basically autocomplete on steroids.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • llm

    An ecosystem of Rust libraries for working with large language models

    • Project mention: Open-sourcing a simple automation/agent workflow builder | /r/ChatGPTPro | 2023-10-07

    We're open-sourcing a project that lets you build simple automations/agent workflows that use LLMs for different tasks. Kinda like Zapier or IFTTT but focused on using natural language to accomplish your tasks.It's super early but we'd love to start getting feedback to steer it in the right direction. It currently supports OpenAI and local models through llm.

  • postgresml

    The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models.

    • Project mention: PostgresML | /r/programming | 2023-08-30

  • aichat

    All-in-one AI-Powered CLI Chat & Copilot that integrates 10+ AI platforms, including OpenAI, Azure-OpenAI, Gemini, VertexAI, Claude, Mistral, Cohere, Ollama, Ernie, Qianwen...

    • Project mention: Show HN: A shell CLI tool to predict your next command enhanced by LLM and RAG | news.ycombinator.com | 2024-04-16

    thanks for sharing this, I have been using aichat (https://github.com/sigoden/aichat) and shell_gpt for a while. Let's see how it works.

  • text-embeddings-inference

    A blazing fast inference solution for text embeddings models

    • Project mention: HuggingFace text-generation-inference is reverting to Apache 2.0 License | news.ycombinator.com | 2024-04-08

    Worth noting that this also impacts the great https://github.com/huggingface/text-embeddings-inference, which allows anyone to run state of the art embeddings with great performance.

  • chat-ai-desktop

    Unofficial ChatGPT desktop app for Mac & Windows menubar using Tauri & Rust

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • aici

    AICI: Prompts as (Wasm) Programs

    • Project mention: HonoJS: Small, simple, and ultrafast web framework for the Edges | news.ycombinator.com | 2024-04-15

    Have you looked at AICI by Microsoft yet?

    https://github.com/microsoft/aici/

  • smartgpt

    A program that provides LLMs with the ability to complete complex tasks using plugins.

    • Project mention: Smartgpt: A program that provides LLMs ability with complex tasks using plugins | news.ycombinator.com | 2023-08-28

  • chidori

    A reactive runtime for building durable AI agents

    • Project mention: Chidori – Declarative Framework for AI Agents (Rust, Python, and Node.js) | news.ycombinator.com | 2023-07-26

  • floneum

    A toolkit for controllable, private AI on consumer hardware in rust

    • Project mention: Dioxus 0.5: Web, Desktop, Mobile Apps in Rust | news.ycombinator.com | 2024-03-28

    It is pretty good. I am working on an application that uses SVGs as a way to draw a workflow editor UI with Dioxus: https://github.com/floneum/floneum

  • whatlang-rs

    Natural language detection library for Rust. Try demo online: https://whatlang.org/

    • Project mention: Lingua 1.5.0 - The most accurate natural language detection library for Rust, now with support for detecting multiple languages in mixed-language text | /r/rust | 2023-06-15

    How does it compare to whatlang?

  • llama-node

    Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

    • Project mention: Tell HN: Rust Is the Superglue | news.ycombinator.com | 2023-07-15

    You can practice your Rust skills by writing performant and/or gluey extensions for higher-level language such as NodeJS (checkout napi-rs) and Python or complementing JS in the browser if you target Webassembly.

    For instance, checkout Llama-node https://github.com/Atome-FE/llama-node for an involved Rust-based NodeJS extension. Python has PyO3, a Rust-Python extension toolset: https://github.com/PyO3/pyo3.

    They can help you leverage your Rust for writing cool new stuff.

  • ezkl

    ezkl is an engine for doing inference for deep learning models and other computational graphs in a zk-snark (ZKML). Use it from Python, Javascript, or the command line.

    • Project mention: Show HN: Turn ML/AI models into zero-knowledge proofs | news.ycombinator.com | 2023-10-14

  • ort

    A Rust wrapper for ONNX Runtime (by pykeio)

    • Project mention: AI Inference now available in Supabase Edge Functions | dev.to | 2024-04-16

    To solve this, we built a native extension in Edge Runtime that enables using ONNX runtime via the Rust interface. This was made possible thanks to an excellent Rust wrapper called Ort:

  • blindai

    Confidential AI deployment with secure enclaves :lock:

  • chess-engine

    A dependency-free chess engine♟️ library built to run anywhere.

  • ai00_server

    A localized open-source AI server that is better than ChatGPT.

    • Project mention: People who've used RWKV, whats your wishlist for it? | /r/LocalLLaMA | 2023-12-09

  • Pleco

    A Rust-based re-write of the Stockfish Chess Engine (by pleco-rs)

    • Project mention: I have years of experience in vulnerability analysis including several 0-day discovery, and this bug [buffer overflow] seems totally safe. | /r/programmingcirclejerk | 2023-05-09

    /rj https://github.com/pleco-rs/Pleco

  • LangHelper

    Striving to create a great Application with full functions of learning languages by ChatGPT, TTS, STT and other awesome AI models, supports talking, speaking assessment, memorizing words with contexts, Listening test, so on.

  • bonsai

    Rust implementation of AI behavior trees. (by Sollimann)

    • Project mention: Suggestions for Async Behavior Tree Implementation | /r/rust | 2023-08-18

    Was looking at existing StateMachine and BehaviorTree examples recently and I found the following Behavior Tree crates https://github.com/PistonDevelopers/ai_behavior https://github.com/Sollimann/bonsai

  • asteroids-genetic

    Interactive AI training simuation

  • L2

    l2 is a fast, Pytorch-style Tensor+Autograd library written in Rust

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust AI related posts

Index

What are some of the best open-source AI projects in Rust? This list will help you:

Project Stars
1 ChatGPT 47,295
2 tabby 17,420
3 llm 5,931
4 postgresml 5,468
5 aichat 2,871
6 text-embeddings-inference 2,024
7 chat-ai-desktop 1,957
8 aici 1,743
9 smartgpt 1,729
10 chidori 1,197
11 floneum 979
12 whatlang-rs 952
13 llama-node 849
14 ezkl 834
15 ort 580
16 blindai 491
17 chess-engine 397
18 ai00_server 386
19 Pleco 349
20 LangHelper 309
21 bonsai 262
22 asteroids-genetic 221
23 L2 184

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com