Python llms

Open-source Python projects categorized as llms

Top 23 Python llm Projects

  • LLaMA-Factory

    Unify Efficient Fine-Tuning of 100+ LLMs

  • Project mention: FLaNK-AIM Weekly 06 May 2024 | dev.to | 2024-05-06
  • chroma

    the AI-native open-source embedding database

  • Project mention: Let’s build AI-tools with the help of AI and Typescript! | dev.to | 2024-04-23

    Package installer for Python (pip), we use this for installing the Python-based packages, such as Jupyter Lab, and we're going to use this for installing other Python-based tools like the Chroma DB vector database

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • LLMSurvey

    The official GitHub page for the survey paper "A Survey of Large Language Models".

  • Project mention: Ask HN: Textbook Regarding LLMs | news.ycombinator.com | 2024-03-23

    Here’s another one - it’s older but has some interesting charts and graphs.

    https://arxiv.org/abs/2303.18223

  • OpenNMT-py

    Open Source Neural Machine Translation and (Large) Language Models in PyTorch

  • AutoGPTQ

    An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

  • Project mention: Setting up LLAMA2 70B Chat locally | /r/developersIndia | 2023-08-18
  • gpt-code-ui

    An open source implementation of OpenAI's ChatGPT Code interpreter

  • Project mention: Should I tell my employer about a product that makes my job irrelevant? | /r/cscareerquestions | 2023-07-11

    Is this of any help?

  • api-for-open-llm

    Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

  • Project mention: FLaNK Stack Weekly for 14 Aug 2023 | dev.to | 2023-08-14
  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • langroid

    Harness LLMs with Multi-Agent Programming

  • Project mention: OpenAI: Streaming is now available in the Assistants API | news.ycombinator.com | 2024-03-14

    This was indeed true in the beginning, and I don’t know if this has changed. Inserting messages with Assistant role is crucial for many reasons, such as if you want to implement caching, or otherwise edit/compress a previous assistant response for cost or other reason.

    At the time I implemented a work-around in Langroid[1]: since you can only insert a “user” role message, prepend the content with ASSISTANT: whenever you want it to be treated as an assistant role. This actually works as expected and I was able to do caching. I explained it in this forum:

    https://community.openai.com/t/add-custom-roles-to-messages-...

    [1] the Langroid code that adds a message with a given role, using this above “assistant spoofing trick”:

    https://github.com/langroid/langroid/blob/main/langroid/agen...

  • DemoGPT

    Create 🦜️🔗 LangChain apps by just using prompts🌟 Star to support our work! | 只需使用句子即可创建 LangChain 应用程序。 给个star支持我们的工作吧!

  • Project mention: Llama 2 Code Interpreter | news.ycombinator.com | 2023-07-23
    Project mention: GitHub - swirlai/swirl-search: Swirl is an open-source search platform that uses AI to search multiple content and data sources simultaneously, finds the best results using a reader LLM, then prompts Generative AI, enabling you to get answers based on your data. | /r/programming | 2023-12-05
  • loopgpt

    Modular Auto-GPT Framework

  • Project mention: [P] LoopGPT Update - Finally something useful? | /r/MachineLearning | 2023-07-20

    So we thought it would be a good idea to create a framework that makes use of LoopGPT agent's memory and custom tooling capabilities. Let's jump right into the new features of this framework.

  • coffee

    Build and iterate on your UI 10x faster with AI - right from your own IDE ☕️

  • Project mention: AI Grant Traction in OSS Startups | dev.to | 2024-02-01

    Coframe

  • safe-rlhf

    Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

  • LLMStack

    No-code multi-agent framework to build LLM Agents, workflows and applications with your data

  • Project mention: Vanna.ai: Chat with your SQL database | news.ycombinator.com | 2024-01-14

    We have recently added support to query data from SingleStore to our agent framework, LLMStack (https://github.com/trypromptly/LLMStack). Out of the box performance performance when prompting with just the table schemas is pretty good with GPT-4.

    The more domain specific knowledge needed for queries, the harder it has gotten in general. We've had good success `teaching` the model different concepts in relation to the dataset and giving it example questions and queries greatly improved performance.

  • dstack

    An open-source container orchestration engine for running AI workloads in any cloud or data center. https://discord.gg/u8SmfwPpMd

  • Project mention: Pyinfra: Automate Infrastructure Using Python | news.ycombinator.com | 2024-04-30

    We build a similar tool except we focus on AI workloads. Also support on-prem clusters now in addition to GPU clouds. https://github.com/dstackai/dstack

  • LLMCompiler

    [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

  • Project mention: FLaNK Weekly 18 Dec 2023 | dev.to | 2023-12-18
  • distilabel

    ⚗️ distilabel is a framework for synthetic data and AI feedback for AI engineers that require high-quality outputs, full data ownership, and overall efficiency.

  • Project mention: Open-source AI Feedback framework for scalable LLM Alignment | news.ycombinator.com | 2023-11-23
  • llm_agents

    Build agents which are controlled by LLMs

  • agenta

    The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.

  • Project mention: Top Open Source Prompt Engineering Guides & Tools🔧🏗️🚀 | dev.to | 2024-05-02

    Agenta is an end-to-end LLMOps platform. It provides tools for prompt engineering and management, evaluation, human annotation, and deployment.

  • agent-protocol

    Common interface for interacting with AI agents. The protocol is tech stack agnostic - you can use it with any framework for building agents.

  • Project mention: Show HN: Common protocol for communication with (and between) AI Agents | news.ycombinator.com | 2023-08-09
  • DataDreamer

    DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

  • Project mention: FLaNK AI - 01 April 2024 | dev.to | 2024-04-01
  • llmflows

    LLMFlows - Simple, Explicit and Transparent LLM Apps

  • Project mention: Show HN: LLMFlows – LangChain alternative for explicit and transparent apps | news.ycombinator.com | 2023-07-29
  • oterm

    a text-based terminal client for Ollama

  • Project mention: term | /r/LocalLLaMA | 2023-10-17

    Check it out here

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python llms related posts

  • Google AI search feature suggested using glue to keep cheese sticking to a pizza

    1 project | news.ycombinator.com | 24 May 2024
  • LangFun: Object oriented data programs using LLMs

    1 project | news.ycombinator.com | 2 May 2024
  • Large language models (e.g., ChatGPT) as research assistants

    1 project | news.ycombinator.com | 27 Apr 2024
  • LLM Is a Capable Regressor When Given In-Context Examples

    3 projects | news.ycombinator.com | 13 Apr 2024
  • Show HN: Burr: An OS Framework for Building and Debugging GenAI Apps Faster

    2 projects | news.ycombinator.com | 3 Apr 2024
  • Long-form factuality in large language models

    2 projects | news.ycombinator.com | 30 Mar 2024
  • text-generation-webui VS LibreChat - a user suggested alternative

    2 projects | 29 Feb 2024
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 30 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source llm projects in Python? This list will help you:

Project Stars
1 LLaMA-Factory 22,989
2 chroma 12,771
3 LLMSurvey 9,126
4 OpenNMT-py 6,619
5 AutoGPTQ 3,906
6 gpt-code-ui 3,507
7 api-for-open-llm 2,071
8 langroid 1,736
9 DemoGPT 1,595
10 swirl-search 1,571
11 loopgpt 1,401
12 coffee 1,368
13 safe-rlhf 1,188
14 LLMStack 1,167
15 dstack 1,136
16 LLMCompiler 1,110
17 distilabel 1,005
18 llm_agents 891
19 agenta 906
20 agent-protocol 804
21 DataDreamer 691
22 llmflows 626
23 oterm 650

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com