Jupyter Notebook llm-inference

Open-source Jupyter Notebook projects categorized as llm-inference
Edit details
Topics: llm Chatbot chat-application Gpt agent-based-framework
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 3 Jupyter Notebook llm-inference Projects

  • autogen

    A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap

    • Project mention: Agents of Change: Navigating the Rise of AI Agents in 2024 | dev.to | 2024-05-02

    AutoGen is an AI framework by Microsoft designed to streamline multi-agent conversations. AutoGen allows agents to communicate, share information, and make collective decisions. This setup enhances the responsiveness and dynamism of conversations. Developers use AutoGen to tailor agents to specific roles, such as programmer, content writer, CEO, etc. This enhances their ability to handle tasks from simple queries to intricate problem-solving.

  • mistral-src

    Reference implementation of Mistral AI 7B v0.1 model.

    • Project mention: Mistral 7B vs. Mixtral 8x7B | dev.to | 2024-03-26

    A French startup, Mistral AI has released two impressive large language models (LLMs) - Mistral 7B and Mixtral 8x7B. These models push the boundaries of performance and introduce a better architectural innovation aimed at optimizing inference speed and computational efficiency.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • fastassert

    Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.

    • Project mention: FLaNK AI Weekly 18 March 2024 | dev.to | 2024-03-18
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Jupyter Notebook llm-inference related posts

  • Mistral 7B vs. Mixtral 8x7B

    1 project | dev.to | 26 Mar 2024

  • How to have your own ChatGPT on your machine (and make him discussed with himself)

    1 project | dev.to | 24 Jan 2024

  • How to Serve LLM Completions in Production

    1 project | dev.to | 18 Jan 2024

  • Stuff we figured out about AI in 2023

    5 projects | news.ycombinator.com | 1 Jan 2024

  • Mistral AI – open-source models

    1 project | news.ycombinator.com | 8 Dec 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 9 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source llm-inference projects in Jupyter Notebook? This list will help you:

Project Stars
1 autogen 25,506
2 mistral-src 8,732
3 fastassert 25

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com