SuperDuperDB - how to use it to talk to your documents locally using llama 7B or Mistral 7B?

• superduperdb

  24 4,433 9.9 Python

  🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.

  

• text-generation-webui

  877 37,401 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

4) https://github.com/oobabooga/text-generation-webui/wiki -- oobabooga, this seems promising. Haven't tried it yet.

• Scout Monitoring

  www.scoutapm.com featured

  Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

  

• langroid

  15 1,736 9.8 Python

  Harness LLMs with Multi-Agent Programming

  

Thanks, also found Langdroid: https://github.com/langroid/langroid/blob/main/README.md

• llama_index

  76 32,094 10.0 Python

  LlamaIndex is a data framework for your LLM applications

  

• dspy

  25 12,030 9.9 Python

  DSPy: The framework for programming—not prompting—foundation models

  

• rags

  3 5,967 6.2 Python

  Build ChatGPT over your data, all with natural language

  

• ragas

  10 5,117 9.6 Python

  Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

  

Also, at some point you'll need to get serious about evaluation (trust me, you will). You may be interested in https://github.com/explodinggradients/ragas

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project