llama_farm
talk
| llama_farm | talk | |
|---|---|---|
| 17 | 3 | |
| 143 | 559 | |
| - | - | |
| 6.7 | 8.1 | |
| about 1 month ago | 8 months ago | |
| Hy | TypeScript | |
| GNU Affero General Public License v3.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llama_farm
-
How to overcome the issues of the limit of ~4,000 tokens per input, when dealing with documents summarization?
I do i recursively https://github.com/atisharma/llama_farm/blob/main/llama_farm/summaries.hy
-
Ask HN: Is SICP/HtDP still worth reading in 2023? Any alternatives?
It's funny that you asked that and then someone posted an app that's almost entirely Hy language. I'm just sharing it so you have one example:
https://github.com/atisharma/llama_farm/tree/main
The AI's have limited ability to either handle large documents or track conversations. This tool is an attempt to solve that problem. It works with OpenAI and open-source AI's.
-
Langchain Youtube Summarizer with Oooba api Custom LLM wrapper (and kobold)
Then you might like https://github.com/atisharma/llama_farm
-
What is the best way to create a knowledge-base specific LLM chatbot ?
I use this
-
Is anyone doing always-on voice to text with a local llama at home?
Bark and another one I forgot. See this for example implementation.
- Request for comment / contribution - local AI tool (Hy)
-
Anything like ChatGPT that we can run ourself where we train with with our own data, so we can use it as personal assistant, where it only knows about oneself better than themselves ?
This is what I use
-
balacoon_tts: Fastest neural TTS on Raspberry
It's now incorporated in llama-farm.
- A local model for summarizing articles
- Story writing concept
talk
-
ChatGPT can now see, hear, and speak – openai.com
Also curious to hear about your setup. Using whisper too? When I was experimenting with it there was still a lot of annoyance about hallucinations and I was hard coding some "if last phrase is 'thanks for watching', ignore last phrase"
I was just googling a bit to see what's out there now for whisper/llama combos and came across this: https://github.com/yacineMTB/talk
There's a demo linked on the github page that seems relatively fast at responding conversationally, but still maybe 1-2 seconds at times. Impressive it's entirely offline.
- Is anyone doing always-on voice to text with a local llama at home?
-
Giving LLM’s a <Backspace> Token
Here’s a project attempting to do just this!
https://github.com/yacineMTB/talk
What are some alternatives?
h2ogpt - Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
willow - Open source, local, and self-hosted Amazon Echo/Google Home competitive Voice Assistant alternative
SillyTavern-Extras - Extensions API for SillyTavern.
chatcraft.org - Developer-oriented ChatGPT clone
vllm - A high-throughput and memory-efficient inference and serving engine for LLMs
awesome-talking-head-generation
gorilla - Gorilla: An API store for LLMs
DeepKE - [EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction
whisper-live-transcription - Live-Transcription (STT) with Whisper PoC
ue5-llama-lora - A proof-of-concept project that showcases the potential for using small, locally trainable LLMs to create next-generation documentation tools.
nerd-dictation - Simple, hackable offline speech to text - using the VOSK-API.