llama_farm VS ue5-llama-lora

I do i recursively https://github.com/atisharma/llama_farm/blob/main/llama_farm/summaries.hy

It's funny that you asked that and then someone posted an app that's almost entirely Hy language. I'm just sharing it so you have one example:

https://github.com/atisharma/llama_farm/tree/main

The AI's have limited ability to either handle large documents or track conversations. This tool is an attempt to solve that problem. It works with OpenAI and open-source AI's.

Then you might like https://github.com/atisharma/llama_farm

I use this

Bark and another one I forgot. See this for example implementation.

This is what I use

It's now incorporated in llama-farm.

https://github.com/bublint/ue5-llama-lora https://www.reddit.com/r/LocalLLaMA/comments/157vzq6/unleashing_the_power_of_language_learning_models/

You can follow this guy's steps. https://github.com/bublint/ue5-llama-lora He basic just throw a txt file let AI read it. Pygmalion 7B or 13B are both llama base, so you can just follow his step to fine-tuning Pygmalion you want. You will need to prepare the character's script,like chat,reaction,background to a file,then just hope AI will learn it correctly,it might need to fine-tuning multiple times if your feed is not enough or AI learn it wrong somehow.

ue5 lora might be a good starting point. It doesn't use any advanced features at all:

I got the idea from a reddit user that started a project that uses LLMs (forgot his name but here's a link to his repo, and I based my implementation from this TDS article

Someone did a LoRA finetuning example using the UE5 documentation, which I replicated to make sure, and you do end up producing word patterns from the document, but it doesn't get incorporated as concepts very well

GitHub - bublint/ue5-llama-lora: A proof-of-concept project that showcases the potential for using small, locally trainable LLMs to create next-generation documentation tools.

This would be an interesting experiment. People are already doing similar stuff, such as expanding the model's knowledge domain into something specific. Here's an example of how someone created a LoRA for UE5 documentation: https://github.com/bublint/ue5-llama-lora

I basically copied the steps from this Unreal Engine 5 LoRA repo and adjusted as needed.