khoj VS obsidian-smart-connections

There are already several RAG chat open source solutions available. Two that immediately come to mind are:

Danswer

https://github.com/danswer-ai/danswer

Khoj

https://github.com/khoj-ai/khoj

I'm a fan of Khoj. Been using it for months. https://github.com/khoj-ai/khoj

https://github.com/khoj-ai/khoj

This is the easiest I found, on here too.

Thanks for the feedback. Does your machine have a GPU? 32GB CPU RAM should be enough but GPU speeds up response time.

We have fixes for the seg fault[1] and improvement to the query speed[2] that should be released by end of day today[3].

Update khoj to version 0.10.1 with pip install --upgrade khoj-assistant to see if that improves your experience.

The number of documents/pages/entries doesn't scale memory utilization as quickly and doesn't affect the search, chat response time as much

[1]: The seg fault would occur when folks sent multiple chat queries at the same time. A lock and some UX improvements fixed that

[2]: The query time improvements are done by increasing batch size, to trade-off increased memory utilization for more speed

[3]: The relevant pull request for reference: https://github.com/khoj-ai/khoj/pull/393

We recently integrated Llama 2 into Khoj. I wanted to share a short real-world evaluation of using Llama 2 for the chat with docs use-cases and hear which models have worked best for you all. The standard benchmarks (ARC, HellaSwag, MMLU etc.) are not tuned for evaluating this

Self-host your Notion assistant using the instructions here. You'll need Python >= 3.8 to get started.

Here's an early example: https://github.com/khoj-ai/khoj

For my personal notes, I use Smart Connections[1] with Obsidian. I am considering devising my own solution using LlamaIndex[2] in the near future.

For coding, I use Copilot[3]. While it's been great for writing boilerplate code, it falls short in every other regard. I also had the opportunity to try the new version of Copilot as well, but it feels like a glorified ChatGPT inside VSCode.

For everything else, I use a tiny tool I made[4] which enables me to invoke my own prompts in basically any application that allows me to select text.

[1] https://github.com/brianpetro/obsidian-smart-connections

[2] https://gpt-index.readthedocs.io/en/latest/getting_started/s...

[3] https://github.com/features/copilot

[4] https://github.com/overflowy/chat-key

Adding options to us local LLM's like GPT4all, or alpaca #141

Smart Connections allows you to search using embeddings[1].

[1] https://github.com/brianpetro/obsidian-smart-connections

There is actually a plugin that leverages AI to do it. I haven't used it yet plus there might also be a concern over giving a third party AI access to your notes but if you are interested here is the link. https://github.com/brianpetro/obsidian-smart-connections

The "smart connection" plugin is ideal for your search needs. This plugin allows you to search using semantics rather than keywords, just like Google. https://github.com/brianpetro/obsidian-smart-connections

Here is the Obsidian plugin I was referring to: https://github.com/brianpetro/obsidian-smart-connections

I am very attracted to the Smart Connections plugin, which would implement Obsidian with the only real feature I envy other centralized PKMs (such as Mem X): that of finding and connecting to similar notes. The point is this: the price (paid after each use) due to Open AI for using the GPT engine.

I'm using Obsidian with the Smart Connections plugin. I then used chatGPT (4) to write a python script that chatGPT summarized this way:

Smart Connections