pg_vectorize
nlm-ingestor
| pg_vectorize | nlm-ingestor | |
|---|---|---|
| 5 | 3 | |
| 647 | 836 | |
| 10.2% | 13.4% | |
| 9.2 | 7.1 | |
| 2 days ago | 7 days ago | |
| Rust | Python | |
| - | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pg_vectorize
-
Embeddings are a good starting point for the AI curious app developer
check out https://github.com/tembo-io/pg_vectorize - we're taking it a little bit beyond just the storage and index. The project uses pgvector for the indices and distance operators, but also adds a simpler API, hooks into pre-trained embedding models, and helps you keep embeddings updated as data changes/grows
-
Pg_vectorize: The simplest way to do vector search and RAG on Postgres
There is a RAG example here https://github.com/tembo-io/pg_vectorize?tab=readme-ov-file#...
You can provide your own prompts by adding them to the `vectorize.prompts` table. There's an API for this in the works. It is poorly documented at the moment.
- Pg_vectorize – The simplest way to orchestrate vector search on Postgres
nlm-ingestor
-
Pg_vectorize: The simplest way to do vector search and RAG on Postgres
>tree-based approach to organize and summarize text data, capturing both high-level and low-level details.
https://twitter.com/parthsarthi03/status/1753199233241674040
processes documents, organizing content and improving readability by handling sections, paragraphs, links, tables, lists, page continuations, and removing redundancies, watermarks, and applying OCR, with additional support for HTML and other formats through Apache Tika:
https://github.com/nlmatics/nlm-ingestor
-
Show HN: Open-source Rule-based PDF parser for RAG
Here's another notebook from the repo with examples: https://github.com/nlmatics/nlm-ingestor/blob/main/notebooks...
What are some alternatives?
pgvector - Open-source vector similarity search for Postgres
llmsherpa - Developer APIs to Accelerate LLM Projects
fastembed-rs - Library to generate vector embeddings. Rust implementation of Qdrant's FastEmbed.
txtai - 💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
SemanticSlicer - A recursive text chunker that attempts to preserve context.