Top 14 unstructured-data Open-Source Projects

• towhee

  26 3,029 8.6 Python

  Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

  

Project mention: FLaNK Stack Weekly for 14 Aug 2023 | dev.to | 2023-08-14

• bootcamp

  25 1,653 9.1 HTML

  Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc. (by milvus-io)

  

Project mention: FLaNK-AIM: 20 May 2024 Weekly | dev.to | 2024-05-20

• Scout Monitoring

  www.scoutapm.com featured

  Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

  

• awesome-document-understanding

  4 1,156 4.5

  A curated list of resources for Document Understanding (DU) topic

• spotlight

  24 1,020 9.8 TypeScript

  Interactively explore unstructured datasets from your dataframe. (by Renumics)

Project mention: Renumics/spotlight: Interactively explore unstructured datasets from dataframes | news.ycombinator.com | 2024-03-10

• Nuclia DB

  3 585 9.9 Rust

  NucliaDB, The AI Search database for RAG

  

Project mention: Tantivy 0.20 is released: Schemaless column store, Schemaless aggregations, Phrase prefix queries, Percentiles, and more... | /r/rust | 2023-06-20

You have also NucliaDB that is built on top of tantivy and addresses vector search for documents and video search.

• cursusdb

  14 417 9.7 Go

  CursusDB is an open-source distributed in-memory yet persisted document oriented database system with real time capabilities.

  

Project mention: CursusDB: Fast, open-source document oriented database with SQL like query | news.ycombinator.com | 2024-01-08

• trex

  3 238 6.6 Python

  Enforce structured output from LLMs 100% of the time (by automorphic-ai)

  

Project mention: Show HN: Generate JSON mock data for testing/initial app development | news.ycombinator.com | 2023-10-03

A friend of mine built a tool called Trex that you might find helpful, check it out here: https://github.com/automorphic-ai/trex

It's very consistent at generating templated data.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• unstract

  6 166 9.7 Python

  No-code LLM Platform to launch APIs and ETL Pipelines to structure unstructured documents

  

Project mention: Ask HN: I have many PDFs – what is the best local way to leverage AI for search? | news.ycombinator.com | 2024-05-30

• relevanceai

  1 103 6.4 Python

  Home of the AI workforce - Multi-agent system, AI agents & tools

  

• dkm

  2 95 1.5 HTML

  Dynamic Kernel Matching (DKM) for Classifying Data with Non-conforming Features

• base

  1 28 0.0 Jupyter Notebook

  Adansons Base is a data programming tool for error-analysis of training results. It organizes metadata of unstructured data and creates and organizes datasets. It makes dataset creation more effective and helps to find low-quality data by using the training results and improves AI performance. (by adansons)

  

• deprecated-core

  7 13 9.1 Makefile

  🔮 Instill Core contains components for supporting Instill VDP and Instill Model

  

Project mention: Building an Instill AI Pipeline in 5 minutes | dev.to | 2023-10-22

Step 1: Log in to your InstillAI Cloud account. If you don't have an account yet, you can create one here for free using your Email or Google or GitHub ID.

• html_tag_annotator

  1 12 0.0 JavaScript

  A Machine Learning tool to create the training dataset very quickly & easily by using a smart chrome extension

• pipeline-docs-data-extractor

  1 5 7.8 Python

  (Let's build a) Robust pipeline for extracting structured data from various documents

Project mention: ETL Texts | news.ycombinator.com | 2024-01-14

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

unstructured-data related posts

• Show HN: LLMWhisperer – Prep complex documents ready for use in LLMs

  1 project | news.ycombinator.com | 10 Apr 2024

• RAGFlow is an open-source RAG engine based on deep document understanding

  8 projects | news.ycombinator.com | 1 Apr 2024

• CursusDB: Fast, open-source document oriented database with SQL like query

  1 project | news.ycombinator.com | 8 Jan 2024

• Milvus Adventures Jan 5, 2023

  1 project | dev.to | 5 Jan 2024

• A new open-source distributed in-memory and persisted document oriented DBMS

  1 project | news.ycombinator.com | 2 Jan 2024

• CursusDB – Distributed document oriented DBMS with an SQL like query language

  1 project | news.ycombinator.com | 9 Dec 2023

• How to approach databases inside Next.js?

  2 projects | /r/nextjs | 9 Dec 2023
• A note from our sponsor - InfluxDB
  www.influxdata.com | 1 Jun 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com