With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js. Learn more →
Top 18 TypeScript prompt-engineering Projects
-
-
promptfoo
Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.
-
SurveyJS
Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.
-
-
knowledge
Knowledge is a tool for saving, searching, accessing, exploring and chatting with all of your favorite websites, documents and files. (by KnowledgeCanvas)
-
-
Magick
Magick is a cutting-edge toolkit for a new kind of AI builder. Make Magick with us! (by Oneirocom)
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
Raycast-PromptLab
A Raycast extension for creating powerful, contextually-aware AI commands using placeholders, action scripts, selected files, and more.
-
-
langtrace
Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊
-
-
-
prompting
A batteries-included, model-agnostic prompt engineering library for Node.js and TypeScript.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Great to know this!
I have come across Portkey's Open-source AI Gateway which kind of does the same.
https://github.com/portkey-ai/gateway
It looks like with more LLM adoption, resiliency and cost related aspects take off sooner than expected unlike other technological trends in the past.
I'm also thinking that there is a chance if something like this could help build a better RAG pipeline or evals for the GenAI App. Because end of the day you want to reduce hallucinations but still get good generative responses.
Project mention: Ask HN: How does deploying a fine-tuned model work | news.ycombinator.com | 2024-04-23- Fireworks: $0.20
If you're looking for an end-to-end flow that will help you gather the training data, validate it, run the fine tune and then define evaluations, you could also check out my company, OpenPipe (https://openpipe.ai/). In addition to hosting your model, we help you organize your training data, relabel if necessary, define evaluations on the finished fine-tune, and monitor its performance in production. Our inference prices are higher than the above providers, but once you're happy with your model you can always export your weights and host them on one of the above!
https://github.com/KnowledgeCanvas/knowledge
Project mention: Rebuff: Detect and protect against prompt injection attacks in LLMs | news.ycombinator.com | 2023-07-05
Project mention: Dify, a visual workflow to build/test LLM applications | news.ycombinator.com | 2024-04-22
Learn more about PromptLab: https://github.com/SKaplanOfficial/Raycast-PromptLab
Lmstudio (that they linked) is definitely not open source, and doesn't even offer a pricing model for business use.
Llmstudio is, but I suspect that was a typo in their comment. https://github.com/TensorOpsAI/LLMStudio
- Typescript - https://github.com/dosco/llm-client/
One specific feature I would like to see is to expose the prompt templates as config and give greater control to the developers in incorporating our “versions” of templates for CoT, Fewshots etc. This will also help with the adoption of DSPy to languages other than English.
Finally, I was able to understand what DSPy is adding to its prompts and what sort of optimizations it is doing by using Langtrace, an open source tracing tool i am building that can be setup with just 2 lines of code.
https://github.com/Scale3-Labs/langtrace
Project mention: Show HN: Made Open Source NPM like package ecosytem for reusable Prompts | news.ycombinator.com | 2023-12-15
Coincidentally, I just published this JS library[1] over the weekend that helps prompt LLMs to return typed JSON data and validates it for you. Would love feedback on it if this is something people here are interested in. Haven’t played around with the new API yet but I think this is super exciting stuff!
[1] https://github.com/jacobsimon/prompting
Well here’s a somewhat limited version of your idea and really only helps mitigate the copy/paste effort with coding: https://github.com/backnotprop/prompt-tower
My original idea was a DnD interface that works at the os level as a HUD… and functions like your idea but that is not so simple to develop.
Project mention: AI Study Planner using Next.js 13, Google PaLM API and TailwindCSS | /r/webdev | 2023-07-23
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
TypeScript prompt-engineering related posts
-
Iterate on LLMs Faster
-
Prompt Tower v0.1.9 – Batch file selection
-
Prompt Tower v0.1.9 – batch file selection
-
Top Open Source Prompt Engineering Guides & Tools🔧🏗️🚀
-
OpenAI: Improvements to the fine-tuning API and expanding our cus
-
Launch HN: Talc AI (YC S23) – Test Sets for AI
-
Fine Tuning LLMs to Process Massive Amounts of Data 50x Cheaper than GPT-4
-
A note from our sponsor - SurveyJS
surveyjs.io | 31 May 2024
Index
What are some of the best open-source prompt-engineering projects in TypeScript? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | gateway | 4,830 |
| 2 | promptfoo | 3,100 |
| 3 | OpenPipe | 2,401 |
| 4 | knowledge | 1,287 |
| 5 | rebuff | 958 |
| 6 | Magick | 624 |
| 7 | latent-browser | 258 |
| 8 | Raycast-PromptLab | 236 |
| 9 | LLMstudio | 215 |
| 10 | langtrace | 152 |
| 11 | promptclip | 50 |
| 12 | sugarcane-ai | 46 |
| 13 | prxmpt | 27 |
| 14 | prompting | 17 |
| 15 | promptman | 6 |
| 16 | chatml | 5 |
| 17 | prompt-tower | 25 |
| 18 | ai-study-planner | 0 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com