LLMs-from-scratch
harlequin
LLMs-from-scratch | harlequin | |
---|---|---|
9 | 14 | |
16,129 | 2,531 | |
- | - | |
9.6 | 9.3 | |
1 day ago | 7 days ago | |
Jupyter Notebook | Python | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
LLMs-from-scratch
- Finetune a GPT Model for Spam Detection on Your Laptop in Just 5 Minutes
- Insights from Finetuning LLMs for Classification Tasks
-
Ask HN: Textbook Regarding LLMs
https://www.manning.com/books/build-a-large-language-model-f...
- Comparing 5 ways to implement Multihead Attention in PyTorch
- FLaNK Stack 29 Jan 2024
-
Implementing a ChatGPT-like LLM from scratch, step by step
The attention mechanism we implement in this book* is specific to LLMs in terms of the text inputs, but it's fundamentally the same attention mechanism that is used in vision transformers. The only difference is that in LLMs, you turn text into tokens, and convert these tokens into vector embeddings that go into an LLM. In vision transformers, instead of regarding images as tokens, you use an image patch as a token and turn those into vector embeddings (a bit hard to explain without visuals here). In both text or vision context, it's the same attention mechanism, and it both cases it receives vector embeddings.
(*Chapter 3, already submitted last week and should be online in the MEAP soon, in the meantime the code along with the notes is also available here: https://github.com/rasbt/LLMs-from-scratch/blob/main/ch03/01...)
harlequin
- DBeaver – open-source Database client
- FLaNK Stack 29 Jan 2024
- FLaNK Weekly 08 Jan 2024
- Harlequin: SQL IDE for Your Terminal
- Harlequin: DuckDB IDE for the terminal
- Harlequin.sh DuckDB IDE for your terminal
-
Show HN: Harlequin, the DuckDB IDE for Your Terminal
For the past four months I've been working (part-time, this is OSS after all) on Harlequin, a SQL IDE for DuckDB that runs in your terminal. I built this because I work in Data, and I found myself often reaching for the DuckDB CLI to quickly query CSV or Parquet data, but then hitting a wall when using the DuckDB CLI as my queries got more complex and my result sets got larger.
Harlequin is a drop-in replacement for the DuckDB CLI that runs in any terminal (even over SSH), but adds a browsable data catalog, full-powered text editor (with multiple buffer support), and a scrollable results viewer that can display thousands of records.
Harlequin is written in Python, using the Textual framework. It's licensed under MIT.
Today I released v1.0.0, and I'm excited to share Harlequin with HN for the first time. You can try it out with `pip install harlequin`, or visit https://harlequin.sh for docs and other info.
- FLaNK Stack Weekly for 07August2023
What are some alternatives?
s4 - Structured state space sequence models
hugging-chat-api - HuggingChat Python API🤗
opensms - Open-source solution to programmatically send and receive SMS using your own SIM cards
llama2_aided_tesseract - Enhance Tesseract OCR output for scanned PDFs by applying Large Language Model (LLM) corrections, complete with options for text validation and hallucination filtering.
OpenBuddy - Open Multilingual Chatbot for Everyone
examples - Analyze the unstructured data with Towhee, such as reverse image search, reverse video search, audio classification, question and answer systems, molecular search, etc.
textadept - Textadept is a fast, minimalist, and remarkably extensible cross-platform text editor for programmers.
Qwen-7B - The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud. [Moved to: https://github.com/QwenLM/Qwen]
ToolBench - [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
gorilla-cli - LLMs for your CLI
yyjson - The fastest JSON library in C
anomalib - An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.