Top 3 Python pytorch-transformer Projects

transformers

181 126,516 10.0 Python

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Project mention: How to count tokens in frontend for Popular LLM Models: GPT, Claude, and Llama | dev.to | 2024-05-21

Thanks to transformers.js, we can run the tokenizer and model locally in the browser. Transformers.js is designed to be functionally equivalent to Hugging Face's transformers python library, meaning you can run the same pretrained models using a very similar API.

pytorch-widedeep

7 1,250 8.7 Python

A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
tensor_parallel

3 580 8.5 Python

Automatically split your PyTorch models on multiple GPUs for training & inference

Project mention: How to finetune a LoRA with Data parallelism? | /r/LocalLLaMA | 2023-06-23

I've had some success with the wrappers here: https://github.com/BlackSamorez/tensor_parallel

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).