Top 12 Python Tensor Projects

Pytorch

345 78,852 10.0 Python

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Project mention: Understanding GPT: How To Implement a Simple GPT Model with PyTorch | dev.to | 2024-05-31

In this guide, we provided a comprehensive, step-by-step explanation of how to implement a simple GPT (Generative Pre-trained Transformer) model using PyTorch. We walked through the process of creating a custom dataset, building the GPT model, training it, and generating text. This hands-on implementation demonstrates the fundamental concepts behind the GPT architecture and serves as a foundation for more complex applications. By following this guide, you now have a basic understanding of how to create, train, and utilize a simple GPT model. This knowledge equips you to experiment with different configurations, larger datasets, and additional techniques to enhance the model's performance and capabilities. The principles and techniques covered here will help you apply transformer models to various NLP tasks, unlocking the potential of deep learning in natural language understanding and generation. The methodologies presented align with the advancements in transformer models introduced by Vaswani et al. (2017), emphasizing the power of self-attention mechanisms in processing sequences of data more effectively than traditional approaches (Vaswani et al., 2017). This understanding opens pathways to explore and innovate in the field of natural language processing using cutting-edge deep learning techniques (Kingma & Ba, 2015).

tvm

16 11,296 9.9 Python

Open deep learning compiler stack for cpu, gpu and specialized accelerators

Project mention: Show HN: I built a free in-browser Llama 3 chatbot powered by WebGPU | news.ycombinator.com | 2024-05-03

Yes. Web-llm is a wrapper of tvmjs: https://github.com/apache/tvm
Just wrappers all the way down

Scout Monitoring

www.scoutapm.com featured

Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
einops

19 8,010 7.5 Python

Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)

Project mention: Einsum in 40 Lines of Python | news.ycombinator.com | 2024-04-27

Not sure if the wrapper you’re talking about is your own custom code, but I really like using einops lately. It’s got similar axis naming capabilities and it dispatches to both numpy and pytorch
http://einops.rocks/

cupy

22 7,862 9.9 Python

NumPy & SciPy for GPU

Project mention: Mojo: Ownership and lifetime checks deep dive with Chris Lattner [video] | news.ycombinator.com | 2024-05-13

I think I would agree with you. In my opinion, that already exists and is decently mature. CuPy [0] for Python and CUDA.jl [1] for Julia are both excellent ways to interface with GPU that don't require you to get into the nitty gritty of CUDA. Both do their best to keep you at the Array-level abstraction until you actually need to start writing kernels yourself and even then, it's pretty simple. They took a complete GPU novice like me and let me to write pretty performant kernels without having to ever touch raw CUDA.
[0] https://cupy.dev/

mars

0 2,679 5.7 Python

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.
dlpack

1 862 5.2 Python

common in-memory tensor structure
opt_einsum

1 806 2.7 Python

⚡️Optimizing einsum functions in NumPy, Tensorflow, Dask, and more with contraction order optimization.
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
norse

6 622 6.4 Python

Deep learning with spiking neural networks (SNNs) in PyTorch.
rwkvstic

2 144 6.7 Python

Framework agnostic python runtime for RWKV models
multidim_indexing

1 7 6.6 Python

Batch multidimensional indexing for pytorch
tensortrax

1 8 6.8 Python

Math on (Hyper-Dual) Tensors with Trailing Axes
tdb

1 1 6.0 Python

tdb: Simple, Lightweight Tool for Streamlined PyTorch Tensor and CUDA Debugging.

Project mention: TDB: Simple Tensor and CUDA debugging tool | news.ycombinator.com | 2024-04-13

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Tensor related posts

Einsum in 40 Lines of Python

6 projects | news.ycombinator.com | 27 Apr 2024
Making AMD GPUs competitive for LLM inference

1 project | news.ycombinator.com | 9 Aug 2023
The Distributed Tensor Algebra Compiler (2022)

4 projects | news.ycombinator.com | 15 Jun 2023
MLC LLM - "MLC LLM is a universal solution that allows any language model to be deployed natively on a diverse set of hardware backends and native applications, plus a productive framework for everyone to further optimize model performance for their own use cases."

2 projects | /r/LocalLLM | 30 Apr 2023
Apache TVM

1 project | news.ycombinator.com | 30 Apr 2023
Neuromorphic learning, working memory, and metaplasticity in nanowire networks

2 projects | news.ycombinator.com | 24 Apr 2023
[D] The Complete Guide to Spiking Neural Networks

3 projects | /r/MachineLearning | 10 Apr 2023
A note from our sponsor - SaaSHub
www.saashub.com | 1 Jun 2024

SaaSHub helps you find the best software and product alternatives Learn more →