Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2 (by TurkuNLP)
Add to my DEV experience Suggest topics
Source Code
Suggest alternative
Edit details
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com
featured
Suggest an alternative to Megatron-DeepSpeed

Megatron-DeepSpeed reviews and mentions

Posts with mentions or reviews of Megatron-DeepSpeed. We have used some of these posts to build our list of alternatives and similar projects.

Stats

Basic Megatron-DeepSpeed repo stats
1
19
0.0
7 months ago

TurkuNLP/Megatron-DeepSpeed is an open source project licensed under GNU General Public License v3.0 or later which is an OSI approved license.

The primary programming language of Megatron-DeepSpeed is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com