llm-colosseum
Awesome_Satellite_Benchmark_Datasets
| llm-colosseum | Awesome_Satellite_Benchmark_Datasets | |
|---|---|---|
| 4 | 1 | |
| 942 | 284 | |
| 74.6% | - | |
| 9.4 | 4.0 | |
| 8 days ago | about 1 month ago | |
| Jupyter Notebook | Jupyter Notebook | |
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llm-colosseum
- LLM Colosseum
- Evaluate LLMs in Real Time with Street Fighter III
-
LLM Colosseum: Make LLMs fight in SFIII
Hello guys,
Tired of current boring LLMs benchmark ? I'm sharing with you a fun project built during the Mistral AI SF hackathon.
Using a RL framework, we made LLMs fight against each other in real time in Street Fighter III. You can find the repo here : https://github.com/OpenGenerativeAI/llm-colosseum.
Aside from the fact that it's very funny to see Mistral and others performing Hadouken, we found that it is a great way to benchmark language models. They need to quickly understand their environment and take actions accordingly.
With >400 fights, check out the ELO ranking on the HF space here : https://huggingface.co/spaces/junior-labs/llm-colosseum
Awesome_Satellite_Benchmark_Datasets
What are some alternatives?
awesome-satellite-imagery-datasets - 🛰️ List of satellite image training datasets with annotations for computer vision and deep learning
lidar-harmonization - Code release for Intensity Harmonization for Airborne LiDAR
ml-earth-observation-101 - An introduction to applying machine learning to satellite imagery (remote sensing).
awesome-gis - 😎Awesome GIS is a collection of geospatial related sources, including cartographic tools, geoanalysis tools, developer tools, data, conference & communities, news, massive open online course, some amazing map sites, and more.
awesome-bigdata - A curated list of awesome big data frameworks, ressources and other awesomeness.
ee_repository_stats - Scraping, parsing, and analyzing every public Earth Engine repository
ml4eo-bootcamp-2021 - Machine Learning for Earth Observation Training of Trainers Bootcamp
awesome-open-geoscience - Curated from repositories that make our lives as geoscientists, hackers and data wranglers easier or just more awesome
QGIS - QGIS is a free, open source, cross platform (lin/win/mac) geographical information system (GIS)