[D] Any pre trained retrieval based language models available?

This page summarizes the projects mentioned and recommended in the original post on /r/MachineLearning
Retrieval Artificial intelligence icml-2022 Deep Learning Knn

Scout Monitoring - Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

  • RetGen

    • You may look into RetGen by Microsoft. They have released model checkpoints too.

  • retomaton

    PyTorch code for the RetoMaton paper: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022)

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo

  • RETRO-pytorch

    Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

    • There's a Github project that an individual put together based on the RETRO paper. If you checkout the issues list there is some info on work on a pretrained model.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • [D] Is there an open-source implementation of the Retrieval-Enhanced Transformer (RETRO)?

    4 projects | /r/MachineLearning | 15 Jan 2022

  • Diffusion Models

    4 projects | news.ycombinator.com | 25 May 2024

  • The best domain name generators on the web

    2 projects | dev.to | 19 May 2024

  • HMT: Hierarchical Memory Transformer for Long Context Language Processing

    4 projects | news.ycombinator.com | 17 May 2024

  • Anomaly Detection with FiftyOne and Anomalib

    4 projects | dev.to | 6 May 2024