Top 23 Python Whisper Projects

• PaddleSpeech

  6 10,271 6.8 Python

  Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

  

Project mention: Open Source Libraries | /r/AudioAI | 2023-10-02

PaddlePaddle/PaddleSpeech

• buzz

  21 10,177 8.5 Python

  Buzz transcribes and translates audio offline on your personal computer. Powered by OpenAI's Whisper.

Project mention: Buzz: Transcribe and translate audio offline on your personal computer | news.ycombinator.com | 2024-03-21

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• whisperX

  24 9,391 8.4 Python

  WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

Project mention: Easy video transcription and subtitling with Whisper, FFmpeg, and Python | news.ycombinator.com | 2024-04-06

It uses this, which does support diarization: https://github.com/m-bain/whisperX

• faster-whisper

  23 9,278 8.1 Python

  Faster Whisper transcription with CTranslate2

  

Project mention: Creando Subtítulos Automáticos para Vídeos con Python, Faster-Whisper, FFmpeg, Streamlit, Pillow | dev.to | 2024-04-29

Faster-whisper (https://github.com/SYSTRAN/faster-whisper)

• FunASR

  2 3,872 9.9 Python

  A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.

  

Project mention: FunASR: Fundamental End-to-End Speech Recognition Toolkit | news.ycombinator.com | 2024-01-13

• distil-whisper

  9 3,236 8.9 Python

  Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.

  

Project mention: FLaNK Stack 05 Feb 2024 | dev.to | 2024-02-05

• chatgpt-telegram-bot

  3 2,781 8.5 Python

  🤖 A Telegram bot that integrates with OpenAI's official ChatGPT APIs to provide answers, written in Python (by n3d1117)

Project mention: Are you selfhosting a ChatGPT alternative? | /r/selfhosted | 2023-06-09

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• inference

  2 2,871 9.8 Python

  Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

  

Project mention: GreptimeAI + Xinference - Efficient Deployment and Monitoring of Your LLM Applications | dev.to | 2024-01-24

Xorbits Inference (Xinference) is an open-source platform to streamline the operation and integration of a wide array of AI models. With Xinference, you’re empowered to run inference using any open-source LLMs, embedding models, and multimodal models either in the cloud or on your own premises, and create robust AI-driven applications. It provides a RESTful API compatible with OpenAI API, Python SDK, CLI, and WebUI. Furthermore, it integrates third-party developer tools like LangChain, LlamaIndex, and Dify, facilitating model integration and development.

• whisper-timestamped

  2 1,582 8.1 Python

  Multilingual Automatic Speech Recognition with word-level timestamps and confidence

  

Project mention: Show HN: AI Dub Tool I Made to Watch Foreign Language Videos with My 7-Year-Old | news.ycombinator.com | 2024-02-28

Yes. But Whisper's word-level timings are actually quite inaccurate out of the box. There are some Python libraries that mitigate that. I tested several of them. whisper-timestamped seems to be the best one. [0]

[0] https://github.com/linto-ai/whisper-timestamped

• yt-whisper

  3 1,320 0.0 Python

  Using OpenAI's Whisper to automatically generate YouTube subtitles

• WhisperLive

  4 1,287 9.4 Python

  A nearly-live implementation of OpenAI's Whisper.

  

Project mention: Show HN: WhisperFusion – Ultra-low latency conversations with an AI chatbot | news.ycombinator.com | 2024-01-29

Everything runs locally, we use:

- WhisperLive for the transcription - https://github.com/collabora/WhisperLive

• auto-subtitle

  4 1,211 2.1 Python

  Automatically generate and overlay subtitles for any video.

• subsai

  3 1,094 8.4 Python

  🎞️ Subtitles generation tool (Web-UI + CLI + Python package) powered by OpenAI's Whisper and its variants 🎞️

Project mention: Porting CP/M to the Brother SuperPowerNote Z80 laptop thing [video] | news.ycombinator.com | 2023-12-13

Adding Whisper subtitles was really easy and they're dramatically better than the automatic Google ones (I did it via https://github.com/abdeladim-s/subsai, which was really easy to use). So there is now a reasonably good transcript available in the video comments.

• whisper.api

  4 843 8.0 Python

  This project provides an API with user level access support to transcribe speech to text using a finetuned and processed Whisper ASR model.

Project mention: Do you know any quality FastAPI starter projects? | /r/flask | 2023-10-10

• truss

  3 843 9.6 Python

  The simplest way to serve AI/ML models in production (by basetenlabs)

  

• whisper-standalone-win

  3 842 8.8 Python

  Whisper & Faster-Whisper standalone executables for those who don't want to bother with Python.

Project mention: Question : is this a movie only tracker? | /r/Karagarga | 2023-07-03

On the other hand, if you need subtitles for a movie that doesn't have some. There are some automated solutions like Whisper that can do a very decent job in most cases : https://github.com/Purfview/whisper-standalone-win

• whisper-playground

  7 763 6.1 Python

  Build real time speech2text web apps using OpenAI's Whisper https://openai.com/blog/whisper/

• whisper-ctranslate2

  3 770 8.3 Python

  Whisper command line client compatible with original OpenAI client based on CTranslate2.

  

Project mention: Firefox slow to load YouTube? Just another front in Google's war on ad blockers | news.ycombinator.com | 2023-12-12

Much better, actually. Try the large-v3 model, it's great. I use it via whisper-ctranslate2 which is a faster implementation.

https://github.com/Softcatala/whisper-ctranslate2

• Whisper-WebUI

  1 715 9.1 Python

  A Web UI for easy subtitle using whisper model.

• AI-Waifu-Vtuber

  1 656 5.6 Python

  AI Vtuber for Streaming on Youtube/Twitch

• whisper_mic

  2 639 7.2 Python

  Project that allows one to use a microphone with OpenAI whisper.

• agentchain

  2 563 5.8 Python

  Chain together LLMs for reasoning & orchestrate multiple large models for accomplishing complex tasks

  

• Owl

  2 444 9.7 Python

  A personal wearable AI that runs locally (by OwlAIProject)

  

Project mention: Limitless: Personalized AI powered by what you've seen, said, and heard | news.ycombinator.com | 2024-04-15

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Python Whisper related posts

• Best Speech-to-text API with speaker diarization?

  1 project | news.ycombinator.com | 6 May 2024

• Easy video transcription and subtitling with Whisper, FFmpeg, and Python

  1 project | news.ycombinator.com | 6 Apr 2024

• SOTA ASR Tooling: Long-Form Transcription

  1 project | news.ycombinator.com | 31 Mar 2024

• Deploying whisperX on AWS SageMaker as Asynchronous Endpoint

  2 projects | dev.to | 31 Mar 2024

• Buzz: Transcribe and translate audio offline on your personal computer

  1 project | news.ycombinator.com | 21 Mar 2024

• Voxos.ai – An Open-Source Desktop Voice Assistant

  7 projects | news.ycombinator.com | 19 Jan 2024

• Jarvis: A Voice Virtual Assistant in Python (OpenAI, ElevenLabs, Deepgram)

  7 projects | news.ycombinator.com | 18 Dec 2023
• A note from our sponsor - SaaSHub
  www.saashub.com | 23 May 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!