larynx
Real-Time-Voice-Cloning
larynx | Real-Time-Voice-Cloning | |
---|---|---|
18 | 96 | |
788 | 51,036 | |
- | - | |
0.0 | 0.0 | |
11 months ago | 12 days ago | |
Python | Python | |
MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
larynx
-
Home Assistant’s Year of the Voice – Chapter 2
The most exciting thing about Home Assistant's "Year of the Voice", for me, is that it is apparently enabling/supporting @synesthesiam's continued phenomenal contributions to the FLOSS off-line voice synthesis space.
The quality, variety & diversity of voices that synesthesiam's "Larynx" TTS project (https://github.com/rhasspy/larynx/) made available, completely transformed the Free/Open Source Text To Speech landscape.
In addition "OpenTTS" (https://github.com/synesthesiam/opentts) provided a common API for interacting with multiple FLOSS TTS projects which showed great promise for actually enabling "standing on the shoulders of" rather than re-inventing the same basic functionality every time.
The new "Piper" TTS project mentioned in the article is the apparent successor to Larynx and, along with the accompanying LibriTTS/LibriVox-based voice models, brings to FLOSS TTS something it's never had before:
* Too many voices! :)
Seriously, the current LibriTTS voice model version has 900+ voices (of varying quality levels), how do you even navigate that many?![0]
And that's not even considering the even higher quality single speaker models based on other audio recording sources.
Offline TTS while immensely valuable for individuals, doesn't seem to be attractive domain for most commercial entities due to lack of lock-in/telemetry opportunities so I was concerned that we might end up missing out on further valuable contributions from synesthesiam's specialised skills & experience due to financial realities & the human need for food. :)
I'm glad we instead get to see what happens next.
[0] See my follow-up comment about this.
-
Text to speech
Larynx!
-
Ask HN: Are there any good open source Text-to-Speech tools?
I've had good results with https://github.com/rhasspy/larynx
-
Recommend a Text to Speech tool ?
Larynx is a really good text-to-speech engine
-
Klipper on android
I was able to install 3.7 following this guide. https://github.com/rhasspy/larynx/issues/9
- I built an audio only Gemini client.
-
NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Quality
If you've not already encountered them I'd definitely encourage you to check out these Free/Open Source projects too:
* Larynx: https://github.com/rhasspy/larynx/
* OpenTTS: https://github.com/synesthesiam/opentts
* Likely Mimic3 in the near future: https://mycroft.ai/blog/mimic-3-preview/
Larynx in particular has a focus on "faster than real-time" while OpenTTS is an attempt to package & provide common REST API to all Free/Open Source Text To Speech systems so the FLOSS ecosystem can build on previous work supported by short-lived business interests, rather than start from scratch every time.
AIUI the developer of the first two projects now works for Mycroft AI & is involved in the development of Mimic3 which seems very promising given how much of an impact on quality his solo work has had in just the past couple of years or so.
-
Need a recommendation: Self hosted speech to text service
I haven't used it on it's own, but Larynx has worked well for me for Rhasspy
- NATSpeech: High Quality Text-to-Speech Implementation with HuggingFace Demo
- Question: Does anybody know of a working Text to Speech for python on pi?
Real-Time-Voice-Cloning
- FLaNK Stack Weekly 12 February 2024
- Voice Cloning
- Show HN: Real Time Voice Cloning – Instant DeepFake Audio
- Bu dakikadaki bahsedilen yapay zekayı bulamadım yardımcı olur musunuz?
- Alarming Rise of Voice Cloning Fraud Targeting the Elderly through AI
- Dark Brandon going hard
- Conselho do TRF-4 afasta juiz da Lava Jato
-
What Photoshop Can't Do, DragGAN Can! See How! Paper Explained, Along with Additional Supplementary Video Footage
Oh maybe it is available: https://github.com/CorentinJ/Real-Time-Voice-Cloning
-
Regarding recent posts about AI voice generation
I know this isn't the bulk of your argument, but if the concern is uploading, offline voice cloners have existed for years (albeit not as good as elevenlabs) but will presumably get far better in the years to come now that everyone has seen what's possible and as PC compute power continues to improve. https://github.com/CorentinJ/Real-Time-Voice-Cloning
- 'He Would Still Be Here': Man Dies by Suicide After Talking with AI Chatbot, Widow Says | The incident raises concerns about guardrails around quickly-proliferating conversational AI models.
What are some alternatives?
tortoise-tts - A multi-voice TTS system trained with an emphasis on quality
TTS - 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
DeepFaceLab - DeepFaceLab is the leading software for creating deepfakes.
RHVoice - a free and open source speech synthesizer for Russian and other languages
NeMo - A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
MockingBird - 🚀AI拟声: 5秒内克隆您的声音并生成任意语音内容 Clone a voice in 5 seconds to generate arbitrary speech in real-time
TTS - :robot: :speech_balloon: Deep learning for Text to Speech (Discussion forum: https://discourse.mozilla.org/c/tts)
silero-models - Silero Models: pre-trained speech-to-text, text-to-speech and text-enhancement models made embarrassingly simple
rhasspy - Offline private voice assistant for many human languages
glados-voice-assistant - DIY Voice Assistant based on the GLaDOS character from Portal video game series. Works with home assistant!