What is a good tool+model for near-realtime voice conversation?
r/LocalLLaMA
September 11, 2026 at 06:22 PM
📌 Looking for tools to build/run an engine to do STT-LLM-TTS basically. I know how to run all of them separately, and if need be I can build one myself, but I was curious if there is already an open source tool out there that can do this. I know that some UIs like Open WebUI can do this but I find it to be not fluid. I don't know about SillyTavern though, it might already have it. This is just for the funsies so it doesn't have to be perfect. I saw this model https://huggingface.co/LessThanThre...
Looking for tools to build/run an engine to do STT-LLM-TTS basically.
I know how to run all of them separately, and if need be I can build one myself, but I was curious if there is already an open source tool out there that can do this. I know that some UIs like Open WebUI can do this but I find it to be not fluid. I don't know about SillyTavern though, it might already have it.
This is just for the funsies so it doesn't have to be perfect.
I saw this model https://huggingface.co/LessThanThreeAI/Qwen3.8-27B-Humanlike-Chat-GGUF and I bet I will have a LOT of fun if I can just turn this into a turn based or fluid voice conversation engine.
[link] [comments]
Read the full article at
r/LocalLLaMA
More in Models & Releases
Models & Releases
NVIDIA Unveils RTX PRO 5500 "Blackwell" Workstation GPU with 84 GB GDDR7 Memory
submitted by /u/Lumpy_Phase_9539 [link] [comments]
What happened to AI browsers?
AI browsers were supposedly going to kill Chrome/Safari, and help people quickly buy stuff, book tickets etc. at reasonable prices while avoiding ads. That was such a great sales pitch, but it has been just radio silence from then on. Ar...
[Bi-Weekly Megathread] Project Showcase
Do you have something you'd like to share with the r/LocalLLaMA community. This is the place for it! Recommendation on presentation: Please share plain english description of what your project does and why people should care about it Ho...