[Open-source self-promo] Mimi: Add real-time translated subtitles to videos and livestreams

Sharing something I made: Mimi. When watching foreign-language videos, livestreams, or online courses without Chinese subtitles, it can recognize the audio currently playing on your computer and translate it into floating subtitles, without requiring you to download the video first.

The subtitles can be dragged and resized, and you can also switch to immersive mode, which leaves only the subtitles visible. The software is free and open source under the MIT license, supporting Apple silicon Macs running macOS 13+ and Windows x64.

You’ll need to provide your own cloud service API credentials, and providers may charge for their services. It currently mainly uses Alibaba Cloud for testing; other services are also integrated, but haven’t been tested thoroughly and may not work properly.

GitHub: GitHub - yuxino/mimi: Real-time system-audio subtitles and translation for macOS and Windows. 实时字幕翻译,支持视频、会议与游戏音频。 · GitHub

Give it a try if you need it, and feel free to open an issue if you run into any problems. Happy Mid-Autumn Festival! ⸜(。˃ ᵕ ˂ )⸝:heart:

Film shown: Sintel, © Blender Foundation, CC BY 3.0.

7 Likes

Thank you for your selfless sharing~ Please like to show your support~

1 Like

Very strong

1 Like

Pretty impressive.

1 Like

Thanks for the encouragement, boss! I’m so touched—it’s my first time posting on loc!!!

Thanks for the encouragement, boss! Happy holidays!!!

Thanks for putting so much thought into this! I used to always use the accessibility option. Thanks for sharing!

1 Like

Thank you for your recognition, teacher~ :face_holding_back_tears:

Thank you so much for your recognition and encouragement, teacher!! I’m incredibly grateful—this is my first time sharing my work here. :heart:

1 Like

Learning a bit… Please like—thanks for sharing~

1 Like

Can live streams on TikTok and YouTube be translated on an iOS phone?

1 Like

This is actually a desktop app. An iOS version is being explored, and a similar effect could be achieved with picture-in-picture. The downside is that if the video also enters picture-in-picture mode, this little translation window disappears. Hahaha, I don’t know how to solve that. I’ve also considered some rather unusual approaches, such as using the Dynamic Island to display translated subtitles, but that didn’t work. It would look roughly like this:

1 Like

You’re awesome, boss :+1:

1 Like

I’d like to fulfill a little dream: when I used to watch adult videos, I could only understand the performers’ expressions, so I’d also like to understand a bit of what they were saying ≽(•⩊ •マ≼

It’s not something you come across often, but it’s practical and in demand in the market.

1 Like

Thank you for sharing so selflessly~ Please like and support~

1 Like

This is great, thanks for sharing.

1 Like

Nicely done—put it straight on Xianyu (闲鱼) and sell it!

1 Like

Awesome!

1 Like

此话题已在最后回复的 24 小时后被自动关闭。不再允许新回复。