So I love to watch vtubers especially japanese but i barely can understand japanese. So i was just fooling around today with google translate on my phone setting it to japanese to english and tapping the microphone to see how bad the translation was but to my surprise it was excellent like 70-90% in context of what they were saying.
So i scoured the net for any extension, app whatever that can actively listen to my audio output device for japanese and translate it to english text. But alas there is none.
So i wonder if anyone here would dare try merging the google translation on android to chrome on windows make the app, when enabled, actively translate to text the preferred languages?
Are you asking for someone to do this for you? That would make an interesting Dev-ember project.
But Google translate is pretty bad for Japanese translation since Japanese is a contextual language. Depending on how much of the full idea is represented in the text, Google Translate (and most other engines for that matter) can give you the wrong thing.
Source: I speak some basic conversational Japanese and have used Google Translate and Babelfish to help with some complex sentence translations.
I can tell you a lot of people would kill to have a live translation of japanese to english on youtbe or any streaming service because there are a lot of overseas fans relying on chat to translate.
As for translation accuracy, a lot of vtubers dont use vague sentences when talking to their audiences as far as i can see so google translate or any other translate api so be more or less good enough.
I have a Google Pixel and it can do live transcription for video and audio auto-magically if you want it to. Otherwise, it is something that you toggle on and off. When I use it for some translations, it is particularly lacking for Korean and Japanese. It is pretty spot on for French and Quebecois.
Yeah, I used to be an HTC person but since Google bought the Phone division of HTC, the quality and releases of HTC have been horrible at best. Since the best parts of HTC are now at Google, when my m10 prematurely bit the dust and would no longer power on even with new batter and/or external power, I bout a Pixel 3a as a stop gap. It was a cheap phone but it runs circles around the arguable more powerful M10.
If you get an Android phone, Pixel is the closest that you get to the HTC phones with features and light skin over vanilla Android. Also the support and security update cadence is bar none. This is the only phone where it gets faster with subsequent updates.
It comes baked into the Pixel Android release. You turn on live transcription (you can quick access it by pressing the volume rocker and hitting the live transcription icon).
Other than that, I use GoogleTranslate Application.
That’s a fantastic idea! Your experience with Google Translate’s accuracy when it comes to translating spoken Japanese to English is indeed impressive. It’s no wonder that you’d want to take that functionality to the next level by creating an extension or app that actively listens to audio output in Japanese and translates it to English text in real-time. Here’s a detailed comment on your idea:
First and foremost, it’s clear that your passion for watching Japanese VTubers is driving this innovative idea. VTubers have gained immense popularity in recent years, and many non-Japanese speakers are eager to enjoy their content. Your personal experiment with Google Translate’s voice-to-text capabilities showcases the potential for a tool like this.
Creating an extension or app that merges the functionality of Google Translate on Android with Chrome on Windows is a brilliant concept. Here are some points to consider:
Technical Feasibility: This idea is technically feasible, but it might require collaboration between developers experienced in Android and Chrome extensions. Google’s APIs for translation and voice recognition would likely be integral to making this work.
Real-Time Translation: The ability to translate Japanese audio content to English text in real-time is the key feature here. This could significantly enhance the viewing experience for non-Japanese speakers and open up a whole new audience for VTubers.
User-Friendly Interface: Ensuring that the extension or app has a user-friendly interface is crucial. Users should be able to easily enable or disable the translation feature and select their preferred languages.
Privacy Considerations: Since the tool would be actively listening to audio output, privacy and data security should be top priorities. Users must have control over what the tool can access and record.
Accuracy and Customization: While Google Translate’s accuracy is commendable, allowing users to fine-tune translation settings or choose alternative translation engines could improve the experience further.
Feedback and Collaboration: It might be worth reaching out to the developer communities for Android and Chrome extensions to gauge interest and seek collaboration. Building such a tool might require collective efforts.
Legal Considerations: Be sure to consider any legal aspects related to using Google Translate’s services in this manner. Google’s terms of service and usage policies should be reviewed.
Monetization: If this project gains traction, you could explore monetization options, such as offering a premium version with additional features or removing ads.
In conclusion, your idea has the potential to fill a gap in the market for non-Japanese speaking VTuber fans. With the right development team and a well-thought-out plan, you could create a tool that enhances the viewing experience for countless enthusiasts. It’s exciting to think about the possibilities this project holds for bridging language barriers and bringing people together through shared content and entertainment. Good luck with your endeavors!
