One of Google’s top on-device machine learning (ML) programs, only available on Pixel phones, is Recorder. Surprisingly, the transcription software came from the Google Creative Lab as the firm works to develop additional Pixel Smarts.
Recorder not only records audio but also instantly transcribes spoken phrases without the need for an internet connection. This speech-to-text process is carried out solely on your Pixel, ensuring its privacy and enabling quick searches.
Additionally, the program can tag noises like music and even laughter, and an Smart Scrolling feature highlights key passages in the transcript with keywords to facilitate quick scrolling. Later updates brought with them the ability to create editable shareable clips, cloud backup, link-based sharing, and a Material You redesign with tablet-like landscape mode.
Naturally, Recorder utilizes machine learning advancements from Google Research, but the app was in large part created by the Google Creative Lab, which describes itself as:
a group of creatives who spend 99.9% of their time creating—designers, writers, programmers, filmmakers, producers, and business thinkers. We are a tiny group that strives to make a bigger effect than we leave behind. Our role is to contribute to Google’s future inventions and effectively share Google’s innovations so that more people may benefit from them.
The Creative Lab offers a wide range of services, from branding to creating advertisements, most notably Parisian Love . The former has a variety of unique products and experiences that are frequently included on Experiments with Google , whereas Project Guideline , which aids those with limited vision in operating autonomously, is the result of a cooperation between Google Research, Google Creative Lab, and the Accessibility Team.
In contrast, Recorder, developed by the Pixel Essential Apps team, is a more ambitious project. all-neural, on-device speech recognizer , a recently developed machine learning algorithm, was given a very practical application by Creative Lab, which is very much in line with the group’s objective.
By appointing a leader for Smart Scrolling 0, Google intends to create additional Pixel experiences along these lines in the future. Funny enough, the company then broadened the listing to include Android System Intelligence, the background service that powers many ML capabilities but is most feature-rich on the Pixel. (The quotations in the section below refer to the original job posting.)
Your primary responsibility as the Director of Product Management for Pixel Smarts will be to develop unique experiences on Pixel that make use of our machine learning skills. This calls for a thorough, creative investigation of user requirements and technical potential. Additionally, you will take the lead in this research, develop a product roadmap, and aid in the establishment of a Product team.
The Pixel 2’s Now Playings backdrop detection, Recorder and Live Caption’s improved automatic speech recognition, on-device Assistant, and Gboard voice typing are some examples of current innovations.
Google wants the Pixel to make use of cutting-edge machine learning technology and develop distinctive smart features while using the special Pixel hardware and function integration.