Skip to content
View original post on X: Philipp Schmid
Published
42/100

Gemini API CLI can generate test audio for voice features in coding agents

AIPhilipp Schmid says developers can use the Gemini API CLI with a coding agent to test voice and audio features. The method generates speech, feeds it to Chrome as a fake microphone input via a WAV file, clicks the mic button with Playwright or browser-use, and checks the transcript and UI state in the DOM.
Philipp SchmidVerified on X
@_philschmid
View on X

Did you know you can use the Gemini API CLI together with your coding agent to test multimodal features like voice and audio? Here is how it works:

  1. Use Gemini API CLI to generate speak
  2. Use Chrome with --use-file-for-fake-audio-capture=voice.wav%noloop
  3. Click the mic button via Playwright or browser-use so getUserMedia streams the WAV from 0.0s
  4. Verify the transcript and UI state in the DOM

Prompt below 👇

Source details

Philipp Schmid · x.comPublished · added here

Original title: Did you know you can use the Gemini API CLI together with your coding agent to test multimodal features like voice and audio? Here is how...

Topics

AI codingMultimodal AIVoice & audioTutorials & how-to