2025 Foundation Project ยท Browser Automation

Speech-To-Text-Selenium

Voice-driven browser automation system turning spoken speech into Selenium navigation actions.

Year: 2025 | Role: Creator and Developer. Implemented the speech listener, query formatting logic, and Selenium execution hooks.

View source on GitHub

Project Overview

Speech-To-Text-Selenium provides hands-free browser control by bridging browser-native speech recognition with automated Selenium WebDriver routines.

Problem Statement

Traditional web automation scripts require manual keyboard and mouse execution, lacking voice-command integration for accessibility and hands-free operation.

Solution Architecture

Connected the Chrome Web Speech API with Python Selenium automation, enabling natural language command recognition, query normalization, and automated web interaction.

  • Audio Listener: Utilizes Chrome Web Speech API for high-accuracy local speech-to-text conversion.
  • Command Dispatcher: Parses voice tokens into browser automation commands (search, click, scroll, navigate).
  • Selenium Driver: Executes target DOM operations across destination web pages.

Tech Stack & Engineering

  • Python
  • Selenium WebDriver
  • Chrome Web Speech API
  • JavaScript
  • HTML5

Key Implementation Features

  • Configurable language support via Chrome speech recognition.
  • Query normalization and automated search execution.
  • Real-time console feedback on recognized utterances.

Technical Challenges & Solutions

  • Handling background noise and false command triggers: Implemented query thresholding and keyword activation gates.

Verified Results

  • Provided an early hands-on foundation in Python automation, browser DOM manipulation, and asynchronous event loops.