Spokenly LogoSpokenly

Agent Mode: Voice Control for Your Mac

Agent Mode interface

Agent Mode transforms Spokenly into a powerful voice assistant that can control your Mac. Instead of just transcribing, it executes commands, opens apps, searches the web, and automates tasks all through natural speech.


Why Use Agent Mode

  • Control apps and websites hands-free.
  • Automate repetitive tasks with voice commands.
  • Access AI assistants like ChatGPT and Claude instantly.
  • Execute complex workflows with simple phrases.

Getting Started

  1. Open an AI Prompt configuration.
  2. Select the tools you want to enable.
  3. Save and test with your voice command.

Performance tip: Enabling tools adds processing time. For simple transcription, don't select any tools.


Available Tools

🔍 Google Search

Search Google for any topic

"Search Google for weather"

▶️ YouTube Search

Find videos on YouTube

"Search YouTube for tutorials"

🔗 Open Website

Navigate to any website

"Open Twitter"

💬 Ask ChatGPT

Query ChatGPT

"Ask ChatGPT about Python"

🤖 Ask Claude

Query Claude AI

"Ask Claude to write a poem"

🚀 Launch Apps

Open Mac applications

"Launch Safari and Finder"

❌ Close Apps

Quit applications

"Close Safari"

⌨️ Press Keys

Simulate keyboard shortcuts

"Press command tab"

⚡ Apple Shortcuts

Run your Shortcuts

"Run morning routine"

Note: Shortcuts with input parameters are not yet supported. This will be added in a future version.

💻 Shell Command

Execute terminal commands

"Show system information"

Best Practices

  • Be specific: Clear commands work better than vague requests.
  • Create dedicated prompts: Make separate AI Prompts for different workflows.
  • Test first: Use the test feature to verify commands work as expected.
  • Enable only needed tools: Fewer active tools mean faster processing.

Need Help?

If you encounter any issues or have questions about Agent Mode, join our Discord community for support and to share feedback.


Key Takeaways

  • Agent Mode turns voice into actions, not just text.
  • Enable only the tools you need for better performance.
  • Create separate prompts for different workflows.
  • Grant necessary permissions in System Settings.

Start with simple commands, then build more complex workflows as you get comfortable with Agent Mode.