automate-this
Analyze a screen recording of a manual process and produce targeted, working automation scripts. Extracts frames and audio narration from video files, reconstructs the step-by-step workflow, and proposes automation at multiple complexity levels using tools already installed on the user machine.
Best for Process automationWorks with GitHub
⌘source
- author
@github- language
- Python
★30kstars
3.6kforks
Apr 18, 2026
✦overview.md
Key Features
- ·Analyzes screen recordings of manual processes
- ·Extracts frames and audio narration from video files
- ·Reconstructs step-by-step workflows
- ·Proposes automation scripts at multiple complexity levels
- ·Uses tools already installed on the user's machine
Use Cases
- →Automating repetitive manual tasks captured in screen recordings
- →Converting documented workflows from video tutorials into executable scripts
- →Analyzing recorded processes to identify automation opportunities
Best for
- ✓Process automation
- ✓Workflow documentation analysis
Not ideal for
- !Real-time automation
- !Processes without visual recordings
FAQs
name
automate-this
description
Analyze a screen recording of a manual process and produce targeted, working automation scripts. Extracts frames and audio narration from video files, reconstructs the step-by-step workflow, and proposes automation at multiple complexity levels using tools already installed on the user machine.
Automate This
Analyze a screen recording of a manual process and build working automation for it.
The user records themselves doing something repetitive or tedious, hands you the video file, and you figure out what they're doing, why, and how to script it away.
Prerequisites Check
Before analyzing any recording, verify the required tools are available. Run these checks silently and only surface problems:
command -v ffmpeg >/dev/null 2>&1 && ffmpeg -version 2>/dev/null | head -1 || echo "NO_FFMPEG"
command -v whisper >/dev/null 2>&1 || command -v whisper-cpp >/dev/null 2>&1 || echo "NO_WHISPER"
- ffmpeg is required. If missing, tell the user:
brew install ffmpeg(macOS) or the equivalent for their OS. - Whisper is optional. Only needed if the recording has narration. If missing AND the recording has an audio track, suggest:
pip install openai-whisperorbrew install whisper-cpp. If the user declines, proceed with visual analysis only.
Phase 1: Extract Content from the Recording
Given a video file path (typically on ~/Desktop/), extract both visual frames and audio:
Frame Extraction
$install
1-click copynpx skills add github/awesome-copilot --skill automate-thisSafety assessment
★
Clarity score
How clear and easy to understand the SKILL.md instructions are, rated from 1 to 5.
3/ 5
goodMostly clear, but there are still a few confusing or poorly structured parts.
◎
Actionability score
How directly an agent can act on the SKILL.md instructions, rated from 1 to 5.
3/ 5
mediumPartially actionable with several concrete steps, but still missing important details.