AI & GTM ENGINEERING SHOWCASE

Local YouTube Knowledge Pipeline

A hybrid, local-first system that bypasses cloud IP blocking to scrape, synthesize, and pipe YouTube transcript data into your personal knowledge base with $0 server costs.

Read Case Study
System Preview
play_circle
Local Node: Active
Thread ID: [PIPELINE_LOCAL_01]
YOUTUBE CLOUDFLARE DOCKER GEMINI AI TELEGRAM
Engineering Case Study

The Product Builder's Perspective

Bypassing Aggressive IP Blocks

YouTube aggressively limits cloud hosting providers. To solve this, I engineered a hybrid execution model: ingestion sits in the cloud, while scraping executes on a local residential IP node, simulating authentic traffic patterns.

Architecture: Hybrid Docker Sync

Lightweight local nodes running in Docker containers subscribe to task queues via Webhooks. This ensures reliability without the overhead of massive VM clusters.

face
Nico
AI & GTM Engineer
Stack Focus AI/GTM Automation
Favorite SDK TS / Hono / Workers
Status Ready for Collab
Interactive Simulation

The Local-First Orchestration Flow

01

Ingestion Layer

CF Worker captures PubSub webhook.

02

Review Queue

Extension prompts human-in-the-loop validation.

03

Local Scraping

Residential IP node executes secure extraction.

04

LLM Structuring

Gemini AI synthesizes and categorizes transcript.

05

Knowledge Sync

Markdown files pushed to Obsidian/Telegram.

Feature Set

Fully Integrated Solutions

hub

Autopilot Ingestion

Zero-latency webhook listeners on the edge, handling thousands of concurrent channel updates.

chrome_reader_mode

Chrome Extension UI

A custom dashboard to manage your ingestion queue directly from the browser window.

terminal

Category-Specific Prompts

Dynamic prompt templates that adapt based on the video niche (Tech, Philosophy, Gaming).

savings

Zero-Cost Infrastructure

Utilizing free-tier cloud resources and existing local hardware for 100% margin operation.

auto_stories

Obsidian Sync

Automatic generation of clean Markdown files with bi-directional links for your PKM.

send

Telegram Digests

Daily summaries of processed insights delivered as a clean message to your mobile device.

Pipeline Technical Performance

~5.2s
EXECUTION SPEED
$0.00
SERVER COST
100%
IP BLOCKS BYPASSED
10+ hrs
TIME SAVED / WK
code