yourgirltech/job-search-pipeline-agent

A daily automated job search agent — 5 sources, priority scoring for AI/full-stack roles, geographic filtering for Africa-eligible listings, LLM summarization, and dual delivery (email digest + Supabase log). # Job Search Pipeline Agent A daily automated job search agent built in n8n. Every morning it pulls fresh remote listings from five sources, filters and prioritizes them against a real profile (full-stack, AI agent/automation, AI engineer, n8n), scores them, summarizes the matches with an LLM, and delivers both an email digest and a permanent Supabase log — with no manual searching required. ## Why this exists Job searching manually across multiple boards, filtering for genuinely relevant and genuinely eligible roles, is repetitive, exhausting work — exactly the kind of thing worth automating. This isn't a demo scraper; it runs daily, unattended, in production. ## Architecture ``` Schedule Trigger (daily, 08:00) │ ├──► RemoteOK API ─────────────┐ ├──► WeWorkRemotely RSS ───────┤ ├──► Jobicy API ───────────────┤ ├──► Arbeitnow API ────────────┼──► Merge (append) ──► Filter & Score ──┐ └──► Remote4Africa (scraped) ──┘ │ ▼ LLM Summarization (Gemini) │ Unwrap structured output │ ┌─────────────────────────────┴─────────────────────────────┐ ▼ ▼ Split into individual rows Format as email digest │ │ Save to Supabase (job_leads) Send via Gmail ``` ## The five sources — and why one required a different approach **Four via genuine free, public APIs, no authentication required:** - RemoteOK - We Work Remotely (RSS) - Jobicy - Arbeitnow — includes an explicit `remote` boolean, used directly for filtering **Remote4Africa has no public API.** It's the single most precisely-targeted source for genuine Africa-eligible remote roles, but it's a subscription platform, not a developer feed. Rather than skip it, it's integrated via direct HTML scraping of its public category pages (`/categories/software-development`, `/categories/data-science`), extracting listings vi …