ramajha@portfolio: ~/projects/flowscrape

ramajha@portfolio:~/projects/flowscrape$ cat README.md

flowscrape

Self-hosted, no-code web scraping workflows with a visual selector picker, scheduled runs, change detection and alerts.

date
stack
typescript react express playwright sqlite drizzle
code
private repo

Scraping tools are either code-only or expensive SaaS. FlowScrape sits in between: build a scraper step by step in the browser, then let it run on a schedule.

  • Visual selector picker: click elements on a live preview of the page instead of writing selectors
  • Step templates: presets for common flows: log in then scrape, paginated lists, search and extract
  • Scheduling: cron-based runs with a job queue
  • Run history and change detection: see what changed since the last run, with notifications
  • Conditions and transforms between steps, and exports of the results
  • Proxy rotation and stealth settings for sites that block headless browsers

Express and TypeScript on the server with Playwright doing the browsing; React, Vite, Tailwind and shadcn/ui on the client; SQLite through Drizzle ORM.

cd ..