Technical guides
Configuration, failure modes and measurement. Written for the people building the pipeline.
Playwright proxy configuration
Configure a proxy, separate credentials, and check navigation and content before comparing performance.
Fixing 403 errors when scraping
Distinguish missing authorization, content blocks, and configuration failures.
Handling 429 rate limits
Bound concurrency, honor retry instructions, and avoid retry storms.
Python rotating proxies
Design a bounded proxy pool with explicit configuration and observable errors.
MCP web scraping setup
Define a narrow web-fetch tool boundary with explicit limits and provenance.