· Does it need a browser?
Scraper returns empty HTML? Tell the four causes apart
An empty or near-empty response has four common causes: an app shell, a refusal page, compressed bytes and a soft 404. How to tell which one you have.
SiteRender blog: notes on raw HTML and rendering
One rendering question per post, with its sources listed and a test you can run on example.com before you change your pipeline.
RSS feedDoes it need a browser?
· Does it need a browser?
View source vs Inspect element: the one that matches curl
View source shows the HTML the server sent. Inspect shows the live DOM after scripts ran. Only one of them is what a plain HTTP fetch receives.
SPA, SSR and hydration
· SPA, SSR and hydration
Reading Next.js hydration data without a browser
Next.js pages often ship their content as JSON in the first response. Where to find __NEXT_DATA__ and the App Router payload, and how to parse them safely.