Failure
First failed attempt at using Puppeteer to scrape a website with web scraping protection turned on.
Take a look at the buffer dumps from my terminal, to see all the errors I came across.
Some notes
I didn’t handle the errors because I just wanted to play with Puppeteer.
I wonder if there was a Bot and/or DDoS protection from something like Cloudflare. If this is the case, it is a lose/lose for me.
Faq
I could have easily accomplished this task with ⌘ + P and save as PDF. However, this was an experiment to see how I could save data from some site with a web scraping tool like Puppeteer. I will probably try a Python script in the meantime.
Todo
Write a script for this in Python Research how Cloudflare protects against DDoS/Web scraping attempts Write a more detailed account on my blog