💻 Epigrams on Web Scraping

1. Never climb the tree when you can shoot down it's apples
2. Web scraping is a cat and mouse game
3. A status sidecar is the only reasonable way to monitor continued effectiveness
4. Regex will never parse all of html
5. Regex will always parse a subset of html
6. In web scraping, all invariance is ephemeral. Embrace it
7. Don't build too high on fragile grounds
8. Talking over the network, algorithmic speed becomes irrelevant
9. Web scraping is the combination of web requests and html data extraction
10. Web drivers are a sign of weakness, spiders are a sign of strength