Follow along with the video below to see how to install our site as a web app on your home screen.
Note: This feature may not be available in some browsers.
Normal
Once I finish my rewrite there should be no missing buckets, but I need to rewrite part of my scraping engine to even make this manageable. (the core issue is Cloudflare's 1000 subrequest limit per request. There are ways around this but it requires me to rethink my current approach).I'm toying with the idea of a highly optimized algorithm that knows there should be 8 buckets and only scrapes until the 8 buckets are known, but this might leave out extreme coach buckets since the number of coach buckets seems to be unknown.
Once I finish my rewrite there should be no missing buckets, but I need to rewrite part of my scraping engine to even make this manageable. (the core issue is Cloudflare's 1000 subrequest limit per request. There are ways around this but it requires me to rethink my current approach).
I'm toying with the idea of a highly optimized algorithm that knows there should be 8 buckets and only scrapes until the 8 buckets are known, but this might leave out extreme coach buckets since the number of coach buckets seems to be unknown.
