Hey everyone,
My University (and all universities in the state actually) recently implemented the same content blocking system the UK uses, by joining the IWF (https://www.iwf.org.uk/). They’ve had a nasty reputation of blocking legitimate sites (even wikipedia for a short time!) and appear to have little to no accountability with the sites they block. I’m trying to build a case to bring to the University and State to help push back against this move, but I would like to have some more hard data.
Does anyone know of a bash script or program that will parse through, say, the top 10,000 Alexa sites and check if they’re blocked? Just a simple ping may not be enough, you would need to check the page size versus the page they give you when they block it (since it sounds like they will redirect us to a page saying the site is blocked.) I’m a CompSci/Math/EE major, so if it needs modifications for this capability I can do that. If it doesn’t exist, I’ll probably write something to make it exist.
Thanks in advance!!