HWQ HWQ - 10 months ago 45
AngularJS Question

check a set of URLs if it contains a particular table ID

I have a set of URL links , some which contains table and some that does not return any table. I've inspected the source and there is this particular table ID that loads at runtime. Is there a script or tool to check each url content and see if it contains that particular table ID and return true.

I can use this script or tool to load a batch of URL's to see which url contains the table that I am looking for.


Answer Source

This is web scraping. Many languages have a way to do this. Pick your most comfortable, however, python w/ the beautiful soup library is a nice choice.