There is a directory that is being served over the net which I'm interested in monitoring. Its contents are various versions of software that I'm using and I'd like to write a script that I could run which checks what's there, and downloads anything that is newer that what I've already got.
Is there a way, say with
I just figured out a way to do it:
wget --spider -r --no-parent http://some.served.dir.ca/
It's quite verbose, so you need to pipe through
grep a couple of times depending on what you're after, but the information is all there. It looks like it prints to stderr, so append
2>&1 to let
grep at it. I grepped for "\.tar\.gz" to find all of the tarballs the site had to offer.