My question is, does anyone in similar situation as I am now and have successfully solved these types of "challenges"? Does anyone know of a certain book or article regarding web crawling? Those that pertains to these advanced type of websites?
I found an article which tackles deep web and its very interesting and I think this answers my questions above.
Gotta love this.