Batch web scraping for competitor analysis, price monitoring and market research