This is one of the most popular services that I see posted on software job forums to date
Everybody wants to know what their competition is doing so they commission a website scraper
But the problem I see is that most are looking for just a script to run on a daily basis, and the script is not capable of storing the data in a usable format.
This is too bad because people that make these purchases have no clue how it works, and end up buying a complex script that is difficult to run and observe.
I've solved that problem by creating a scraper in a Windows Application that can write the data to a database and then create reports and Excel Spreadsheets for further analysis.
The center screen is a browser, so you can see the page scraps in action, changing pages and websites.
It's really cool to watch the action because it's really fast in operation.
This program collected all the artwork and built the menus on the left, and downloaded product pictures.
The Excel spreadsheets even include the product pictures embedded in the file.