Website crawler
By : otgoohsum Published on Sunday, May 08, 2016,03:47:56 in Mobile
Our Website crawler can import websites to crawl. It will get page url, page texts, page size, page domain, initial page url, page title. There is no need to download html files and images. Our crawler stored by text. All crawled data will be stored to output folder and saved sql file. Example: yahoo.com.sql First time launching crawler then it is required password. But don’t worry it is already written in crypt.txt The crawler is - Windows based crawler/scraper - Multithreaded - Optimized for performance. - Depth and scope of the crawl. - It is fast. Because written by C# - Including source file
