Website crawler

Website crawler Created by otgoohsum. This templates have specific characteristics, namely: Our Website crawler can import websites to crawl. It will get page url, page texts, page size, page domain, initial page url, page title. There is no need to download html files and images. Our crawler stored by text. .

You can use this Website crawler on Apps category for crawl, crawler, data, database, html, scrape, scraper, sql, web crawler, web scraper and another uses.

Website crawler
© Copyright by otgoohsum

Features:

  • None: None
  • No: No
  • Windows vista, windows 7, windows 8 desktop, windows 8 metro: Windows Vista, Windows 7, Windows 8 Desktop, Windows 8 Metro
  • .net 4: .NET 4

Our Website crawler can import websites to crawl. It will get page url, page texts, page size, page domain, initial page url, page title. There is no need to download html files and images. Our crawler stored by text.

All crawled data will be stored to output folder and saved sql file. Example: yahoo.com.sql

First time launching crawler then it is required password. But don’t worry it is already written in crypt.txt

The crawler is – Windows based crawler/scraper- Multithreaded- Optimized for performance. – Depth and scope of the crawl.- It is fast. Because written by C#- Including source file