发布时间:2022-08-09 文章分类:编程知识 投稿人:王小丽 字号: 默认 | | 超大 打印

Orchid 1.1

Generic Multi Threaded Web Crawler

Orchid is a python crawler I developed for one of my graduate courses. It is a
generic multi-threaded web crawler complete with documentation. We used this
crawler to locate web pages which contained malicious code. However, the logic
of what to do with the crawled pages is implemented in a separate class and
therefore Orchid can easily be used for any application which requires crawling
the web.