实现一个并发版爬虫程序
- 采用广度优先算法
- 需要实现一个engine
- 需要实现一个scheduler
- 需要实现一个worker，包含parser和fetcher
-
Notifications
You must be signed in to change notification settings - Fork 0
实现一个并发版爬虫
License
luckygopher/go-spider
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
实现一个并发版爬虫
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published