(This course describes how to write a target crawler. First, explain the basic principle of the crawler, and write a simple crawler using Python's requests module and regular expression. Next, use the scrapy open source crawler framework and redis database to improve the crawling efficiency. Finally, I will explain the crawling of dynamically loaded web content and some processing methods of anti crawling mechanism.)
收藏
