![]() Outputs: 01:49:13 INFO: Scrapy 2.2.0 started (bot: example) ExampleĪlso you can directly run with Docker: docker run germey/gerapy-pyppeteer-example ![]() Proxy and proxy_credential will override the settings GERAPY_PYPPETEER_PROXY and GERAPY_PYPPETEER_PROXY_CREDENTIAL. Then you can get the actions result from ta, result is 1.Īlso you can define proxy and proxy_credential for each Reqest, for example: yield PyppeteerRequest( Return 1 yield PyppeteerRequest(url, callback=self.parse, actions=execute_actions) You can use PyppeteerRequest to specify a request which uses pyppeteer to render.įor example: yield PyppeteerRequest(detail_url, callback=self.parse_detail)Īnd you also need to enable PyppeteerMiddleware in DOWNLOADER_MIDDLEWARES: DOWNLOADER_MIDDLEWARES = ') Installation pip3 install gerapy-pyppeteer ![]() This is a package for supporting pyppeteer in Scrapy, also this
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |