[HN Gopher] Webscraping Proxy Library for Scrapy
___________________________________________________________________
Webscraping Proxy Library for Scrapy
Author : squatrito23
Score : 19 points
Date : 2022-05-30 17:33 UTC (5 hours ago)
(HTM) web link (github.com)
(TXT) w3m dump (github.com)
| adanto6840 wrote:
| Not free & no personal association with them, just a former happy
| customer -- https://proxymesh.com/ -- paid/hosted "rotating"
| proxies with additional features available like session-pinning,
| location selection, etc. I haven't used it in years now but it
| was a great service back then; it looks like it has probably only
| improved since then, and the owner/developer was helpful and
| great to work with as well.
| alexott wrote:
| You may also look to this project: https://github.com/nfx/slrp -
| rotating open proxy multiplexer
| squatrito23 wrote:
| Python library for dealing with proxies in your Scrapy project
| thatwasunusual wrote:
| Wow. Doesn't even bother to link to Scrapy itself.
___________________________________________________________________
(page generated 2022-05-30 23:01 UTC)