How to use proxies with ParseHub

Which proxy works best with ParseHub?

For most scraping, Residential Lite is the cheapest way to get home IP addresses in the right country. Use Residential when you need a particular state or city, and Unlimited Datacenter for targets in the United States that do not block data centre addresses.

• Residentialfrom $3.52 per GB
• Residential Litefrom $0.96 per GB
• Unlimited Datacenterfrom $0.56 per hour

Proxy settings for ParseHub: host, port and login

A BooProxies plan gives you four things: a host, a port, a username and a password. These are the values for Residential; the username and password are on your plan page.

As one line:

resi.proxies.boo:8080:USERNAME:PASSWORD

The country and the session are chosen in the username, not in a separate setting. The generator on your plan page writes the username for you, and Targeting and sessions explains each part.

ParseHub proxy setup, step by step

1. Ask ParseHub support to enable custom proxies on your account. The option is not there until they do.
2. Open the project's Settings and tick Rotate IP Addresses. A box for custom proxies appears.
3. Add your proxy as resi.proxies.boo:8080:USERNAME:PASSWORD. Several proxies go on separate lines.

Menu names can differ a little between versions of ParseHub. The four values to enter are always the same.

Rotating or sticky sessions for ParseHub?

For crawling many pages with ParseHub, leave the username without a session so every request leaves from a new IP address. For anything with steps that belong together, such as a login, a cart or a paginated search that sets cookies, add a session to the username so those requests share one address.

A sticky username looks like this:

USERNAME-country-us-time-600-session-a1b2c3d4

ParseHub proxy not working?

• ParseHub advises fixed proxies and says that not every provider's gateway works with it. Test with a small project before relying on it.
• Use a sticky username on each line, so a run keeps one IP address per line.
• A 407 error means the username or password was not accepted. Copy both again from your plan page, and check that nothing added a space or cut the username short.
• If the IP address is in the wrong country, look at the username: the country code is part of it. More fixes.

Questions about ParseHub and proxies

Terms explained: web scraping, rotating proxy, sticky session, rate limiting, headless browser.

ParseHub is a product of its own makers. BooProxies is not affiliated with it; the name is used here only to say what this guide is about. Use it within the rules of the sites you work with and our acceptable use policy.