[HN Gopher] Show HN: Hyperbrowser - Scalable Browser Infrastruct...
___________________________________________________________________
Show HN: Hyperbrowser - Scalable Browser Infrastructure for AI Apps
Hey HN! Excited to share a project we've been working on called
Hyperbrowser. It's a tool that makes scaling headless browsers
ridiculously easy. It allows you to spin up hundreds of browser
sessions in secure, isolated environments, with sub-second launch
times. We automatically solve captchas, use residential proxies and
manage concurrent sessions so that you can focus on your own
business. The idea for Hyperbrowser came from our own struggles
building AI apps and agents like sales tools, automations, and AI
editors. Every project seemed to hit the same roadblock:
interacting with the web. Whether we needed web data as input or
web browsing as output, we faced constant challenges--getting
blocked, setting up proxy services, solving captchas, and scaling
everything in Kubernetes. On top of that, we had to build custom
functions and services to convert websites into LLM-friendly
markdown and crawl entire sites for relevant data. Keeping all of
this running became a full-time job! To make this easy for
everyone else we built Hyperbrowser. It packages everything we
learned and built, with a nice frontend that gets rid of the
boilerplate and lets you hit the ground running. Hyperbrowser works
seamlessly with tools you already know, like Puppeteer, Playwright,
or Selenium, while removing the hassle of infrastructure and
scaling. If this sounds interesting, we'd love for you to give it
a spin! You can sign up and start playing around with a free plan.
Would love to hear your thoughts, feedback, or ideas! Check it out
here at hyperbrowser.ai. If you have any questions at all feel
free to reach out to me at akshay@hyperbrowser.ai! Ideally share
the website you'd like to scrape or automate. I can provide a
script for it or we can create a custom API endpoint!
Author : ashekhawat
Score : 13 points
Date : 2024-12-10 21:24 UTC (1 hours ago)
(HTM) web link (www.hyperbrowser.ai)
(TXT) w3m dump (www.hyperbrowser.ai)
| Dingway98 wrote:
| Seems pretty cool for getting some data off web pages. How many
| browsers can I open concurrently with hyperbrowser?
| ashekhawat wrote:
| Hey, 100 max on our paid plan but I can enable 1k concurrently
| if you want!
| skilbjo wrote:
| Sweet! trying this out now.
|
| one quick nit on your docs:
| https://docs.hyperbrowser.ai/guides/scrape-site
|
| ```
|
| import Hyperbrowser from "@hyperbrowser/sdk";
|
| const client = new Hyperbrowser({ apiKey:
| process.env.HYPERBROWSER_API_KEY, });
|
| (async () => { const job = await
| client.startScrapeJob({ url: "https://example.com" });
| console.log(job); const job = await
| client.getScrapeJob(job.jobId); console.log(job);
|
| })(); ```
|
| should be:
|
| ```
|
| import Hyperbrowser from "@hyperbrowser/sdk";
|
| const client = new Hyperbrowser({ apiKey:
| process.env.HYPERBROWSER_API_KEY, });
|
| (async () => { let job = await
| client.startScrapeJob({ url: "https://example.com" }); //
| s/const/let console.log(job); job = await
| client.getScrapeJob(job.jobId); // remove const
| console.log(job);
|
| })();
|
| ```
| shrisukhani wrote:
| thanks! fixing now
| shrisukhani wrote:
| update: fixed now :)
| dbmikus wrote:
| Just did a pricing check, and you give twice as much
| concurrency/browsing/data-transfer as Browserbase. Nice!
|
| Do you have any restrictions on sites we can scrape? I am likely
| going to do some public LinkedIn scraping (logged out, legally
| compliant).
| ashekhawat wrote:
| Hey! So we have to use a different proxy service for some sites
| (LinkedIn included). Just ask in the app support and we can do
| that. We are also making custom endpoints for LinkedIn as well
| that should be ready soon, Ill shoot you an email once we have
| that!
| ATechGuy wrote:
| Congrats on launching!
|
| > spin up hundreds of browser sessions in secure, isolated
| environments, with sub-second launch times
|
| What tech do you use for this, and where is this hosted?
| ashekhawat wrote:
| Just docker containers in GCP and AWS. We do all the instance
| management ourselves. It seems like you are working on infra
| for this from your bio! Send me an email would love to chat :)
___________________________________________________________________
(page generated 2024-12-10 23:00 UTC)