HydrantBot

Hydrant is a company data API. Given a company's website, it returns what public sources say about the company: its name, headquarters, industry, size, founding year, LinkedIn page and logo, each with the source it came from.

What we fetch

• Company websites. We read a company's homepage and the few pages that say who it is (about, contact, imprint, history), and the logo and icon its homepage shows. We fetch them as a browser would, with a browser's User-Agent, a second or more apart, a handful of pages at a time and rarely more than once a month. We read robots.txt for its sitemaps and its Crawl-delay.
• Public registers and open data, such as Wikidata, GLEIF, UK Companies House, SEC EDGAR and the national registers of France, Norway, Czechia and Finland. We ask through their APIs, as HydrantBot/1.0 (+https://hydrantapi.com/bot; [email protected]), within their rate limits.
• Search results. We search Google, through a search API, for a company's LinkedIn page and its founding year. We never request LinkedIn's pages ourselves.

From a website we keep the facts its pages state, with a short quote from the page as evidence, and a copy of each page so that the facts can be checked. We don't republish your pages.

How to stop us fetching your site

Email [email protected] from an address at your domain, or tell us how else to confirm the site is yours, and name the domain. We'll add it to our opt-out list, usually within two working days. From then on we don't fetch pages, images or redirects on the domain or its subdomains. Two things can still reach it: if another site redirects our crawler to yours, its browser loads that one page before it sees where it landed (we drop it), and another site's page we read may load images or scripts from yours, as any visitor's browser would. What we read before is kept unless you ask us to remove it too.

To have what we hold about your company corrected or removed, or to ask what we hold about you as a person, write to the same address.