HighlandBot

HighlandBot is an automated crawler operated by Highland, a health communications consultancy. It reads publicly published health and life sciences news to help our team understand which journalists cover which topics.

It reads RSS and Atom feeds, sitemaps, and article bylines and publication dates. It does not store full article text.

HighlandBot obeys robots.txt, including rules aimed at every crawler, not only ones naming it by name. If a site returns a blocking response, HighlandBot stops visiting it, and a person decides whether to follow up.

HighlandBot visits participating sites once nightly, one request at a time per site, with a pause between requests.

Questions or requests: info@highland.health