NyckelBot
NyckelBot is the crawler behind Nyckel, a property-search workbench for Stockholm. It reads public listing pages on real-estate broker websites so home buyers can search every home for sale in one place. Every listing links back to the broker's own page.
How it behaves
- Identifies itself as
NyckelBot/<version> (+https://nyckel.site/bot; jim@instabox.se). - Reads and honours
robots.txt; disallowed paths are never fetched. - At most one request per second per site, on a single connection.
- Uses conditional requests so unchanged pages are not downloaded again.
- Stops for six hours on any 403, 429 or block page, and alerts us.
- Only public listing pages: no logins, no forms, no personal data beyond what the listing shows.
To opt out
Add User-agent: NyckelBot followed by Disallow: / to your robots.txt. We re-read it before every crawl and stop on the next pass. You can also email jim@instabox.se and we will stop within one business day.