1. Home
  2. DeskDaddyBot

DeskDaddyBot

The crawler that keeps workspace listings on Desk Daddy current.

If you saw DeskDaddyBot/1.0 (+https://deskdaddy.in/bot) in your logs, that is us. Desk Daddy compares coworking spaces, managed offices and meeting rooms across India. DeskDaddyBot reads the public centre pages on workspace operators' own websites so that the address, location, amenities, plans and published prices we show stay up to date.

What it collects

Facts about each centre: name, address, map coordinates, city and locality, amenities, plans offered, prices the page publishes, opening hours and the page URL. It may record the URL of a photo together with the page it appeared on, as a link; it never downloads or re-hosts images. It does not collect personal data, does not log in, fill in forms or open gated or paid content.

How it behaves

  • Obeys robots.txt on every run, including Disallow, Allow and Crawl-delay, for User-agent: DeskDaddyBot and *.
  • One request at a time per website, at least 4 seconds apart (longer if your Crawl-delay asks for it), and at most 150 pages per site per run.
  • Redirects are followed only within the same website, and only to addresses its robots.txt allows.
  • A page whose details only appear after JavaScript runs may be opened in a headless browser. That counts as one page visit in the 4-second spacing; it loads only the page, its scripts and its data requests from the same website that robots.txt allows (no images, fonts, stylesheets, trackers or third-party calls), at most 30 requests per page, spaced out.
  • Runs about every 4 hours and uses conditional requests (If-None-Match / If-Modified-Since), so unchanged pages cost you a 304.
  • Stops immediately on 403, 429 or a CAPTCHA page and backs off for longer each time. No proxies, no rotating addresses, no attempts to get around blocks.

Opting out

Add this to your robots.txt and DeskDaddyBot will stop on its next run:

User-agent: DeskDaddyBot
Disallow: /

Or email support@deskdaddy.in and we will stop crawling your site and remove its data. Operators can also send us their listings directly instead — see List your space.

Compare

Get a visit slot. We’ll call you to set it up.

No obligation — just exploring is fine.

Free to visit. No spam, no sharing your number with operators until you say so.