If you saw DeskDaddyBot/1.0 (+https://deskdaddy.in/bot) in your logs, that is us. Desk Daddy compares coworking spaces, managed offices and meeting rooms across India. DeskDaddyBot reads the public centre pages on workspace operators' own websites so that the address, location, amenities, plans and published prices we show stay up to date.
What it collects
Facts about each centre: name, address, map coordinates, city and locality, amenities, plans offered, prices the page publishes, opening hours and the page URL. It may record the URL of a photo together with the page it appeared on, as a link; it never downloads or re-hosts images. It does not collect personal data, does not log in, fill in forms or open gated or paid content.
How it behaves
- Obeys
robots.txton every run, includingDisallow,AllowandCrawl-delay, forUser-agent: DeskDaddyBotand*. - One request at a time per website, at least 4 seconds apart (longer if your
Crawl-delayasks for it), and at most 150 pages per site per run. - Redirects are followed only within the same website, and only to addresses its
robots.txtallows. - A page whose details only appear after JavaScript runs may be opened in a headless browser. That counts as one page visit in the 4-second spacing; it loads only the page, its scripts and its data requests from the same website that
robots.txtallows (no images, fonts, stylesheets, trackers or third-party calls), at most 30 requests per page, spaced out. - Runs about every 4 hours and uses conditional requests (
If-None-Match/If-Modified-Since), so unchanged pages cost you a 304. - Stops immediately on 403, 429 or a CAPTCHA page and backs off for longer each time. No proxies, no rotating addresses, no attempts to get around blocks.
Opting out
Add this to your robots.txt and DeskDaddyBot will stop on its next run:
User-agent: DeskDaddyBot
Disallow: /Or email support@deskdaddy.in and we will stop crawling your site and remove its data. Operators can also send us their listings directly instead — see List your space.