The website processes the domains submitted to its checker and may retain a one-way IP hash, domain, response status, and summary results for diagnostics and abuse prevention. Optional analytics or advertising operate only when configured.
Last updated: July 15, 2026
This Privacy Policy explains how the website handles information when you browse the public site, use the robots.txt generator or checker, or contact the site operator. The operator should update this notice when the production domain, contact details, hosting, analytics, advertising, or retention practices change.
When you submit a domain, the service normalises the host and requests its public /robots.txt file. The checker processes the returned status, rules, sitemaps, and analysis needed to display the result. A technical log may store the submitted domain, the HTTP status code, a summary of the analysis, and a one-way hash derived from the requesting IP address and the application key.
The hash is used to support diagnostics and abuse prevention without intentionally storing the raw IP address in the checker log. Domain names and summary results can still be operational data and may relate to a person in some circumstances.
The generator processes the website URL, crawler choices, paths, sitemap setting, and other options you submit in order to produce robots.txt text. Do not enter passwords, API keys, private URLs, personal data, or confidential configuration into public tools.
The hosting platform and web server may process standard request information such as IP address, date and time, requested URL, referrer, browser or User-Agent string, response status, and security events. This data is used for delivery, troubleshooting, availability, fraud prevention, and protection of the service.
The site may use essential cookies required for sessions, security, or administrator authentication. Analytics and advertising integrations are optional configuration features. When enabled, third-party providers may process device, cookie, request, and interaction data according to their own terms and privacy notices. The Cookie Policy should describe the active categories and available choices.
If you contact the operator, the message may include your email address, name, message content, attachments, and technical context you choose to provide. This information is used to review and respond to the request, maintain records, prevent abuse, and protect legal rights.
Checker logs remain in the application database until they are manually purged or otherwise removed by the operator. The administration interface supports deletion of records older than a selected number of days, but this public policy does not promise a fixed automatic retention period. Contact records, security logs, and hosting backups may be retained for different periods according to operational need and applicable requirements.
Information may be processed by hosting, infrastructure, security, email, analytics, advertising, or other service providers used to operate the site. Information may also be disclosed when reasonably necessary to comply with applicable law, protect rights or security, investigate misuse, or complete a legitimate transfer of the service.
You can avoid submitting a domain to the checker and can limit optional cookies where a consent control is available. Depending on applicable law, you may have rights to request access, correction, deletion, restriction, objection, or a copy of certain personal data, and to complain to an appropriate supervisory authority. Use the Contact page to make a request. The operator may need enough information to verify the request and locate the relevant records.
The service is intended as a technical resource and is not directed specifically to children. This policy may be updated when the service, production domain, providers, or legal requirements change. The updated date at the top identifies the current published version.
The site provides a permanent privacy center in the footer. Optional analytics and advertising are denied by default, can be accepted or rejected separately, and can be withdrawn later without losing access to public content.
The site also honors Global Privacy Control for advertising-related sale, sharing, and cross-context behavioral advertising. The preference cookie stores the policy version, selected categories, and time of the choice; it does not contain a name, email address, or advertising identifier.
It may store the submitted domain, response status, a summary of the analysis, and a one-way hash derived from the requester’s IP address and the application key.
The fetched file is processed to display the requested analysis. The application’s checker log stores summary data rather than publishing the full third-party file as site content.
No. They are optional configuration features. When enabled, the policy and Cookie Policy should identify the active providers and relevant choices.
The current application allows the operator to purge older records manually but does not enforce a fixed automatic public retention period.
Use the active contact method published by the site operator, identify the request, and provide only the information reasonably necessary to locate and verify the relevant record.
Use the email below for technical questions, corrections, crawler documentation updates or problems with the site.
Cookie PolicyThe website uses essential session and security cookies for core operation. Analytics or advertising cookies are used only if the corresponding services are enabled.
Terms of UseThe website provides technical information and tools on an as-available basis. You are responsible for reviewing generated rules, protecting private content with real access controls, and using the service lawfully without abuse.
About this websiteThe website is an independent technical resource that helps site owners understand crawler purposes, generate selective robots.txt rules, test live files, and avoid confusing crawler policy with real access security.
