Properties
| Name | Type | Description |
|---|---|---|
| site_url | string | Site origin used to absolutize sitemap_path into the Sitemap: line. |
| sitemap_path | string | Path (or absolute URL) advertised in the Sitemap: line. |
| allow_ai | boolean | True (the GEO default) explicitly welcomes AI crawlers (GPTBot, ClaudeBot, PerplexityBot, ...); false emits an explicit Disallow for each instead. |
| disallow_paths | array | Paths blocked in every crawler group; include "/" to block the whole site. |
| source | string |
JSON Schema
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"$id": "https://artifacts.apis.io/majr-app/json-schema/majr-app-robots-request-schema.json",
"title": "RobotsRequest",
"x-generated": "2026-10-29",
"x-method": "derived",
"x-generator": "derive-json-schema.py",
"x-source": "openapi/seo-openapi.json#/components/schemas/RobotsRequest",
"properties": {
"site_url": {
"type": "string",
"title": "Site Url",
"description": "Site origin used to absolutize sitemap_path into the Sitemap: line.",
"default": ""
},
"sitemap_path": {
"type": "string",
"title": "Sitemap Path",
"description": "Path (or absolute URL) advertised in the Sitemap: line.",
"default": "/sitemap.xml"
},
"allow_ai": {
"type": "boolean",
"title": "Allow Ai",
"description": "True (the GEO default) explicitly welcomes AI crawlers (GPTBot, ClaudeBot, PerplexityBot, ...); false emits an explicit Disallow for each instead.",
"default": true
},
"disallow_paths": {
"items": {
"type": "string"
},
"type": "array",
"title": "Disallow Paths",
"description": "Paths blocked in every crawler group; include \"/\" to block the whole site."
},
"source": {
"type": "string",
"title": "Source",
"default": ""
}
},
"type": "object"
}
Work with this as data
Every JSON Schema here is available over the APIs.io API and to AI agents over MCP.
MCP server
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
Tools for schemas
4 MCP tools reach this
find_json_schemasBrowse and filter every JSON Schema in the catalog.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.
Call it yourself
curl for this page
This JSON Schema
curl "https://apis.io/api/v1/json-schemas/majr-app-robots-request"
All schemas
curl "https://apis.io/api/v1/json-schemas?limit=25"
Discovery needs no key. Ratings and market analysis are Pro.
Get an API key
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.