ragfeed-de · Schema

BatchScrapeRequest

Web ScrapingAPIAI DataEU HostingComplianceSaaS

Properties

Name Type Description
formats array
onlyMainContent boolean
onlyCleanContent boolean
includeTags object
excludeTags object
maxAge object
minAge object
headers object
waitFor integer
mobile boolean
skipTlsVerification boolean
timeout object
parsers object
actions object
location object
removeBase64Images boolean
blockAds boolean
proxy object
storeInCache boolean
lockdown boolean
redactPII object
zeroDataRetention boolean
urls array
webhook object
maxConcurrency object
ignoreInvalidURLs boolean
View JSON Schema on GitHub

JSON Schema

ragfeed-de-batch-scrape-request-schema.json Raw ↑
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "https://artifacts.apis.io/ragfeed-de/json-schema/ragfeed-de-batch-scrape-request-schema.json",
  "title": "BatchScrapeRequest",
  "x-generated": "2026-10-31",
  "x-method": "derived",
  "x-generator": "derive-json-schema.py",
  "x-source": "openapi/ragfeed-de-openapi.json#/components/schemas/BatchScrapeRequest",
  "properties": {
    "formats": {
      "items": {
        "anyOf": [
          {
            "type": "string"
          },
          {
            "additionalProperties": true,
            "type": "object"
          }
        ]
      },
      "type": "array",
      "title": "Formats"
    },
    "onlyMainContent": {
      "type": "boolean",
      "title": "Onlymaincontent",
      "default": true
    },
    "onlyCleanContent": {
      "type": "boolean",
      "title": "Onlycleancontent",
      "default": false
    },
    "includeTags": {
      "anyOf": [
        {
          "items": {
            "type": "string"
          },
          "type": "array"
        },
        {
          "type": "null"
        }
      ],
      "title": "Includetags"
    },
    "excludeTags": {
      "anyOf": [
        {
          "items": {
            "type": "string"
          },
          "type": "array"
        },
        {
          "type": "null"
        }
      ],
      "title": "Excludetags"
    },
    "maxAge": {
      "anyOf": [
        {
          "type": "integer"
        },
        {
          "type": "null"
        }
      ],
      "title": "Maxage"
    },
    "minAge": {
      "anyOf": [
        {
          "type": "integer"
        },
        {
          "type": "null"
        }
      ],
      "title": "Minage"
    },
    "headers": {
      "anyOf": [
        {
          "additionalProperties": {
            "type": "string"
          },
          "type": "object"
        },
        {
          "type": "null"
        }
      ],
      "title": "Headers"
    },
    "waitFor": {
      "type": "integer",
      "title": "Waitfor",
      "default": 0
    },
    "mobile": {
      "type": "boolean",
      "title": "Mobile",
      "default": false
    },
    "skipTlsVerification": {
      "type": "boolean",
      "title": "Skiptlsverification",
      "default": true
    },
    "timeout": {
      "anyOf": [
        {
          "type": "integer"
        },
        {
          "type": "null"
        }
      ],
      "title": "Timeout"
    },
    "parsers": {
      "anyOf": [
        {
          "items": {
            "anyOf": [
              {
                "type": "string"
              },
              {
                "additionalProperties": true,
                "type": "object"
              }
            ]
          },
          "type": "array"
        },
        {
          "type": "null"
        }
      ],
      "title": "Parsers"
    },
    "actions": {
      "anyOf": [
        {
          "items": {
            "additionalProperties": true,
            "type": "object"
          },
          "type": "array"
        },
        {
          "type": "null"
        }
      ],
      "title": "Actions"
    },
    "location": {
      "anyOf": [
        {
          "$ref": "#/$defs/Location"
        },
        {
          "type": "null"
        }
      ]
    },
    "removeBase64Images": {
      "type": "boolean",
      "title": "Removebase64Images",
      "default": true
    },
    "blockAds": {
      "type": "boolean",
      "title": "Blockads",
      "default": true
    },
    "proxy": {
      "anyOf": [
        {
          "type": "string",
          "enum": [
            "basic",
            "enhanced",
            "auto",
            "stealth"
          ]
        },
        {
          "type": "null"
        }
      ],
      "title": "Proxy",
      "default": "auto"
    },
    "storeInCache": {
      "type": "boolean",
      "title": "Storeincache",
      "default": true
    },
    "lockdown": {
      "type": "boolean",
      "title": "Lockdown",
      "default": false
    },
    "redactPII": {
      "anyOf": [
        {
          "type": "boolean"
        },
        {
          "additionalProperties": true,
          "type": "object"
        }
      ],
      "title": "Redactpii",
      "default": false
    },
    "zeroDataRetention": {
      "type": "boolean",
      "title": "Zerodataretention",
      "default": false
    },
    "urls": {
      "items": {
        "type": "string"
      },
      "type": "array",
      "title": "Urls"
    },
    "webhook": {
      "anyOf": [
        {
          "$ref": "#/$defs/Webhook"
        },
        {
          "type": "string"
        },
        {
          "type": "null"
        }
      ],
      "title": "Webhook"
    },
    "maxConcurrency": {
      "anyOf": [
        {
          "type": "integer"
        },
        {
          "type": "null"
        }
      ],
      "title": "Maxconcurrency"
    },
    "ignoreInvalidURLs": {
      "type": "boolean",
      "title": "Ignoreinvalidurls",
      "default": true
    }
  },
  "additionalProperties": true,
  "type": "object",
  "required": [
    "urls"
  ],
  "$defs": {
    "Location": {
      "properties": {
        "country": {
          "anyOf": [
            {
              "type": "string"
            },
            {
              "type": "null"
            }
          ],
          "title": "Country",
          "default": "US"
        },
        "languages": {
          "anyOf": [
            {
              "items": {
                "type": "string"
              },
              "type": "array"
            },
            {
              "type": "null"
            }
          ],
          "title": "Languages"
        }
      },
      "additionalProperties": true,
      "type": "object",
      "title": "Location"
    },
    "Webhook": {
      "properties": {
        "url": {
          "type": "string",
          "title": "Url"
        },
        "headers": {
          "anyOf": [
            {
              "additionalProperties": {
                "type": "string"
              },
              "type": "object"
            },
            {
              "type": "null"
            }
          ],
          "title": "Headers"
        },
        "metadata": {
          "anyOf": [
            {
              "additionalProperties": true,
              "type": "object"
            },
            {
              "type": "null"
            }
          ],
          "title": "Metadata"
        },
        "events": {
          "anyOf": [
            {
              "items": {
                "type": "string"
              },
              "type": "array"
            },
            {
              "type": "null"
            }
          ],
          "title": "Events"
        }
      },
      "additionalProperties": true,
      "type": "object",
      "required": [
        "url"
      ],
      "title": "Webhook"
    }
  }
}

Work with this as data

Every JSON Schema here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for schemas

4 MCP tools reach this
  • find_json_schemasBrowse and filter every JSON Schema in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This JSON Schema
curl "https://apis.io/api/v1/json-schemas/ragfeed-de-batch-scrape-request"
All schemas
curl "https://apis.io/api/v1/json-schemas?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.