api-ninjas-com

api-ninjas-com Web Scraper API

The Web Scraper API provides web scraper services to retrieve HTML and plaintext data from any website URL.

Documentation GitHub OpenAPI

Operations 1

GET /v1/webscraper Scrape data from a specified URL #

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this

find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/api-ninjas-com:api-ninjas-com-web-scraper-api"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

openapi: 3.2.0
info:
  title: Ninjas Web Scraper API
  description: 'Combined OpenAPI specification for every API Ninjas endpoint. Requests go to https://api.api-ninjas.com with an `X-Api-Key` header; get a free key at https://api-ninjas.com/register. Human-readable docs: https://api-ninjas.com/api. Index for LLMs: https://api-ninjas.com/llms.txt.'
  version: 1.0.0
  contact:
    name: API Ninjas
    url: https://api-ninjas.com
  license:
    name: Proprietary
servers:
- url: https://api.api-ninjas.com
  description: API Ninjas Production
security:
- ApiKeyAuth: []
tags:
- name: Web Scraper
  description: The Web Scraper API provides web scraper services to retrieve HTML and plaintext data from any website URL.
paths:
  /v1/webscraper:
    get:
      summary: Scrape data from a specified URL
      description: Fetches a `url` and returns its contents, with `text_only` to strip markup. For the page title and metadata alone use /webpage.
      operationId: scrapeData
      security:
      - ApiKeyAuth: []
      parameters:
      - $ref: '#/components/parameters/url'
      - $ref: '#/components/parameters/text_only'
      - $ref: '#/components/parameters/user_agent'
      responses:
        '200':
          description: Successful response
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/WebScraperResponse'
        '400':
          description: Bad Request
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/WebScraperOpenapi_ErrorResponse'
        '401':
          description: Unauthorized
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/WebScraperOpenapi_ErrorResponse'
        '500':
          description: Internal Server Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/WebScraperOpenapi_ErrorResponse'
      tags:
      - Web Scraper
components:
  schemas:
    WebScraperResponse:
      type: object
      properties:
        data:
          type: string
          description: The HTML or plaintext data scraped from the URL.
    WebScraperOpenapi_ErrorResponse:
      type: object
      properties:
        message:
          type: string
          description: Error message describing the failure.
  parameters:
    url:
      in: query
      name: url
      description: URL to scrape.
      required: true
      schema:
        type: string
        format: uri
    text_only:
      in: query
      name: text_only
      description: Whether to only extract visible text (ignores HTML tags and metadata).
      required: false
      schema:
        type: boolean
        default: false
    user_agent:
      in: query
      name: user_agent
      description: User-Agent string to use in the request header.
      required: false
      schema:
        type: string
  securitySchemes:
    ApiKeyAuth:
      type: apiKey
      in: header
      name: X-Api-Key
externalDocs:
  description: API Ninjas documentation
  url: https://api-ninjas.com/api