Amazon Kinesis Data Firehose website screenshot

Amazon Kinesis Data Firehose

Amazon Kinesis Data Firehose is the easiest way to reliably load streaming data into data lakes, data stores, and analytics services. It can capture, transform, and deliver streaming data to Amazon S3, Amazon Redshift, Amazon OpenSearch Service, Splunk, and any custom HTTP endpoint. It is a fully managed service that automatically scales to match the throughput of your data and requires no ongoing administration.

1 APIs 5 Features
AnalyticsData DeliveryStreaming

APIs

Amazon Kinesis Data Firehose API

The Amazon Kinesis Data Firehose API provides the easiest way to reliably load streaming data into data lakes, data stores, and analytics services. The API allows you to create ...

Collections

Amazon Kinesis Data Firehose API

OPEN

Pricing Plans

Amazon Kinesis Firehose Plans Pricing

3 plans

PLANS

Rate Limits

Amazon Kinesis Firehose Rate Limits

5 limits

RATE LIMITS

FinOps

Amazon Kinesis Firehose Finops

FINOPS

Features

Zero Administration

Fully managed service that automatically scales to match data throughput with no ongoing administration.

Data Transformation

Transform streaming data using AWS Lambda before delivering to destinations.

Multiple Destinations

Deliver data to Amazon S3, Redshift, OpenSearch Service, Splunk, Datadog, and custom HTTP endpoints.

Format Conversion

Automatically convert data formats such as JSON to Apache Parquet or Apache ORC before storing in S3.

Data Compression

Compress data using GZIP, ZIP, or Snappy before delivering to S3 to reduce storage costs.

Use Cases

Log Analytics

Stream application and infrastructure logs to Amazon OpenSearch Service for real-time analysis.

Clickstream Analytics

Capture website clickstream data and deliver to data lakes for behavioral analysis.

IoT Data Ingestion

Ingest IoT device telemetry into S3 or Redshift for analytics and reporting.

Security Analytics

Stream security events and logs to SIEM systems like Splunk for threat detection.

Integrations

Amazon S3

Deliver streaming data to S3 buckets as the primary data lake destination.

Amazon Redshift

Load streaming data into Redshift data warehouse for SQL analytics.

Amazon OpenSearch Service

Index streaming data in OpenSearch for real-time search and visualization.

AWS Lambda

Transform and enrich streaming data using Lambda functions before delivery.

Splunk

Send streaming data to Splunk for security and operational analytics.

Semantic Vocabularies

Amazon Kinesis Firehose Context

1 classes · 7 properties

JSON-LD

API Governance Rules

Amazon Kinesis Data Firehose API Rules

16 rules · 9 errors 7 warnings

SPECTRAL

JSON Structure

Amazon Kinesis Firehose Delivery Stream Structure

6 properties

JSON STRUCTURE

Example Payloads

Amazon Kinesis Firehose Delivery Stream Example

6 fields

EXAMPLE

Resources

🌐
Portal
Portal
🌐
Portal
Portal
🔗
Documentation
Documentation
📜
TermsOfService
TermsOfService
📜
PrivacyPolicy
PrivacyPolicy
💬
Support
Support
👥
GitHubOrganization
GitHubOrganization
🌐
Console
Console
📝
Signup
Signup
🔗
Login
Login
🟢
StatusPage
StatusPage
🔗
Contact
Contact
🔗
SpectralRules
SpectralRules
🔗
Vocabulary
Vocabulary

Sources

Raw ↑ 
opencollection: 1.0.0
info:
  name: Amazon Kinesis Data Firehose API
  version: '2024-01-01'
request:
  auth:
    type: apikey
    key: Authorization
    value: '{{Authorization}}'
    placement: header
items:
- info:
    name: Delivery Streams
    type: folder
  items:
  - info:
      name: Amazon Kinesis Data Firehose List Delivery Streams
      type: http
    http:
      method: GET
      url: https://firehose.us-east-1.amazonaws.com/delivery-streams
    docs: Lists your delivery streams in alphabetical order of their names.
  - info:
      name: Amazon Kinesis Data Firehose Create Delivery Stream
      type: http
    http:
      method: POST
      url: https://firehose.us-east-1.amazonaws.com/delivery-streams
    docs: Creates a Kinesis Data Firehose delivery stream.
  - info:
      name: Amazon Kinesis Data Firehose Describe Delivery Stream
      type: http
    http:
      method: GET
      url: https://firehose.us-east-1.amazonaws.com/delivery-streams/:DeliveryStreamName
      params:
      - name: DeliveryStreamName
        value: ''
        type: path
        description: The name of the delivery stream.
    docs: Describes the specified delivery stream.
  - info:
      name: Amazon Kinesis Data Firehose Delete Delivery Stream
      type: http
    http:
      method: DELETE
      url: https://firehose.us-east-1.amazonaws.com/delivery-streams/:DeliveryStreamName
      params:
      - name: DeliveryStreamName
        value: ''
        type: path
        description: The name of the delivery stream.
    docs: Deletes a delivery stream and its data.
  - info:
      name: Amazon Kinesis Data Firehose Update Destination
      type: http
    http:
      method: PUT
      url: https://firehose.us-east-1.amazonaws.com/delivery-streams/:DeliveryStreamName/destination
      params:
      - name: DeliveryStreamName
        value: ''
        type: path
        description: The name of the delivery stream.
    docs: Updates the specified destination of the specified delivery stream.
  - info:
      name: Amazon Kinesis Data Firehose Put Record
      type: http
    http:
      method: POST
      url: https://firehose.us-east-1.amazonaws.com/delivery-streams/:DeliveryStreamName/records
      params:
      - name: DeliveryStreamName
        value: ''
        type: path
        description: The name of the delivery stream.
    docs: Writes a single data record into an Amazon Kinesis Data Firehose delivery stream.
  - info:
      name: Amazon Kinesis Data Firehose Put Record Batch
      type: http
    http:
      method: POST
      url: https://firehose.us-east-1.amazonaws.com/delivery-streams/:DeliveryStreamName/records/batch
      params:
      - name: DeliveryStreamName
        value: ''
        type: path
        description: The name of the delivery stream.
    docs: Writes multiple data records into a delivery stream in a single call.
bundled: true