Apache Flume website screenshot

Apache Flume

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log and event data. It provides a simple and flexible architecture based on streaming data flows with pluggable sources, channels, and sinks, plus a REST monitoring API for agent metrics.

Apache Flume publishes 1 API on the APIs.io network: Monitoring API. Tagged areas include Apache, Data Collection, ETL, Log Aggregation, and Open-Source.

The Apache Flume catalog on APIs.io includes 1 JSON-LD context and 2 Spectral governance rulesets.

Apache Flume’s developer surface includes documentation, getting-started guide, and 12 more developer resources.

31.2/100 thin ▬ flat Agent 26/100 agent aware self hosted · Apache-2.0 Full breakdown ↓
scored 2026-09-08 · rubric v0.20.0
AccessFreemium
1 APIs 9 Features 5 Use Cases
ApacheData CollectionETLLog AggregationOpen-SourceStreaming

Kin Score

Kin Score Kin Score How this is scored →
scored 2026-09-08 · rubric v0.20.0
Open Source Surface applies to this provider. This product is open source and we read its repository directly, so Open Source Surface carries 10 points of the composite. It is scored from what the repository actually publishes — a security policy, a contribution guide, a release history, a code of conduct — read live from the provider rather than inferred from our own catalog pointers. This facet adds; nothing was taken away to make room for it. An open-source project is not excused from the commercial facets, because exemption would strip it of the points it does earn. If we have the wrong repository, or this product is not open source, say so on your provider repo and we will drop the facet rather than have you publish against it.
Create-or-Update Ergonomics does not apply to this provider. The published contracts declare no write operations, and a read-only API cannot create-or-update. The facet is excluded from this provider's denominator entirely — not scored zero. A reference or data API is not deficient for being unable to upsert.
The six quality facets above are damped to 90 points between them, because the conditional facet above carries the other 10. That is why each facet's contribution is shown against a damped maximum: raising a quality facet moves the composite by 90% of its nominal weight, not 100%. The full arithmetic is at apis.io/rating/.
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from github.com/api-evangelist/apache-flume: open an issue to ask a question, or submit a pull request to add artifacts. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

APIs 2

Individual APIs this provider publishes, each with its own machine-readable definition.

Apache Flume Java API

Java API for building custom Flume sources, channels, sinks, and interceptors. Provides interfaces for developing pluggable data ingestion components.

Apache Flume Monitoring API

The Monitoring API from Apache Flume — 1 operation(s) for monitoring.

Open Collections 3

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

API Collection

OPEN COLLECTION

Pricing Plans 1

Published pricing tiers and plan structures.

Rate Limits 1

Documented rate limits and quota policies.

Apache Flume Rate Limits

5 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Features 9

Notable capabilities this provider offers.

Pluggable Sources

Extensible source architecture supporting Avro, Thrift, Exec, Taildir, Kafka, HTTP, Syslog, and custom sources.

Durable Channels

Multiple channel implementations including memory, file-backed, and Kafka-backed channels for different durability requirements.

Multi-Destination Sinks

Write events to HDFS, HBase, Solr, Elasticsearch, Kafka, and custom sink destinations.

Fan-In Consolidation

Aggregate events from multiple agent sources into a single destination for centralized log collection.

Fan-Out Distribution

Route events from a single source to multiple channel/sink combinations for parallel processing.

Interceptors

Event transformation interceptors for filtering, enrichment, and routing based on event content.

SSL/TLS Security

TLS encryption support across Avro, Thrift, Kafka, HTTP, and Syslog components.

Monitoring REST API

HTTP monitoring endpoint exposing source, channel, and sink metrics for agent health monitoring.

Multi-Hop Flows

Chain multiple Flume agents via Avro/Thrift RPC for tiered log aggregation architectures.

Scroll for all 9

Semantic Vocabularies 1

JSON-LD contexts and semantic vocabularies used across these APIs.

Apache Flume Monitoring Context

2 classes · 18 properties

JSON-LD

Spectral Rules 2

Spectral governance rulesets for linting and validating these APIs.

Apache Flume API Rules

5 rules · 4 warnings 1 info

SPECTRAL

Apache Flume API Rules

9 rules · 4 errors 4 warnings 1 info

SPECTRAL

JSON Schema 2

Standalone JSON Schema definitions for this provider's data models.

AgentMetrics

0 properties

JSON SCHEMA

ComponentMetrics

18 properties

JSON SCHEMA

JSON Structure 2

JSON Structure definitions describing this provider's data shapes.

Flume Monitoring Agent Metrics Structure

0 properties

JSON STRUCTURE

Examples 2

Example request and response payloads for these APIs.

Security Posture 2

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Apache Flume Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Apache Flume Vulnerability Disclosure

security.txt · contact published

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Apache Flume Agentic Access

1 operation

1 operations · 0 acting

AGENTIC

Use Cases 5

What developers build with this provider.

Centralized Log Aggregation

Collect application logs from hundreds of servers and aggregate them into HDFS, Kafka, or Elasticsearch.

Real-Time Log Tailing

Tail application log files in real time using Taildir source for immediate event processing.

Syslog Ingestion

Ingest RFC-3164 and RFC-5424 syslog events from network devices into centralized storage.

Kafka Event Ingestion

Bridge Kafka topics to HDFS or other storage for batch analytics on streaming event data.

Multi-Tier Architectures

Build tiered data collection with edge collectors forwarding to aggregation agents and final destinations.

Integrations 5

Pre-built integrations with other platforms and tools.

Apache Kafka

Kafka source and channel for consuming events, and Kafka sink for writing events to topics.

Apache HDFS

Primary sink for writing log data to Hadoop Distributed File System for batch analytics.

Apache HBase

HBase sink for writing events directly to HBase tables for random-access analytics.

Apache Solr

Solr sink for indexing log events for full-text search capabilities.

Elasticsearch

Elasticsearch sink for indexing and searching aggregated log data.

Resources

Get Started 1

Portal, sign-up, and the first successful call

Documentation 2

Reference material describing how the API behaves

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

Design & Contract 2

Pagination, idempotency, versioning, errors, and events

Build 3

SDKs, sample code, and the tooling you integrate with

Access & Security 2

Authentication, authorization, and security posture

Operate 1

Status, limits, changes, and where to get help

Commercial 1

Pricing, plans, and the legal terms of use

Company 1

The organization behind the API

Source (apis.yml)

apis.yml Raw ↑
aid: apache-flume
name: Apache Flume
description: Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving
  large amounts of log and event data. It provides a simple and flexible architecture based on streaming data flows with pluggable
  sources, channels, and sinks, plus a REST monitoring API for agent metrics.
type: Index
deliveryModel:
  model: self-hosted
  license: Apache-2.0
  open_source: true
  commercial: false
  callable_host: false
  label: Self-hosted open source · you run it yourself
  confidence: high
  source:
  - license
  - openapi
  generated: '2026-08-28'
  method: derived
accessModel:
  pricing: freemium
  onboarding: unknown
  trial: false
  try_now: false
  public: false
  label: Freemium
  confidence: medium
  source:
  - plans
  generated: '2026-07-22'
  method: derived
position: Consuming
access: 3rd-Party
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/apache-flume.png
tags:
- Apache
- Data Collection
- ETL
- Log Aggregation
- Open-Source
- Streaming
tags_raw:
- Apache
- Data Collection
- ETL
- Log Aggregation
- Open Source
- Streaming
created: '2026-03-16'
modified: '2026-05-19'
url: https://raw.githubusercontent.com/api-evangelist/apache-flume/refs/heads/main/apis.yml
specificationVersion: '0.23'
apis:
- aid: apache-flume:apache-flume-java-api
  name: Apache Flume Java API
  description: Java API for building custom Flume sources, channels, sinks, and interceptors. Provides interfaces for developing
    pluggable data ingestion components.
  humanURL: https://flume.apache.org/FlumeDeveloperGuide.html
  tags:
  - Java
  - SDK
  - Extension
  properties:
  - type: Documentation
    url: https://flume.apache.org/FlumeDeveloperGuide.html
  - type: SDKs
    url: https://search.maven.org/artifact/org.apache.flume/flume-ng-core
    title: Java SDK (Maven Central)
- aid: apache-flume:apache-flume-monitoring-api
  name: Apache Flume Monitoring API
  description: The Monitoring API from Apache Flume — 1 operation(s) for monitoring.
  humanURL: https://flume.apache.org/FlumeUserGuide.html
  baseURL: http://localhost:41414
  tags:
  - Monitoring
  properties:
  - type: OpenAPI
    url: openapi/apache-flume-monitoring-api-openapi.yml
  - type: Documentation
    url: https://flume.apache.org/FlumeUserGuide.html
  - type: JSONSchema
    url: json-schema/flume-monitoring-agent-metrics-schema.json
  - type: JSONLD
    url: json-ld/apache-flume-monitoring-context.jsonld
common:
- type: Website
  url: https://www.apache.org/
- type: IssueTracker
  url: https://github.com/apache/flume/issues
- type: CodeOfConduct
  url: https://github.com/apache/.github/blob/main/.github/CODE_OF_CONDUCT.md
- type: ContributionGuide
  url: https://github.com/apache/logging-flume/blob/trunk/CONTRIBUTING.md
- type: License
  name: Apache-2.0
  url: https://github.com/apache/flume/blob/trunk/LICENSE
- type: AgenticAccess
  url: agentic-access/apache-flume-agentic-access.yml
- type: VulnerabilityDisclosure
  url: security/apache-flume-vulnerability-disclosure.yml
- type: DomainSecurity
  url: security/apache-flume-domain-security.yml
- type: Documentation
  url: https://flume.apache.org/documentation.html
- type: GettingStarted
  url: https://flume.apache.org/FlumeUserGuide.html
- type: GitHubOrganization
  url: https://github.com/apache
- type: GitHubRepository
  url: https://github.com/apache/flume
- type: SpectralRules
  url: rules/apache-flume-spectral-rules.yml
- type: Vocabulary
  url: vocabulary/apache-flume-vocabulary.yaml
- type: Features
  data:
  - name: Pluggable Sources
    description: Extensible source architecture supporting Avro, Thrift, Exec, Taildir, Kafka, HTTP, Syslog, and custom sources.
  - name: Durable Channels
    description: Multiple channel implementations including memory, file-backed, and Kafka-backed channels for different durability
      requirements.
  - name: Multi-Destination Sinks
    description: Write events to HDFS, HBase, Solr, Elasticsearch, Kafka, and custom sink destinations.
  - name: Fan-In Consolidation
    description: Aggregate events from multiple agent sources into a single destination for centralized log collection.
  - name: Fan-Out Distribution
    description: Route events from a single source to multiple channel/sink combinations for parallel processing.
  - name: Interceptors
    description: Event transformation interceptors for filtering, enrichment, and routing based on event content.
  - name: SSL/TLS Security
    description: TLS encryption support across Avro, Thrift, Kafka, HTTP, and Syslog components.
  - name: Monitoring REST API
    description: HTTP monitoring endpoint exposing source, channel, and sink metrics for agent health monitoring.
  - name: Multi-Hop Flows
    description: Chain multiple Flume agents via Avro/Thrift RPC for tiered log aggregation architectures.
- type: UseCases
  data:
  - name: Centralized Log Aggregation
    description: Collect application logs from hundreds of servers and aggregate them into HDFS, Kafka, or Elasticsearch.
  - name: Real-Time Log Tailing
    description: Tail application log files in real time using Taildir source for immediate event processing.
  - name: Syslog Ingestion
    description: Ingest RFC-3164 and RFC-5424 syslog events from network devices into centralized storage.
  - name: Kafka Event Ingestion
    description: Bridge Kafka topics to HDFS or other storage for batch analytics on streaming event data.
  - name: Multi-Tier Architectures
    description: Build tiered data collection with edge collectors forwarding to aggregation agents and final destinations.
- type: Integrations
  data:
  - name: Apache Kafka
    description: Kafka source and channel for consuming events, and Kafka sink for writing events to topics.
  - name: Apache HDFS
    description: Primary sink for writing log data to Hadoop Distributed File System for batch analytics.
  - name: Apache HBase
    description: HBase sink for writing events directly to HBase tables for random-access analytics.
  - name: Apache Solr
    description: Solr sink for indexing log events for full-text search capabilities.
  - name: Elasticsearch
    description: Elasticsearch sink for indexing and searching aggregated log data.
maintainers:
- FN: Kin Lane
  email: info@apievangelist.com

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this
  • find_providersBrowse and filter every provider in the catalog.
  • get_provider_artifactsEvery artifact this provider publishes, grouped by type.
  • get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
  • get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
  • get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
  • get_provider_ratingPRO — composite, band, trend and facet scores.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This provider
curl "https://apis.io/api/v1/providers/apache-flume"
All providers
curl "https://apis.io/api/v1/providers?limit=25"
Every operation they expose
curl "https://apis.io/api/v1/providers/apache-flume/operations?limit=25"
How their score was established
curl "https://apis.io/api/v1/providers/apache-flume/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.