Topic · topic
Sketches
Sketches are probabilistic data structures used in computing and data engineering to approximate answers to queries over large data streams with controlled error bounds and dramatically reduced memory requirements. Common sketches include Count-Min Sketch (frequency estimation), HyperLogLog (cardinality estimation), Bloom Filter (membership testing), and T-Digest (quantile estimation). APIs in this domain include sketch-native databases like Apache DataSketches, Redis probabilistic data structures, and cloud analytics services that implement sketch algorithms for real-time analytics, approximate query processing, and streaming analytics.
Resources
-
Apache DataSketches API
Apache DataSketches is the open-source library providing production-quality implementations of sketch algorithms including Theta Sketches (set operations), Quantiles Sketches (percentile estimation), HLL (HyperLogLog for cardinality), CPC,…
-
Redis Probabilistic Data Structures API
Redis provides native probabilistic data structure commands through the Redis Stack (RedisBloom module), offering server-side implementations of Bloom Filter, Cuckoo Filter, Count-Min Sketch, Top-K, and HyperLogLog. These are accessible vi…
-
Amazon Redshift Approximate Query API
Amazon Redshift supports approximate query processing using HyperLogLog sketch functions (HLL_CREATE_SKETCH, HLL_COMBINE, HLL_CARDINALITY) for fast cardinality estimation on large datasets. These native SQL functions enable analytics teams…
Links
Providers working in Sketches
Providers whose own tags share at least two of this topic's tags, most shared first.
| Provider | About | Rating | APIs |
|---|---|---|---|
| Amazon Managed Service for Apache Flink | Amazon Managed Service for Apache Flink is the easiest way to transform and analyze streaming data in real time with Apache Flink. It enables you to build sophisticated streaming analytics applications using Apache Flink with fully managed… | developing | 1 |
| Altinity | Altinity is the enterprise provider for open-source ClickHouse, the real-time analytical database. It builds and operates Altinity.Cloud, a fully managed ClickHouse service available on AWS, GCP, Azure and Hetzner, plus a bring-your-own-cl… | developing | 1 |
| Apache Flink | Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and bounded data streams. It provides a REST API for job management, cluster operations, metrics collection, and checkpoint management f… | thin | 1 |
| Apache Flink | Apache Flink is an open-source framework and distributed processing engine for stateful computations over unbounded and bounded data streams. It is designed to run in all common cluster environments and to perform computations at in-memory… | emerging | 1 |
Tags
Data StructuresProbabilistic AlgorithmsStreaming AnalyticsApproximate Query ProcessingBig DataReal-Time Analytics