Amazon Managed Apache Flink Reference Data Source Structure

For a SQL-based Kinesis Data Analytics application, describes the reference data source by providing the source information (Amazon S3 bucket name and object key name), the resulting in-application table name that is created, and the necessary schema to map the data elements in the Amazon S3 object to the in-application table.

Type: object Properties: 3 Required: 2
Apache FlinkBig DataReal-Time ProcessingStreaming Analytics

ReferenceDataSource is a JSON Structure definition published by Amazon Managed Service for Apache Flink, describing 3 properties, of which 2 are required. It conforms to the https://json-structure.org/meta/core/v0/# meta-schema.

Properties

TableName S3ReferenceDataSource ReferenceSchema

Meta-schema: https://json-structure.org/meta/core/v0/#

JSON Structure

Raw ↑
{
  "$schema": "https://json-structure.org/meta/core/v0/#",
  "$id": "https://raw.githubusercontent.com/api-evangelist/amazon-managed-apache-flink/refs/heads/main/json-structure/amazon-managed-apache-flink-reference-data-source-structure.json",
  "name": "ReferenceDataSource",
  "description": "For a SQL-based Kinesis Data Analytics application, describes the reference data source by providing the source information (Amazon S3 bucket name and object key name), the resulting in-application table name that is created, and the necessary schema to map the data elements in the Amazon S3 object to the in-application table.",
  "type": "object",
  "properties": {
    "TableName": {
      "allOf": [
        {
          "$ref": "#/components/schemas/InAppTableName"
        },
        {
          "description": "The name of the in-application table to create."
        }
      ]
    },
    "S3ReferenceDataSource": {
      "allOf": [
        {
          "$ref": "#/components/schemas/S3ReferenceDataSource"
        },
        {
          "description": "Identifies the S3 bucket and object that contains the reference data. A Kinesis Data Analytics application loads reference data only once. If the data changes, you call the <a>UpdateApplication</a> operation to trigger reloading of data into your application. "
        }
      ]
    },
    "ReferenceSchema": {
      "allOf": [
        {
          "$ref": "#/components/schemas/SourceSchema"
        },
        {
          "description": "Describes the format of the data in the streaming source, and how each data element maps to corresponding columns created in the in-application stream."
        }
      ]
    }
  },
  "required": [
    "TableName",
    "ReferenceSchema"
  ]
}