Amazon Managed Apache Flink Reference Data Source Structure
For a SQL-based Kinesis Data Analytics application, describes the reference data source by providing the source information (Amazon S3 bucket name and object key name), the resulting in-application table name that is created, and the necessary schema to map the data elements in the Amazon S3 object to the in-application table.
ReferenceDataSource is a JSON Structure definition published by Amazon Managed Service for Apache Flink, describing 3 properties, of which 2 are required. It conforms to the https://json-structure.org/meta/core/v0/# meta-schema.
{
"$schema": "https://json-structure.org/meta/core/v0/#",
"$id": "https://raw.githubusercontent.com/api-evangelist/amazon-managed-apache-flink/refs/heads/main/json-structure/amazon-managed-apache-flink-reference-data-source-structure.json",
"name": "ReferenceDataSource",
"description": "For a SQL-based Kinesis Data Analytics application, describes the reference data source by providing the source information (Amazon S3 bucket name and object key name), the resulting in-application table name that is created, and the necessary schema to map the data elements in the Amazon S3 object to the in-application table.",
"type": "object",
"properties": {
"TableName": {
"allOf": [
{
"$ref": "#/components/schemas/InAppTableName"
},
{
"description": "The name of the in-application table to create."
}
]
},
"S3ReferenceDataSource": {
"allOf": [
{
"$ref": "#/components/schemas/S3ReferenceDataSource"
},
{
"description": "Identifies the S3 bucket and object that contains the reference data. A Kinesis Data Analytics application loads reference data only once. If the data changes, you call the <a>UpdateApplication</a> operation to trigger reloading of data into your application. "
}
]
},
"ReferenceSchema": {
"allOf": [
{
"$ref": "#/components/schemas/SourceSchema"
},
{
"description": "Describes the format of the data in the streaming source, and how each data element maps to corresponding columns created in the in-application stream."
}
]
}
},
"required": [
"TableName",
"ReferenceSchema"
]
}
Discovery needs no key. Ratings and market analysis are Pro.
Get an API key
Free tier, no form to fill in. Signing in shares your email address with us — we
store it to create your key and to recognise you if you sign in with another
provider. See our Privacy Policy and
Terms.