dataSource Schema #
undefined#/properties/postProcess/items/allOf/22/properties/params/properties/pipeline/items/properties/dataSource
A data origin that will supply data to the pipeline
| Abstract | Extensible | Status | Identifiable | Custom Properties | Additional Properties | Access Restrictions | Defined In |
|---|---|---|---|---|---|---|---|
| Can be instantiated | No | Unknown status | No | Forbidden | Allowed | none | specSchema.schema.json* |
dataSource Type #
object (dataSource)
all of
- property source is s3
- property source is mqtt
- property source is kinesis-streams
- property source is dynamo
- property source is cloudwatch-logs-filter
- property source is cloudwatch-logs-insights
- property source is elasticsearch
- property source is inline
- property source is file-binary
- property source is stdin
dataSource Properties #
| Property | Type | Required | Nullable | Defined by |
|---|---|---|---|---|
| source | string |
Required | cannot be null | specSchema (Unified Pipeline Specification) |
source #
Enumeration of origin data system types
source
- is required
- type:
string - cannot be null
- Unstructured type
source Constraints #
enum: the value of this property must be equal to one of the following values:
| Value | Explanation |
|---|---|
"s3" |
S3 data source |
"mqtt" |
IOT Core MQTT data source |
"kinesis-streams" |
Kinesis Streams data source |
"dynamo" |
DynamoDB data source |
"cloudwatch-logs-filter" |
Cloudwatch Logs Filter data source |
"cloudwatch-logs-insights" |
Cloudwatch Logs Insights data source |
"elasticsearch" |
Elasticsearch data source |
"file-binary" |
|
"stdin" |
Standard input command line data source, usually from a pipe or redirect |
"inline" |
Rows of data inline in the JSON of the specification |