Synadia Connect
HDFS
NAME | RUNTIME | TYPE | VERSION |
---|---|---|---|
hdfs | wombat | source | latest |
Reads files from a HDFS directory, where each discrete file will be consumed as a single message payload.
The following metadata fields are added to each message:
- hdfs_name
- hdfs_path
Configuration
Name | Type | Optional | Secret | Description |
---|---|---|---|---|
hosts | []string | no | no | A list of target host addresses to connect to. |
user | string | yes | no | A user ID to connect as. The value defaults to "" . |
directory | string | no | no | The directory to consume from. |