Synadia Connect
HDFS
| NAME | RUNTIME | TYPE | VERSION |
|---|---|---|---|
| hdfs | wombat | source | latest |
Reads files from a HDFS directory, where each discrete file will be consumed as a single message payload.
The following metadata fields are added to each message:
- hdfs_name
- hdfs_path
Configuration
| Name | Type | Optional | Secret | Description |
|---|---|---|---|---|
| hosts | []string | no | no | A list of target host addresses to connect to. |
| user | string | yes | no | A user ID to connect as. The value defaults to "". |
| directory | string | no | no | The directory to consume from. |