Synadia Connect
Azure Data Lake Gen2
| NAME | RUNTIME | TYPE | VERSION | STATUS |
|---|---|---|---|---|
| azure_data_lake_gen2 | wombat | sink | latest | stable |
Sends message parts as files to an Azure Data Lake Gen2 filesystem. Each file is uploaded with the filename specified with the path field.
Configuration
| name | type | optional | secret | description |
|---|---|---|---|---|
| storage_connection_string | string | yes | no | The connection string for the Azure Storage Account. |
| filesystem | string | no | no | The name of the filesystem to upload objects to. This field supports interpolation functions. |
| path | string | yes | no | The path of each message to upload within the filesystem. This field supports interpolation functions. The value defaults to ${!counter()}-${!timestamp_unix_nano()}.txt. |
| max_in_flight | int | yes | no | The maximum number of messages to have in flight at any given time. The value defaults to 64. |