Synadia Connect

GCP Cloud Storage

NAMERUNTIMETYPEVERSIONSTATUS
gcp_cloud_storagewombatsourcelatestpreview

Downloads objects within a Google Cloud Storage bucket, optionally filtered by a prefix.

Configuration

nametypeoptionalsecretdescription
bucketstringnonoThe name of the GCS bucket.
prefixstringyesnoOptional prefix to filter objects by. The value defaults to ``.
credentials_jsonstringnonoJSON credentials for authenticating with GCP.
scannerscannernonoThe scanner by which the stream of bytes consumed will be broken out into individual messages. Scanners are useful for processing large sources of data without holding the entirety of it within memory. For example, the csv scanner allows you to process individual CSV rows without loading the entire CSV file in memory at once.
Previous
GCP BigQuery Select