Configuring an Object Storage target endpoint
Written by
When creating or updating an endpoint, you can configure access to a Yandex Object Storage bucket.
Settings Yandex Object Storage
-
Bucket: The name of the bucket to upload source data to.
-
Service account: Service account with the
storage.uploader
role that will be used to access Yandex Data Streams. -
Output format: Format the data will be written to the bucket in (
JSON
,CSV
, orRaw
). -
Compression format: Compression of output data (
GZIP
orUNCOMPRESSED
). -
Folder name: Name of the folder to store files in. Supports the data layout pattern by date, such as
2006/01/02/<folder name>
.
Advanced settings
-
Buffer size: Size of files the data will be split into.
-
Write interval: Time after which the file will be written, regardless of its size.