Get started
Yandex Object Storage

selectObjectContent method

Written by

Filters and returns the contents of an Object Storage object based on an S3 Select query.

Warning

To be able to make S3 Select queries, contact support. You must also have the s3:GetObject permission. For more information, see Bucket policy.

Features of objects that queries can be applied to:

  • Objects in CSV, JSON, and Parquet formats are supported.

  • UTF-8 encoding is used.

  • GZIP and BZIP2 compression methods are supported for CSV files. For Parquet files, columnar compression with GZIP, Snappy, and ZSTD algorithms is supported.

  • Objects can be protected by server-side encryption.

For objects that are encrypted with managed encryption keys stored in YC Key Management Service (SSE-KMS), server-side encryption is performed transparently. This means you don't need to specify anything else.

Request

POST /{bucket}/{key}?select&select-type=2 HTTP/2

Path parameters

Parameter Description
bucket Bucket name.
key Object key.

Query parameters

Parameter Description
select Required parameter that indicates the type of operation.
select-type Optional parameter to indicate the type of request.

Headers

Use the necessary common request headers in requests.

Data schema

Request parameters are passed in XML format:

<SelectObjectContentRequest xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
   <Expression>string</Expression>
   <ExpressionType>string</ExpressionType>
   <RequestProgress>
      <Enabled>boolean</Enabled>
   </RequestProgress>
   <InputSerialization>
      <CompressionType>string</CompressionType>
      <CSV>
         <AllowQuotedRecordDelimiter>boolean</AllowQuotedRecordDelimiter>
         <Comments>string</Comments>
         <FieldDelimiter>string</FieldDelimiter>
         <FileHeaderInfo>string</FileHeaderInfo>
         <QuoteCharacter>string</QuoteCharacter>
         <QuoteEscapeCharacter>string</QuoteEscapeCharacter>
         <RecordDelimiter>string</RecordDelimiter>
      </CSV>
      <JSON>
         <Type>string</Type>
      </JSON>
      <Parquet>
      </Parquet>
   </InputSerialization>
   <OutputSerialization>
      <CSV>
         <FieldDelimiter>string</FieldDelimiter>
         <QuoteCharacter>string</QuoteCharacter>
         <QuoteEscapeCharacter>string</QuoteEscapeCharacter>
         <QuoteFields>string</QuoteFields>
         <RecordDelimiter>string</RecordDelimiter>
      </CSV>
      <JSON>
         <RecordDelimiter>string</RecordDelimiter>
      </JSON>
   </OutputSerialization>
   <ScanRange>
      <End>long</End>
      <Start>long</Start>
   </ScanRange>
</SelectObjectContentRequest>
Tag Description
SelectObjectContentRequest Root-level tag used for passing request parameters.

Required: yes.

Path: /SelectObjectContentRequest.
Expression SQL expression used to query object data.

Data type: string.

Required: yes.

Path: /SelectObjectContentRequest/Expression.
ExpressionType Type of expression used for the request.

Data type: string.

Acceptable values: SQL.

Required: yes.

Path: /SelectObjectContentRequest/ExpressionType.
InputSerialization Requested object data format description.

Data type: InputSerialization.

Required: yes.

Path: /SelectObjectContentRequest/InputSerialization.
OutputSerialization Returned data format description.

Data type: OutputSerialization.

Required: yes.

Path: /SelectObjectContentRequest/OutputSerialization.
RequestProgress Indicates whether regular notifications of request execution progress are enabled.

Data type: RequestProgress.

Required: no.

Path: /SelectObjectContentRequest/RequestProgress.
ScanRange Specifies the byte range of the object to get the records from. A record is processed when its first byte is contained in the range. Used only for objects in CSV format.

Data type: ScanRange.

Required: no.

Path: /SelectObjectContentRequest/ScanRange.

Response

Headers

Responses can only contain common response headers.

Response codes

For a list of possible responses, see Responses.

A successful response contains additional data in XML format with the schema described below.

Data schema

<Payload>
   <Records>
      <Payload>blob</Payload>
   </Records>
   <Stats>
      <Details>
         <BytesProcessed>long</BytesProcessed>
         <BytesReturned>long</BytesReturned>
         <BytesScanned>long</BytesScanned>
      </Details>
   </Stats>
   <Progress>
      <Details>
         <BytesProcessed>long</BytesProcessed>
         <BytesReturned>long</BytesReturned>
         <BytesScanned>long</BytesScanned>
      </Details>
   </Progress>
   <Cont>
   </Cont>
   <End>
   </End>
</Payload>
Tag Description
Payload Root-level tag used for passing response parameters.

Path: /Payload.
Cont Message indicating that the request is being processed.

Path: /Payload/Cont.
End Message indicating that the request has been processed.

Path: /Payload/End.
Progress Information about the progress of request execution.

Path: /Payload/Progress.
Records Request execution results.
Path: /Payload/Records.
Stats Statistics on processed data. Sent once at the end of the request.
Path: /Payload/Stats.
In this article: