Pre-signed URLs

Using pre-signed URLs, internet users can perform various operations in Object Storage, such as:

• Download an object
• Upload an object
• Create a bucket

A pre-signed URL is a URL containing request authorization data in its parameters. Users with static access keys can create pre-signed URLs.

This section outlines the common principles for generating pre-signed URLs using AWS Signature V4.

General pre-signed URL format

https://storage.yandexcloud.net/<bucket name>/<object key>?
     X-Amz-Algorithm=AWS4-HMAC-SHA256
    &X-Amz-Expires=<time interval in seconds>
    &X-Amz-SignedHeaders=<list of headers separated by ";">
    &X-Amz-Signature=<signature>
    &X-Amz-Date=<time in ISO 8601 format>
    &X-Amz-Credential=<access-key-id>%2F<YYYYMMDD>%2Fru-central1%2Fs3%2Faws4_request

Pre-signed URL parameters:

Creating pre-signed URLs

To get a pre-signed URL, do the following:

1. Calculate the signature.
   1. Compose a string to sign.
   2. Calculate the signature using the string signature algorithm.
2. Compose a pre-signed URL for your request.

To compose a pre-signed URL, you must have static access keys.

String to sign

String to sign:

"AWS4-HMAC-SHA256" + "\n" +
<timestamp> + "\n" +
<scope> + "\n" +
Hex(Hash-SHA256(<CanonicalRequest>))

• AWS4-HMAC-SHA256 — The hashing algorithm.
• timestamp — The current time in ISO 8601 format, for example: 20190801T000000Z. The date specified must match the date in scope (by the value rather than format).
• scope — <YYYYMMDD>/ru-central1/s3/aws4_request.
• CanonicalRequest — A canonical request. To include your request in the string, hash it using the SHA256 algorithm and convert it to hexadecimal format.

Canonical request

General canonical request format:

<HTTPVerb>\n
<CanonicalURL>\n
<CanonicalQueryString>\n
<CanonicalHeaders>\n
<SignedHeaders>\n
UNSIGNED-PAYLOAD

A canonical request must always end with the UNSIGNED-PAYLOAD string.

HTTPVerb

The HTTP method used to send a request: GET, PUT, HEAD, or DELETE.

CanonicalURL

The URL-encoded path to the resource. For example, /<bucket-name>/<object-key>.

CanonicalQueryString

The canonical query string must include all the query parameters of the destination URL, except X-Amz-Signature. The parameters in the string must be URL-encoded and sorted alphabetically.

Example:

X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=JK38EXAMPLEAKDID8%2F20190801%2Fru-central1%2Fs3%2Faws4_request&X-Amz-Date=20190801T000000Z&X-Amz-Expires=86400&X-Amz-SignedHeaders=host

CanonicalHeaders

A list of the request headers and their values.

Requirements:

• Each header is separated by the "\n" newline character.
• Header names must be lowercase.
• Headers must be sorted alphabetically.
• There may not be any extra spaces.
• The list must contain the host header and all the x-amz-* headers used in the request.

You can also add any of the request headers to the list. The more headers you sign, the safer your request is.

Example:

host:storage.yandexcloud.net
x-amz-date:20190801T000000Z

SignedHeaders

A list of lowercase request header names, sorted alphabetically and separated by commas.

Example:

host;x-amz-date

Pre-signed URLs

To create a pre-signed URL, Object Storage add the parameters required to authorize the request to the resource URL, including the X-Amz-Signature parameter with the calculated signature.

Example of composing a pre-signed URL for object download

Let's compose a pre-signed URL to download the object-for-share.txt object that's valid for one hour.

• Static key:

  access_key_id = 'JK38EXAMPLEAKDID8'
  secret_access_key = 'ExamP1eSecReTKeykdokKK38800'
  

• Canonical request:

  GET
  /example-bucket/object-for-share.txt
  X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=JK38EXAMPLEAKDID8%2F20190801%2Fru-central1%2Fs3%2Faws4_request&X-Amz-Date=20190801T000000Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host
  host:storage.yandexcloud.net
  
  host
  UNSIGNED-PAYLOAD
  

• String to sign:

  AWS4-HMAC-SHA256
  20190801T000000Z
  20190801/ru-central1/s3/aws4_request
  2d2b4efefa9072d90a646afbc0fbaef4618c81396b216969ddfc2869db5aa356
  

• Signing key:

  sign(sign(sign(sign("AWS4" + "ExamP1eSecReTKeykdokKK38800","20190801"),"ru-central1"),"s3"),"aws4_request")
  

  The sign function was introduced to indicate the method of key calculation that uses the HMAC algorithm with the SHA256 hash function.

• Signature:

  56bdf53a1f10c078c2b4fb5a26cefa670b3ea796567d85489135cf33e77783f0
  

• Pre-signed URL:

  https://storage.yandexcloud.net/example-bucket/object-for-share.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=JK38EXAMPLEAKDID8%2F20190801%2Fru-central1%2Fs3%2Faws4_request&X-Amz-Date=20190801T000000Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=56bdf53a1f10c078c2b4fb5a26cefa670b3ea796567d85489135cf33e77783f0
  

Examples of getting pre-signed links in tools Object Storage

aws s3 presign s3://<bucket-name>/<object-key> [--expires-in <value>]

# coding=utf-8

import boto3
from botocore.client import Config


ENDPOINT = "https://storage.yandexcloud.net"

ACCESS_KEY = "JK38EXAMPLEAKDID8"
SECRET_KEY = "ExamP1eSecReTKeykdokKK38800"

session = boto3.Session(
    aws_access_key_id=ACCESS_KEY,
    aws_secret_access_key=SECRET_KEY,
    region_name="ru-central1",
)
s3 = session.client(
    "s3", endpoint_url=ENDPOINT, config=Config(signature_version="s3v4")
)

presigned_url = s3.generate_presigned_url(
    "get_object",
    Params={"Bucket": "bucket-with-objects", "Key": "object-for-share"},
    ExpiresIn=100,
)

print(presigned_url)