Installing Fluent Bit with a plugin for Cloud Logging
Fluent Bit
The plugin for Cloud Logging enables you to export logs generated in a Managed Service for Kubernetes cluster, including at the pod level, to Yandex Cloud Logging.
Creating a service account
-
If you do not have the Yandex Cloud command line interface yet, install and initialize it.
The folder specified in the CLI profile is used by default. You can specify a different folder using the
--folder-name
or--folder-id
parameter. -
Create a service account, which is required for Fluent Bit.
-
Assign it the
logging.writer
andmonitoring.editor
roles. -
Create an authorized key and save it to a file named
sa-key.json
:
Installation using Yandex Cloud Marketplace
- Go to the folder page
and select Managed Service for Kubernetes. - Click the Managed Service for Kubernetes cluster name and select the
Marketplace tab. - Under Applications available for installation, select Fluent Bit with a plugin for Cloud Logging and click Use.
- Configure the application:
- Namespace: Select a namespace or create a new one.
- Application name: Enter a name for the application.
- Target log group ID: Specify the ID of the log group to which Fluent Bit logs will be saved.
- Cluster ID: Specify the Managed Service for Kubernetes cluster ID.
- Service account key for Cloud Logging: Paste the contents of the
sa-key.json
file.
- Click Install.
- Wait for the application to change its status to
Deployed
.
Installation using a Helm chart
-
Install Helm
v3.7.0 or higher. -
Install kubectl
and configure it to work with the created cluster. -
To install a Helm chart
with Fluent Bit, run this command:export HELM_EXPERIMENTAL_OCI=1 && \ cat sa-key.json | helm registry login cr.yandex --username 'json_key' --password-stdin && \ helm pull oci://cr.yandex/yc-marketplace/yandex-cloud/fluent-bit/fluent-bit \ --version 2.1.7-3 \ --untar && \ helm install \ --namespace <namespace> \ --create-namespace \ --set loggingGroupId=<log_group_ID> \ --set loggingFilter=<cluster_ID> \ --set-file auth.json=sa-key.json \ fluentbit ./fluent-bit-cloud-logging/
This command also creates a new namespace required for Fluent Bit.