Send Vector logs to Axiom

Vector is a lightweight and ultra-fast tool for building observability pipelines. It has a built-in support for shipping logs to Axiom through the axiom sink.

Installation

Vector can be installed on Linux, Windows, and MacOS. Visit the Vector documentation to install Vector.

Configuration

Sending data to Axiom with Vector is very straightforward using the axiom sink. you only need your dataset name and Ingest Token.

In the example below we configure Vector to read and collect metrics from StatsD aggregator and send StatsD metrics to the Axiom sink.

First, you'll need to create vector configuration file, vector.toml

Common Configuration

[sources.my_source_id]
type = "statsd"

[sinks.axiom]
inputs = ["my_source_id"]
type = "axiom"
token = "xaat-1234"
dataset = "vector-dev"

Advanced Configuration

Send Kubernetes logs to Axiom using the Kubernetes source.

[sources.my_source_id]
type = "kubernetes_logs"
auto_partial_merge = true
ignore_older_secs = 600
read_from = "beginning"
self_node_name = "${VECTOR_SELF_NODE_NAME}"
exclude_paths_glob_patterns = [ "**/exclude/**" ]
extra_field_selector = "metadata.name!=pod-name-to-exclude"
extra_label_selector = "my_custom_label!=my_value"
extra_namespace_label_selector = "my_custom_label!=my_value"
max_read_bytes = 2_048
max_line_bytes = 32_768
fingerprint_lines = 1
glob_minimum_cooldown_ms = 60_000
delay_deletion_ms = 60_000
data_dir = "/var/lib/vector"
timezone = "local"

[sinks.axiom]
type = "axiom"
inputs = ["my-source-or-transform-id"]
token = "xaat-1234"
dataset = "vector-dev"

• DATASET: is the name of your dataset. When logs are sent from your vector it is stored in a Dataset on Axiom.

See creating a dataset for more

• TOKEN: is used to ingest or query data to your dataset. API token can be generated from settings on Axiom dashboard.

See creating an API token for more

You can checkout the advanced configuration on Batch, Buffer configuration, and Encoding on Vector Documentation