Forem: Rayan Slim

Installing Ingress Nginx

Rayan Slim — Tue, 28 Jan 2025 18:03:12 +0000

Install the NGINX Ingress Controller in your Kubernetes cluster with a single command:

kubectl apply -f https://raw.githubusercontent.com/kubernetes/ingress-nginx/controller-v1.8.2/deploy/static/provider/cloud/deploy.yaml

Installing Metrics Server

Rayan Slim — Tue, 28 Jan 2025 17:59:36 +0000

Mac

kubectl apply -f https://github.com/kubernetes-sigs/metrics-server/releases/latest/download/components.yaml && kubectl patch deployment metrics-server -n kube-system --type='json' -p='[{"op": "add", "path": "/spec/template/spec/containers/0/args/-", "value":"--kubelet-insecure-tls"}]'

Windows (Powershell)

kubectl apply -f https://github.com/kubernetes-sigs/metrics-server/releases/latest/download/components.yaml && kubectl patch deployment metrics-server -n kube-system --type='json' -p='[{"op": "add", "path": "/spec/template/spec/containers/0/args/-", "value":"--kubelet-insecure-tls"}]'

Windows (CMD)

If you are using Windows CMD, you will need to enter these two commands separately. The first command installs all the necessary components for the Metrics Server:

kubectl apply -f https://github.com/kubernetes-sigs/metrics-server/releases/latest/download/components.yaml

The second command specifically patches the deployment manifest to add the --kubelet-insecure-tls flag to the Metrics Server configuration:

kubectl patch deployment metrics-server -n kube-system --type="json" -p="[{\"op\": \"add\", \"path\": \"/spec/template/spec/containers/0/args/-\", \"value\":\"--kubelet-insecure-tls\"}]"

Monitoring Redis with Prometheus Exporter and Grafana

Rayan Slim — Fri, 18 Oct 2024 02:51:57 +0000

A Prometheus exporter is a tool that collects metrics from a specific system and exposes them in a format that Prometheus can scrape. The Redis Prometheus Exporter specifically collects metrics from Redis databases.

In this article, you will deploy Redis alongside the Redis Prometheus Exporter to scrape metrics from your database. You'll then visualize these metrics using a Grafana dashboard.

Clone the Repository
Deploy Redis Resources
Install Redis Exporter
Verify Metrics
Deploy Grafana Dashboard
Access Grafana
Cleaning Up Resources

Prerequisites

This guide assumes you have already installed Helm and set up Prometheus in your Kubernetes cluster. If you haven't done this yet, please check out this article on setting up Prometheus with Kubernetes before continuing with this guide.

Clone the Repository

First, clone the repository containing the necessary Redis resources, exporter configuration, and dashboard:

git clone https://github.com/rslim087a/redis-prometheus-sample

cd redis-prometheus-sample

Deploy Redis Resources

Create the namespace database-monitoring if it doesn't already exist:

kubectl create namespace database-monitoring

Deploy the Redis resources (Secret, Service, and StatefulSet) using the following command:

kubectl apply -f redis/

This command applies all the Kubernetes manifests in the redis/ directory, setting up your Redis instance.

Install Redis Exporter

Add the Prometheus Community Helm repository and update it:

helm repo add prometheus-community https://prometheus-community.github.io/helm-charts
helm repo update

Now, install the Redis Exporter using the custom values file:

helm install redis-exporter prometheus-community/prometheus-redis-exporter \
  -f redis-exporter/redis-exporter-values.yaml \
  -n database-monitoring

Let's examine the custom values in redis-exporter-values.yaml:

# Redis Exporter Helm Values

redisAddress: redis://redis:6379
auth:
  enabled: true
  secret:
    name: redis-secret
    key: REDIS_PASSWORD

serviceMonitor:
  enabled: true
  labels:
    release: prometheus

service:
  type: ClusterIP
  port: 9121

resources:
  limits:
    cpu: 100m
    memory: 128Mi
  requests:
    cpu: 100m
    memory: 128Mi

Explanation of key fields:

redisAddress: Specifies the Redis connection details.
auth: Configures authentication for Redis.
- enabled: true: Activates authentication.
- secret: Specifies the Kubernetes secret containing the Redis password.
serviceMonitor: Configuration for Prometheus to automatically discover and scrape metrics from the Redis exporter.
- enabled: true: Activates the creation of a ServiceMonitor resource.
- labels: Ensures that the correct Prometheus instance picks up this ServiceMonitor.
service: Configures the Kubernetes service for the exporter.
resources: Sets resource limits and requests for the exporter.

Verify Metrics

Port-forward the Redis Exporter pod and check the metrics:

kubectl port-forward svc/redis-exporter-prometheus-redis-exporter 9121:9121 -n database-monitoring &

curl http://localhost:9121/metrics

After verifying, stop the port-forward:

kill %1

Deploy Grafana Dashboard

Apply the Grafana dashboard ConfigMap:

kubectl apply -f grafana -n monitoring

This creates a ConfigMap with the grafana_dashboard: "1" label, which Grafana will automatically detect and import.

Access Grafana

Port-forward the Grafana service:

kubectl port-forward svc/prometheus-grafana 3000:80 -n monitoring &

Access Grafana at http://localhost:3000 using the default credentials (usually admin/prom-operator).

The Redis dashboard should now be available in your Grafana instance. To find it, follow these steps:

Log into Grafana
Click on the "Dashboards" icon in the left sidebar
Select "Browse"
Look for a dashboard named "Redis Dashboard for Prometheus"

This dashboard will provide detailed insights into your Redis performance and health, including metrics on connections, memory usage, operations per second, and more.

Cleaning Up Resources

If you've deployed this setup for testing or learning purposes, you may want to clean up the resources afterwards to avoid unnecessary costs or cluster clutter.

Here are the steps to remove the deployed resources:

Delete the Redis Exporter:

   helm uninstall redis-exporter -n database-monitoring

If you deployed Redis as part of this guide:

   kubectl delete -f redis/ -n database-monitoring

Remove the Grafana dashboard:

   kubectl delete -f grafana -n monitoring

If you no longer need the Prometheus Community Helm repository:

   helm repo remove prometheus-community

Finally, delete the namespace:

   kubectl delete namespace database-monitoring

Kubernetes Training

If you found this guide helpful, check out our Kubernetes Training course

Monitoring Postgres with Prometheus Exporter and Grafana

Rayan Slim — Thu, 17 Oct 2024 02:10:28 +0000

A Prometheus exporter is a tool that collects metrics from a specific system and exposes them in a format that Prometheus can scrape. The PostgreSQL Prometheus Exporter specifically collects metrics from PostgreSQL databases.

In this article, you will deploy PostgreSQL alongside the PostgreSQL Prometheus Exporter to scrape metrics from your database. You'll then visualize these metrics using a Grafana dashboard.

Clone the Repository
Deploy PostgreSQL Resources
Install PostgreSQL Exporter
Verify Metrics
Deploy Grafana Dashboard
Access Grafana
Cleaning Up Resources

Prerequisites

Clone the Repository

First, clone the repository containing the necessary PostgreSQL resources, exporter configuration, and dashboard:

git clone https://github.com/rslim087a/postgres-prometheus-sample

cd postgres-prometheus-sample

Deploy PostgreSQL Resources

Create the namespace database-monitoring:

kubectl create namespace database-monitoring

Deploy the PostgreSQL resources (Secret, Service, and StatefulSet) using the following command:

kubectl apply -f postgres/

This command applies all the Kubernetes manifests in the postgres/ directory, setting up your PostgreSQL instance.

Install PostgreSQL Exporter

Add the Prometheus Community Helm repository and update it:

helm repo add prometheus-community https://prometheus-community.github.io/helm-charts
helm repo update

Now, install the PostgreSQL Exporter using the custom values file:

helm install postgres-exporter prometheus-community/prometheus-postgres-exporter \
  -f postgres-exporter/postgresql-exporter-values.yaml \
  -n database-monitoring

Let's examine the custom values in postgresql-exporter-values.yaml:

# PostgreSQL Exporter Helm Values

# Image configuration
image:
  tag: "v0.12.0"

# Datasource configuration
config:
  datasource:
    host: "postgresql.database-monitoring.svc.cluster.local"
    user: "postgres"
    pass: "password123"
    port: "5432"
    database: "postgres"
    sslmode: "disable"

  # Metrics collectors configuration
  exporter:
    default_metrics:
      enabled: true

serviceMonitor:
  enabled: true
  interval: 30s
  scrapeTimeout: 10s
  labels:
    release: prometheus

# Explicitly set the DATA_SOURCE_NAME environment variable
extraEnvs:
  - name: DATA_SOURCE_NAME
    value: "postgresql://postgres:password123@postgresql.database-monitoring.svc.cluster.local:5432/postgres?sslmode=disable"

Explanation of key fields:

config.datasource: Specifies the PostgreSQL connection details.
- host: The Kubernetes service name for PostgreSQL.
- user and pass: Database credentials.
- port: Default PostgreSQL port.
- database: The database to connect to.
- sslmode: SSL mode for the connection.
serviceMonitor: Configuration for Prometheus to automatically discover and scrape metrics from the PostgreSQL exporter.
- enabled: true: Activates the creation of a ServiceMonitor resource.
- interval: 30s: Sets how often Prometheus should scrape metrics.
- scrapeTimeout: 10s: Defines the maximum time Prometheus should wait for a response.
- labels: Ensures that the correct Prometheus instance picks up this ServiceMonitor.
extraEnvs: Explicitly sets the DATA_SOURCE_NAME environment variable, which is used by the exporter to connect to PostgreSQL.

Verify Metrics

Port-forward the PostgreSQL Exporter service and check the metrics:

kubectl port-forward svc/postgres-exporter-prometheus-postgres-exporter 9187:80 -n database-monitoring &

curl http://localhost:9187/metrics

After verifying, stop the port-forward:

kill %1

Deploy Grafana Dashboard

Apply the Grafana dashboard ConfigMap:

kubectl apply -f grafana -n monitoring

This creates a ConfigMap with the grafana_dashboard: "1" label, which Grafana will automatically detect and import.

Access Grafana

Port-forward the Grafana service:

kubectl port-forward svc/prometheus-grafana 3000:80 -n monitoring &

Access Grafana at http://localhost:3000 using the default credentials (usually admin/prom-operator).

The PostgreSQL dashboard should now be available in your Grafana instance. To find it, follow these steps:

Log into Grafana
Click on the "Dashboards" icon in the left sidebar
Select "Browse"
Look for a dashboard named "PostgreSQL Dashboard" or similar

This dashboard will provide detailed insights into your PostgreSQL performance and health, including metrics on connections, transactions, database sizes, and more.

Cleaning Up Resources

If you've deployed this setup for testing or learning purposes, you may want to clean up the resources afterwards to avoid unnecessary costs or cluster clutter.

Here are the steps to remove the deployed resources:

Delete the PostgreSQL Exporter:

   helm uninstall postgres-exporter -n database-monitoring

If you deployed PostgreSQL as part of this guide:

   kubectl delete -f postgres/ -n database-monitoring

Remove the Grafana dashboard:

   kubectl delete -f grafana -n monitoring

If you no longer need the Prometheus Community Helm repository:

   helm repo remove prometheus-community

Finally, delete the namespace

   kubectl delete namespace database-monitoring

Kubernetes Training

If you found this guide helpful, check out our Kubernetes Training course

Forem: Rayan Slim

Installing Ingress Nginx

Installing Metrics Server

Mac

Windows (Powershell)

Windows (CMD)

Monitoring Redis with Prometheus Exporter and Grafana

Table of Contents

Prerequisites

Clone the Repository

Deploy Redis Resources

Install Redis Exporter

Verify Metrics

Deploy Grafana Dashboard

Access Grafana

Cleaning Up Resources

Kubernetes Training

Monitoring Postgres with Prometheus Exporter and Grafana

Table of Contents

Prerequisites

Clone the Repository

Deploy PostgreSQL Resources

Install PostgreSQL Exporter

Verify Metrics

Deploy Grafana Dashboard

Access Grafana

Cleaning Up Resources

Kubernetes Training