kubernetes基于Prometheus监控redis（redisexporter）

云计算 2023-07-09 Escape 手机阅读

1、安装和配置redis-exporter

1.1 使用helm安装redis-exporter

在本方案的redis-exporter在Kubernetes集群中进行部署，并假设在kube-public命名空间下已经部署了redis，对外暴露的服务名称为redis-service。redis-exporter负责从redis中获取指标数据，并将这些数据传递给Prometheus。

$ helm install --name prom-exporter --set "redisAddress=redis://redis-service:6379" stable/prometheus-redis-exporter --namespace=kube-public

redis-exporter部署的主要参数和说明：

参数	描述	Default
`replicaCount`	副本数量	`1`
`image.repository`	prometheus-redis-exporter镜像	`oliver006/redis_exporter`
`image.tag`	prometheus-redis-exporter image tag	`v1.3.4`
`image.pullPolicy`	镜像拉取策略	`IfNotPresent`
`image.pullSecrets`	镜像拉取密文	{}
`extraArgs`	extra arguments for the binary; possible values here	{}
`env`	additional environment variables in YAML format. Can be used to pass credentials as env variables (via secret) as per the image readme here	{}
`resources`	cpu/memory resource requests/limits	{}
`service.type`	desired service type	`ClusterIP`
`service.port`	service external port	`9121`
`service.annotations`	Custom annotations for service	`{}`
`service.labels`	Additional custom labels for the service	`{}`
`redisAddress`	Address of the Redis instance to scrape. Use `rediss://` for SSL.	`redis://myredis:6379`
`annotations`	pod annotations for easier discovery	{}
`rbac.create`	Specifies whether RBAC resources should be created.	`true`
`rbac.pspEnabled`	Specifies whether a PodSecurityPolicy should be created.	`true`
`serviceAccount.create`	Specifies whether a service account should be created.	`true`
`serviceAccount.name`	Name of the service account.
`serviceMonitor.enabled`	Use servicemonitor from prometheus operator	`false`
`serviceMonitor.namespace`	Namespace this servicemonitor is installed in
`serviceMonitor.interval`	How frequently Prometheus should scrape
`serviceMonitor.telemetryPath`	Path to redis-exporter telemtery-path
`serviceMonitor.labels`	Labels for the servicemonitor passed to Prometheus Operator	`{}`
`serviceMonitor.timeout`	Timeout after which the scrape is ended
`serviceMonitor.targetLabels`	Set of labels to transfer on the Kubernetes Service onto the target.
`prometheusRule.enabled`	Set this to true to create prometheusRules for Prometheus operator	`false`
`prometheusRule.additionalLabels`	Additional labels that can be used so prometheusRules will be discovered by Prometheus	`{}`
`prometheusRule.namespace`	namespace where prometheusRules resource should be created
`prometheusRule.rules`	rules to be created, check values for an example.	`[]`
`script.configmap`	Let you run a custom lua script from a configmap. The corresponding environment variable `REDIS_EXPORTER_SCRIPT` will be set automatically
`script.keyname`	Name of the key inside configmap which contains your script
`auth.enabled`	Specifies whether redis uses authentication	`false`
`auth.secret.name`	Name of existing redis secret (ignores redisPassword)
`auth.secret.key`	Name of key containing password to be retrieved from the existing secret
`auth.redisPassword`	Redis password (when not stored in a secret)

1.2 对外暴露redis-exporter

通过下面的命令，将集中部署的redis-exporter暴露给集群外的用户访问。

$ kubectl expose deployment prom-exporter-prometheus-redis-exporter --type=NodePort --namespace=kube-public

1.3 查看redis指标数据

在浏览器中，访问redis-exporter，能够看到所要监控的redis指标。

# HELP go_gc_duration_seconds A summary of the GC invocation durations. 1. TYPE go_gc_duration_seconds summary go_gc_duration_seconds{quantile=”0″} 0 go_gc_duration_seconds{quantile=”0.25″} 0 go_gc_duration_seconds{quantile=”0.5″} 0 go_gc_duration_seconds{quantile=”0.75″} 0 go_gc_duration_seconds{quantile=”1″} 0 go_gc_duration_seconds_sum 0 go_gc_duration_seconds_count 0 1. HELP go_goroutines Number of goroutines that currently exist. 1. TYPE go_goroutines gauge go_goroutines 8 1. HELP go_info Information about the Go environment. 1. TYPE go_info gauge go_info{version=”go1.13.4″} 1 1. HELP go_memstats_alloc_bytes Number of bytes allocated and still in use. 1. TYPE go_memstats_alloc_bytes gauge go_memstats_alloc_bytes 1.198456e+06 1. HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed. 1. TYPE go_memstats_alloc_bytes_total counter go_memstats_alloc_bytes_total 1.198456e+06 1. HELP go_memstats_buck_hash_sys_bytes Number of bytes used by the profiling bucket hash table. 1. TYPE go_memstats_buck_hash_sys_bytes gauge go_memstats_buck_hash_sys_bytes 1.442979e+06 1. HELP go_memstats_frees_total Total number of frees. 1. TYPE go_memstats_frees_total counter go_memstats_frees_total 248 1. HELP go_memstats_gc_cpu_fraction The fraction of this program’s available CPU time used by the GC since the program started. 1. TYPE go_memstats_gc_cpu_fraction gauge go_memstats_gc_cpu_fraction 0 1. HELP go_memstats_gc_sys_bytes Number of bytes used for garbage collection system metadata. 1. TYPE go_memstats_gc_sys_bytes gauge go_memstats_gc_sys_bytes 2.240512e+06 1. HELP go_memstats_heap_alloc_bytes Number of heap bytes allocated and still in use. 1. TYPE go_memstats_heap_alloc_bytes gauge go_memstats_heap_alloc_bytes 1.198456e+06 1. HELP go_memstats_heap_idle_bytes Number of heap bytes waiting to be used. 1. TYPE go_memstats_heap_idle_bytes gauge go_memstats_heap_idle_bytes 6.4086016e+07 1. HELP go_memstats_heap_inuse_bytes Number of heap bytes that are in use. 1. TYPE go_memstats_heap_inuse_bytes gauge go_memstats_heap_inuse_bytes 2.465792e+06 1. HELP go_memstats_heap_objects Number of allocated objects. 1. TYPE go_memstats_heap_objects gauge go_memstats_heap_objects 3334 1. HELP go_memstats_heap_released_bytes Number of heap bytes released to OS. 1. TYPE go_memstats_heap_released_bytes gauge go_memstats_heap_released_bytes 6.4053248e+07 1. HELP go_memstats_heap_sys_bytes Number of heap bytes obtained from system. 1. TYPE go_memstats_heap_sys_bytes gauge go_memstats_heap_sys_bytes 6.6551808e+07 1. HELP go_memstats_last_gc_time_seconds Number of seconds since 1970 of last garbage collection. 1. TYPE go_memstats_last_gc_time_seconds gauge go_memstats_last_gc_time_seconds 0 1. HELP go_memstats_lookups_total Total number of pointer lookups. 1. TYPE go_memstats_lookups_total counter go_memstats_lookups_total 0 1. HELP go_memstats_mallocs_total Total number of mallocs. 1. TYPE go_memstats_mallocs_total counter go_memstats_mallocs_total 3582 1. HELP go_memstats_mcache_inuse_bytes Number of bytes in use by mcache structures. 1. TYPE go_memstats_mcache_inuse_bytes gauge go_memstats_mcache_inuse_bytes 83328 1. HELP go_memstats_mcache_sys_bytes Number of bytes used for mcache structures obtained from system. 1. TYPE go_memstats_mcache_sys_bytes gauge go_memstats_mcache_sys_bytes 98304 1. HELP go_memstats_mspan_inuse_bytes Number of bytes in use by mspan structures. 1. TYPE go_memstats_mspan_inuse_bytes gauge go_memstats_mspan_inuse_bytes 27608 1. HELP go_memstats_mspan_sys_bytes Number of bytes used for mspan structures obtained from system. 1. TYPE go_memstats_mspan_sys_bytes gauge go_memstats_mspan_sys_bytes 32768 1. HELP go_memstats_next_gc_bytes Number of heap bytes when next garbage collection will take place. 1. TYPE go_memstats_next_gc_bytes gauge go_memstats_next_gc_bytes 4.473924e+06 1. HELP go_memstats_other_sys_bytes Number of bytes used for other system allocations. 1. TYPE go_memstats_other_sys_bytes gauge go_memstats_other_sys_bytes 707669 1. HELP go_memstats_stack_inuse_bytes Number of bytes in use by the stack allocator. 1. TYPE go_memstats_stack_inuse_bytes gauge go_memstats_stack_inuse_bytes 557056 1. HELP go_memstats_stack_sys_bytes Number of bytes obtained from system for stack allocator. 1. TYPE go_memstats_stack_sys_bytes gauge go_memstats_stack_sys_bytes 557056 1. HELP go_memstats_sys_bytes Number of bytes obtained from system. 1. TYPE go_memstats_sys_bytes gauge go_memstats_sys_bytes 7.1631096e+07 1. HELP go_threads Number of OS threads created. 1. TYPE go_threads gauge go_threads 7 1. HELP process_cpu_seconds_total Total user and system CPU time spent in seconds. 1. TYPE process_cpu_seconds_total counter process_cpu_seconds_total 0.07 1. HELP process_max_fds Maximum number of open file descriptors. 1. TYPE process_max_fds gauge process_max_fds 65536 1. HELP process_open_fds Number of open file descriptors. 1. TYPE process_open_fds gauge process_open_fds 9 1. HELP process_resident_memory_bytes Resident memory size in bytes. 1. TYPE process_resident_memory_bytes gauge process_resident_memory_bytes 4.58752e+06 1. HELP process_start_time_seconds Start time of the process since unix epoch in seconds. 1. TYPE process_start_time_seconds gauge process_start_time_seconds 1.58528265239e+09 1. HELP process_virtual_memory_bytes Virtual memory size in bytes. 1. TYPE process_virtual_memory_bytes gauge process_virtual_memory_bytes 1.14233344e+08 1. HELP process_virtual_memory_max_bytes Maximum amount of virtual memory available in bytes. 1. TYPE process_virtual_memory_max_bytes gauge process_virtual_memory_max_bytes -1 1. HELP redis_exporter_build_info redis exporter build_info 1. TYPE redis_exporter_build_info gauge redis_exporter_build_info{build_date=”2019-11-15-19:32:19″,commit_sha=”e15c7d22b9151c3681c60b5df5cd552584bef10d”,golang_version=”go1.13.4″,version=”v1.3.4″} 1 1. HELP redis_exporter_last_scrape_duration_seconds exporter_last_scrape_duration_seconds metric 1. TYPE redis_exporter_last_scrape_duration_seconds gauge redis_exporter_last_scrape_duration_seconds 0.019919049 1. HELP redis_exporter_last_scrape_error The last scrape error status. 1. TYPE redis_exporter_last_scrape_error gauge redis_exporter_last_scrape_error{err=”NOAUTH Authentication required.”} 1 1. HELP redis_exporter_scrape_duration_seconds Duration of scrape by the exporter 1. TYPE redis_exporter_scrape_duration_seconds summary redis_exporter_scrape_duration_seconds{quantile=”0.5″} NaN redis_exporter_scrape_duration_seconds{quantile=”0.9″} NaN redis_exporter_scrape_duration_seconds{quantile=”0.99″} NaN redis_exporter_scrape_duration_seconds_sum 0 redis_exporter_scrape_duration_seconds_count 0 1. HELP redis_exporter_scrapes_total Current total redis scrapes. 1. TYPE redis_exporter_scrapes_total counter redis_exporter_scrapes_total 1 1. HELP redis_target_scrape_request_errors_total Errors in requests to the exporter 1. TYPE redis_target_scrape_request_errors_total counter redis_target_scrape_request_errors_total 0 1. HELP redis_up Information about the Redis instance 1. TYPE redis_up gauge redis_up 0

2、Prometheus监控

2.1 配置Prometheus

在Prometheus的配置文件（Prometheus.yaml）中，添加红色字体部分的内容。

global: scrape_interval: 15s # Set the scrape interval to every 15 seconds. Default is every 1 minute. evaluation_interval: 15s # Evaluate rules every 15 seconds. The default is every 1 minute. 1. scrape_timeout is set to the global default (10s).

# Alertmanager configuration alerting: alertmanagers: – static_configs: – targets: 1. – alertmanager:9093

# Load rules once and periodically evaluate them according to the global ‘evaluation_interval’. rule_files: 1. – “first_rules.yml” 1. – “second_rules.yml”

# A scrape configuration containing exactly one endpoint to scrape: 1. Here it’s Prometheus itself. scrape_configs: 1. The job name is added as a label `job=` to any timeseries scraped from this config. – job_name: ‘prometheus’

# metrics_path defaults to ‘/metrics’ 1. scheme defaults to ‘http’.

static_configs: – targets: [‘localhost:9090’]

# 配置从redis-exporter中获取数据，目标地址为：redis-exporter-np:9121

– job_name: ‘redis’ static_configs: – targets: [‘redis-exporter-np:9121’]