Three root causes confirmed via live server investigation (issue #604): 1. ManagementWebSecurityAutoConfiguration applied HTTP Basic auth to the management port (8081), causing Prometheus to receive 401 HTML responses instead of metrics. Excluded the auto-config — the Docker network (archiv-net) provides the security boundary for this internal port. 2. promtail-config.yml had no `job` relabel rule. Grafana's Loki dashboards query {job="$app"} which matched nothing; logs were in Loki under compose_service but invisible to every dashboard panel. 3. prometheus.yml had a stale comment claiming the spring-boot target would be DOWN until micrometer-registry-prometheus was added — it has been present in pom.xml for some time. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
33 lines
1.4 KiB
YAML
33 lines
1.4 KiB
YAML
server:
|
|
http_listen_port: 9080
|
|
grpc_listen_port: 0 # gRPC disabled — used for Promtail clustering only; single-node deployment
|
|
|
|
positions:
|
|
filename: /tmp/positions.yaml # /tmp is a named volume (promtail_positions) — persists across restarts
|
|
|
|
clients:
|
|
- url: http://loki:3100/loki/api/v1/push
|
|
# Loki HTTP API is unauthenticated internally. Any container on obs-net can push logs.
|
|
# Acceptable: only trusted application containers join this network.
|
|
|
|
scrape_configs:
|
|
- job_name: docker-containers
|
|
docker_sd_configs:
|
|
- host: unix:///var/run/docker.sock
|
|
refresh_interval: 5s
|
|
relabel_configs:
|
|
- source_labels: ['__meta_docker_container_name']
|
|
regex: '/(.*)'
|
|
target_label: 'container_name'
|
|
# Note: container_name differs between dev (archive-backend) and prod
|
|
# (archiv-production-backend-1). Prefer compose_service for stable LogQL
|
|
# queries across environments — it is stable: backend, db, minio, etc.
|
|
- source_labels: ['__meta_docker_container_label_com_docker_compose_service']
|
|
target_label: 'compose_service'
|
|
- source_labels: ['__meta_docker_container_label_com_docker_compose_project']
|
|
target_label: 'compose_project'
|
|
- source_labels: ['__meta_docker_container_log_stream']
|
|
target_label: 'logstream'
|
|
- source_labels: ['__meta_docker_container_label_com_docker_compose_service']
|
|
target_label: 'job'
|