~taavi/toolforge-logging

Proof of concept for feeding Toolforge tool logs into Grafana Loki
minio: provision a static port for console

refs

main
browse  log 

clone

read-only
https://git.sr.ht/~taavi/toolforge-logging
read/write
git@git.sr.ht:~taavi/toolforge-logging

You can also use your local clone with git send-email.

#Toolforge Loki logging

Proof of concept for feeding Toolforge tool logs into Grafana Loki

#Status

The write path mostly works, the read path still needs some thinking.

#TODO

Stuff needed for production deployment:

  • Client cert authentication for writes
  • Certs/ingress/etc for the read path
  • TLS for intra-cluster traffic maybe?
  • Loki might need persistent storage or a statefulset for data not written to S3 yet
  • Per-tenant limits
  • Ensure we don't ingest ingress-nginx logs to the admin instance
    • TBD if we want to ignore them or get them to a separate ingress instance

#Notes

This needs containerd. Toolforge is currently running Docker, but this is changing due to K8s changes in T284656.

Do not follow this link