Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GH-214: [feat] Setup Observability For Microservices #356

Open
wants to merge 23 commits into
base: main
Choose a base branch
from
Open

GH-214: [feat] Setup Observability For Microservices #356

wants to merge 23 commits into from

Conversation

wade3hamati
Copy link
Contributor

Description

This PR sets up observability for all microservices using Grafana, Prometheus, Loki, and Tempo. It includes monitoring, logging, and tracing configurations for the following services:

  • user-service
  • email-service
  • event-service
  • gateway
  • storage-service
  • orchestration-service
  • messaging-service

Changes Introduced

  • Prometheus: Added service discovery for all microservices to collect metrics.
  • Grafana: Configured dashboards for visualizing metrics and logs.
  • Loki: Set up centralized logging for all services.
  • Tempo: Enabled distributed tracing to track requests across services.

How to Test

  1. In /Microservices: 
    docker compose up -d
  2. Verify Prometheus is scraping metrics:
    • Access Prometheus UI: http://<prometheus-host>:9090
    • Check targets and ensure all microservices are listed.
  3. Check Grafana dashboards:
    • Access Grafana: http://<grafana-host>:3000
    • Default credentials: admin/admin
    • Verify imported dashboards for logs, metrics, and traces.
  4. Validate logging via Loki:
    • Access Loki via Grafana logs.
    • Ensure logs from all services are visible.

@wade3hamati
GH-214: [feat] Add dependencies to build.gradle.
d513b08
@wade3hamati
GH-214: [feat] Add prometheus properties.
09ccd8b
@wade3hamati
GH-214: [feat] Add ObservationConfig for micrometer observation support.
6203b4f
@wade3hamati
GH-214: [feat] Make repositories observable.
49a939b
@wade3hamati
GH-214: [feat] Create configuration files for tempo, prometheus, and …
b6daf61 
…grafana.
@wade3hamati
GH-214: [feat] Configure Logback for Loki logging integration.
767e22e
@wade3hamati
GH-214: [feat] Add dependencies to build.gradle.
50e8894
@wade3hamati
GH-214: [feat] Add prometheus properties.
9fc48a8
@wade3hamati
GH-214: [feat] Add ObservationConfig for micrometer observation support.
8250ad1
@wade3hamati
GH-214: [feat] Make repositories observable.
c17649a
@wade3hamati
GH-214: [feat] Create configuration files for tempo, prometheus, and …
449dfaf 
…grafana.
@wade3hamati
GH-214: [feat] Configure Logback for Loki logging integration.
c94c162
@wade3hamati
GH-214: [feat] Create docker-compose with Prometheus, Grafana, and Te…
b5b07fa 
…mpo images.
@wade3hamati
GH-214: [feat] Create configuration for Prometheus, Grafana, and Tempo.
92ad080
@wade3hamati
GH-214: [feat] Create Grafana dashboard.
5fd85b4
@wade3hamati
GH-214: [feat] Import needed dependencies and configure application.p…
3b3febc 
…roperties to publish metrics.
@wade3hamati
GH-214: [feat] Add needed dependencies to projects.
56a2b85
@wade3hamati
GH-214: [feat] Add needed configuration settings to projects.
2107596
@wade3hamati
GH-214: [feat] Add needed configuration settings to projects.
3643eae
@wade3hamati
GH-214: [feat] Add ObservationConfig to new messaging-service and sto…
c34fbe4 
…rage-service.
@wade3hamati
GH-214: [feat] Solve merge conflicts.
aa172ec
@wade3hamati
GH-214: [feat] Change ports for easy testability and include actuator…
fea6dc4 
… endpoint in all services.
@wade3hamati
GH-214: [feat] Include all microservices in prometheus config.
585bb80
@wade3hamati wade3hamati added backend Backend related, server side pull request labels Feb 24, 2025
@wade3hamati wade3hamati added this to the Iteration 11 milestone Feb 24, 2025
@wade3hamati wade3hamati self-assigned this Feb 24, 2025
@wade3hamati wade3hamati linked an issue Feb 24, 2025 that may be closed by this pull request
[TASK] Set Up Grafana and Prometheus for Monitoring #214
Open
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@walidoow walidoow Awaiting requested review from walidoow

@DanDuguay DanDuguay Awaiting requested review from DanDuguay

@wolfie7679 wolfie7679 Awaiting requested review from wolfie7679

@Ziadsharkos Ziadsharkos Awaiting requested review from Ziadsharkos

@patrickmac3 patrickmac3 Awaiting requested review from patrickmac3

At least 2 approving reviews are required to merge this pull request.

Assignees

@wade3hamati wade3hamati

Labels
backend Backend related, server side pull request
Projects
None yet
Milestone
Iteration 11
Development

Successfully merging this pull request may close these issues.

[TASK] Set Up Grafana and Prometheus for Monitoring
1 participant
@wade3hamati