ProofLine Grafana Telegram Alerting Steps

1. Create a Telegram bot
- Open Telegram
- Start a chat with @BotFather
- Create a new bot
- Save the bot token

2. Get the chat ID
- Send a message to the bot or add the bot to your group/channel
- Run:
  curl -s "https://api.telegram.org/bot<BOT_TOKEN>/getUpdates"
- Find the target chat.id in the JSON output

3. Create a Grafana Telegram contact point
- Open Grafana
- Go to Alerts & IRM -> Contact points
- Click New contact point
- Name: proofline-telegram
- Integration: Telegram
- Paste bot token
- Paste chat ID
- Send a test notification

4. Create a notification policy
- Go to Alerts & IRM -> Notification policies
- Route Monad alert rules to the proofline-telegram contact point

5. Create Grafana alert rules from Prometheus expressions
- monad_service_up{service="monad-bft"} == 0
- monad_service_up{service="monad-execution"} == 0
- monad_service_up{service="monad-rpc"} == 0
- monad_rpc_up == 0
- monad_rpc_syncing == 1
- monad_ssh_listener_up == 0
- monad_p2p_tcp_listener_up == 0
- monad_p2p_udp_listener_up == 0
- monad_root_free_bytes < 21474836480

6. Recommended rule timing
- Critical service down checks: For 2m
- Syncing and low disk checks: For 10m

7. Validate
- Trigger a test notification from the contact point
- Check that the alert appears in Grafana Alerting
- Confirm the Telegram message is delivered