Skip to content

feat: Easier troubleshooting with a Lambda that detects issues for you#938

Open
kichik wants to merge 3 commits into
mainfrom
troubleshooter
Open

feat: Easier troubleshooting with a Lambda that detects issues for you#938
kichik wants to merge 3 commits into
mainfrom
troubleshooter

Conversation

@kichik

@kichik kichik commented Apr 23, 2026

Copy link
Copy Markdown
Member

Works like the status function. Can be executed directly, or exposed via HTTP. Sample output:

{
  "config": {
    "auth": "ok",
    "webhook": "ok",
    "secrets": "ok"
  },
  "summary": {
    "executions": {
      "total": 24,
      "succeeded": 18,
      "failed": 0,
      "aborted": 2,
      "timedOut": 0,
      "running": 4
    },
    "health": "healthy",
    "analysisWindow": "last 24 executions"
  },
  "issues": [
    {
      "severity": "warning",
      "category": "webhook-delivery",
      "title": "37/100 webhook deliveries failed (37%)",
      "description": "37 of the last 100 webhook deliveries from GitHub failed.",
      "suggestion": "Check the webhook handler Lambda logs for errors. Verify the webhook URL and secret are configured correctly.",
      "links": {
        "webhookHandlerLogs": "https://us-east-1.console.aws.amazon.com/cloudwatch/home?region=us-east-1#logsV2:log-groups/log-group/$252Faws$252Flambda$252Fgithub-runners-test-runnersWebhookHandlerwebhookha-sN5OLWXCeYN0"
      }
    },
    {
      "severity": "info",
      "category": "idle-reap",
      "title": "2 of 24 executions were idle-reaped",
      "description": "Runners were started but never picked up a job. Top repos: CloudSnorkel/cdk-github-runners (2)",
      "suggestion": "A small number of idle reaps is normal.",
      "links": {}
    }
  ],
  "deepLinks": {
    "stepFunction": "https://us-east-1.console.aws.amazon.com/states/home?region=us-east-1#/statemachines/view/arn:aws:states:us-east-1:123456789:stateMachine:runnersRunnerOrchestratorF9B66EBA-3FEK67lzq2U1",
    "webhookHandlerLogs": "https://us-east-1.console.aws.amazon.com/cloudwatch/home?region=us-east-1#logsV2:log-groups/log-group/$252Faws$252Flambda$252Fgithub-runners-test-runnersWebhookHandlerwebhookha-sN5OLWXCeYN0",
    "orchestratorLogs": "",
    "providerLogs": {
      "github-runners-test/CodeBuildx64": "https://us-east-1.console.aws.amazon.com/cloudwatch/home?region=us-east-1#logsV2:log-groups/log-group/github-runners-test-CodeBuildx64LogsA21ECD59-14edlCnV0dtl",
      // ...
    }
  }
}

kichik and others added 3 commits April 22, 2026 21:12
Update snapshot. See details in [workflow run].

[Workflow Run]: https://github.com/CloudSnorkel/cdk-github-runners/actions/runs/24811289530

------

*Automatically created by projen via the "upgrade-snapshot" workflow*
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants