Skip to content

Fix Redpanda healthcheck (always unhealthy) - #14

Merged
ArtyomSavchenko merged 3 commits into
mainfrom
fix-redpanda-healthcheck
Sep 29, 2026
Merged

ArtyomSavchenko merged 3 commits into
mainfrom
fix-redpanda-healthcheck

Conversation

@ArtyomSavchenko

@ArtyomSavchenko ArtyomSavchenko commented Sep 29, 2026 •

Copy link
Copy Markdown
Member

Redpanda was always unhealthy although the broker worked. The healthcheck ran rpk cluster info -X user=… -X pass=…, but SASL is not enabled on the Kafka listener (all services connect to redpanda:9092 without auth). With credentials rpk starts a SASL handshake and the broker answers ILLEGAL_SASL_STATE: Request is not valid given the current SASL state.

  • compose.yml: healthcheck is rpk cluster info without credentials
  • tests/smoke.sh: fails when any healthcheck has failed 3+ probes in a row. Docker only flips to unhealthy after retries failures (100s for redpanda), which the smoke run finished before, so checking the status alone missed it.

CI: with only the new check (7995c5c) the run fails with healthcheck failing: redpanda … ILLEGAL_SASL_STATE; with the fix (ce49c80) it is green.

REDPANDA_SUPERUSER_* / REDPANDA_ADMIN_* are left as they are: they only matter if SASL gets enabled, which would also need credentials in every service's QUEUE_CONFIG.

🤖 Generated with Claude Code

https://claude.ai/code/session_012bF628vAWVF7d1gqS2bQwG


Generated by Claude Code

ArtyomSavchenko and others added 3 commits September 29, 2026 11:55
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_012bF628vAWVF7d1gqS2bQwG
Signed-off-by: Artem Savchenko <armisav@gmail.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_012bF628vAWVF7d1gqS2bQwG
Signed-off-by: Artem Savchenko <armisav@gmail.com>
SASL is not enabled on the Kafka listener (services connect to
redpanda:9092 without auth). rpk with -X user/pass starts a SASL handshake,
the broker answers ILLEGAL_SASL_STATE, and the container was always
unhealthy although the broker worked. Probe without credentials.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_012bF628vAWVF7d1gqS2bQwG
Signed-off-by: Artem Savchenko <armisav@gmail.com>
@ArtyomSavchenko
ArtyomSavchenko merged commit 42fdd73 into main Sep 29, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant