fix: Prevent Pod 0 restart by utilizing mutating webhook

[sbernauer]

Description

Fixes #111

Many parts copied from https://github.com/stackabletech/commons-operator/tree/spike/sts-restarter-webhook

This bumps to operator-rs 0.101.1, but we don't have any objectOverrides to implement here.

Co-authored-by: Natalie Klestrup Röijezon nat@nullable.se

Definition of Done Checklist

• Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant
• Please make sure all these things are done and tick the boxes

Author

• Changes are OpenShift compatible
• CRD changes approved
• CRD documentation for all fields, following the style guide.
• Helm chart can be installed and deployed operator works
• Integration tests passed (for non trivial changes)
• Changes need to be "offline" compatible
• Links to generated (nightly) docs added
• Release note snippet added

Reviewer

• Code contains useful comments
• Code contains useful logging statements
• (Integration-)Test cases added
• Documentation added or updated. Follows the style guide.
• Changelog updated
• Cargo.toml only contains references to git tags (not specific commits or branches)

Acceptance

• Feature Tracker has been updated
• Proper release label has been added
• Links to generated (nightly) docs added
• Release note snippet added
• Add type/deprecation label & add to the deprecation schedule
• Add type/experimental label & add to the experimental features tracker

[dervoeti]

Nice, LGTM!

My tests worked as expected. One thing I found was that with airflow-operator the behavior is still the same (Pod 0 gets restarted), I believe this is because airflow-operator creates the ConfigMap after the StatefulSet: https://github.com/stackabletech/airflow-operator/blob/39d98ecd67a7bf29753551e01217faefafb53220/rust/operator-binary/src/airflow_controller.rs#L604-L628

So this could be a follow-up PR for airflow-operator. With superset-operator it worked fine.

[sbernauer]

I believe this is because airflow-operator creates the ConfigMap after the StatefulSet

Correct, we will change that :)

[sbernauer]

@dervoeti created stackabletech/superset-operator#694 and stackabletech/airflow-operator#734