-
Notifications
You must be signed in to change notification settings - Fork 92
pipeline-manager: pipeline_template in config #5356
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
This PR adds support for users to specify a custom pipeline template name in the runtime configuration. The template is expected to be stored in a Kubernetes ConfigMap and will be used instead of the default template when deploying pipelines as StatefulSets.
- Adds a new optional
pipeline_template_namefield toRuntimeConfig - Updates all instantiations of
RuntimeConfigto include the new field set toNone - Propagates the field through the controller initialization
Reviewed changes
Copilot reviewed 4 out of 4 changed files in this pull request and generated no comments.
| File | Description |
|---|---|
| crates/feldera-types/src/config.rs | Adds pipeline_template_name field to RuntimeConfig struct with documentation and updates Default implementation |
| crates/pipeline-manager/src/db/test.rs | Updates test helper function to include pipeline_template_name: None in runtime config construction |
| crates/pipeline-manager/src/api/examples.rs | Updates example pipeline descriptor to include pipeline_template_name: None |
| crates/adapters/src/controller.rs | Propagates pipeline_template_name from global config to controller initialization |
e861090 to
3c3ec93
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
Copilot reviewed 5 out of 5 changed files in this pull request and generated 3 comments.
3c3ec93 to
f0430eb
Compare
f0430eb to
b8e395f
Compare
1ed291d to
a6b304f
Compare
2cbef6d to
849eacd
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
Copilot reviewed 6 out of 6 changed files in this pull request and generated 1 comment.
849eacd to
e54ab0d
Compare
Allow pipelines to specify a ConfigMap name and key in their config, which holds the StatefulSet template used for pipeline deployment Signed-off-by: Swanand Mulay <[email protected]>
e54ab0d to
326597e
Compare
allow users to specify custom pipeline template to be used for statefulset
Checklist
Breaking Changes?
Optional field in config, should not be breaking change