Release Notes v2.9.x
The 2.9.x series introduces Web UI full support for stateless transformations and revamped pipelines list and creation wizard. This release focuses on improving the day-to-day experience of creating and managing pipelines, with clearer navigation and better validation.
Version History
- v2.9.2 β Patch release with bug fixes and default behavior updates.
- v2.9.1 β Patch release with filter and deduplication component fixes.
- v2.9.0 β Pipeline list and wizard revamp, transformations and filter improvements.
Whatβs New
π Stateless Transformations and Filters full support on the web UI
Stateless transformations and filters are now enabled on the web UI:
- Remove feature flag for filters and transformations β Filters and transformations are now enabled by default on the web UI.
- Transformations β Stateless transformations are now fully supported in the web UI.
π Revamped Pipelines List
The pipelines list has been redesigned for a clearer overview and easier actions:
- Cleaner layout β Updated table and card presentation with consistent styling.
- Copy pipeline ID β Quick copy of pipeline ID from the list.
- Status filtering β Filter pipelines by status.
- Streamlined actions β Simplified action buttons and navigation.
π§ Transformation Configurator Improvements
The transformation configurator has been reworked for clarity and flexibility:
- Concatenation builder β New builder for string concatenation expressions.
- Waterfall support β Support for waterfall-style functions and a more capable complex expression builder.
- Raw expression mode β Manual input and raw expression mode for advanced expressions.
- Expression mode fixes β Correct handling of various functions and fractional values in expression mode.
- Error feedback β Expandable panel to inspect transformation expression errors.
- Event editing β Event modifications at the type verification step; modified schema can be used as the source of truth for downstream steps, including when a schema is already present.
π Filter Builder Revamp
The filter builder has been improved for reliability and flexibility:
- Condition chaining β Filter conditions chain correctly.
- Manual input β Option to enter filter expressions manually.
πΊοΈ Pipeline Configuration Upload
You can upload a pipeline configuration instead of building it step-by-step:
- Upload option β New option in the wizard to upload a pipeline JSON configuration file.
- Hydration β Uploaded config is hydrated so the wizard reflects the full configuration.
- Validation β Validation and error handling for uploaded configs.
ποΈ Auto Mapping and Schema Handling
- Auto mapping on demand β Auto mapping can be triggered at the mapping step when needed.
- Type verification β Event editing at the type verification step; modified schema is used as the source of truth for downstream steps.
π Patch Releases: v2.9.1 and v2.9.2
v2.9.1
- Filter-only pipelines β Kubernetes orchestrator now enables the deduplication component when only filtering is enabled (no deduplication), so filter-only pipelines run correctly.
v2.9.2
- Sink read path β Fixed sink reading from the transform component when only filtering is enabled.
- Pipeline config generation β Fixed pipeline config generation to correctly include transformation expressions.
- Event fetching β Improved error display when reaching end-of-topic while fetching events.
- Config upload β Fixed pipeline config upload failing silently after hydration.
- Field mapper β Fixed search field alignment in the field mapper.
- Validation β Improved validation for topic selection and deduplication, with clearer error messages and correct submit button state when valid.
- UI β Styling changes to consolidate look and feel; new searchable select component (reused in transformation field select); fixed transformation select positioning; fixed help menu in light mode; ClickHouse mapper draft state preserved when revisiting the step; smart navigation with resume step and skipped event fetching when revisiting the Kafka selection form.
Migration Notes
For Existing Users
- No breaking changes β This release is fully backward compatible.
- Filter-only pipelines β Pipelines with only a filter (no deduplication) now correctly start the deduplication component; no config change needed.
Configuration Updates
- Filters β Default for
NEXT_PUBLIC_FILTERS_ENABLEDis nowtruein the UI. - Transformations β Default for
NEXT_PUBLIC_TRANSFORMATIONS_ENABLEDis nowtruein the UI. - Helm and build β No new required Helm values; build and image options updated for multi-arch and standalone output.
Try It Out
To try the new features in v2.9.x:
- Deploy the latest version using our Kubernetes Helm charts.
- Create a pipeline with transformations β Use the transformation configurator in the wizard (enabled by default).
- Use the revamped pipelines list β Filter by status, copy pipeline IDs, and use the new actions.
- Upload a config β Upload an existing pipeline JSON from the creation flow.
Full Changelog
For a complete list of changes, improvements, and bug fixes in the v2.9.x series, see the GitHub releases:
GlassFlow v2.9.x continues our commitment to making streaming ETL easier to configure, monitor, and operate for technical users and teams.