Skip to Content

Release Notes v2.9.x

The 2.9.x series introduces Web UI full support for stateless transformations and revamped pipelines list and creation wizard. This release focuses on improving the day-to-day experience of creating and managing pipelines, with clearer navigation and better validation.

Version History

  • v2.9.2 β€” Patch release with bug fixes and default behavior updates
  • v2.9.1 β€” Patch release with filter and deduplication component fixes
  • v2.9.0 β€” Pipeline list and wizard revamp, transformations and filter improvements

What’s New

πŸ”„ Stateless Transformations and Filters full support on the web UI

Stateless transformations and filters are now enabled on the web UI:

  • Remove feature flag for filters and transformations β€” Filters and transformations are now enabled by default on the web UI
  • Transformations β€” Stateless transformations are now fully supported in the web UI

πŸ“‹ Revamped Pipelines List

The pipelines list has been redesigned for a clearer overview and easier actions:

  • Cleaner layout β€” Updated table and card presentation with consistent styling
  • Copy pipeline ID β€” Quick copy of pipeline ID from the list
  • Status filtering β€” Filter pipelines by status
  • Streamlined actions β€” Simplified action buttons and navigation

πŸ”§ Transformation Configurator Improvements

The transformation configurator has been reworked for clarity and flexibility:

  • Concatenation builder β€” New builder for string concatenation expressions
  • Waterfall support β€” Support for waterfall-style functions and a more capable complex expression builder
  • Raw expression mode β€” Manual input and raw expression mode for advanced expressions
  • Expression mode fixes β€” Correct handling of various functions and fractional values in expression mode
  • Error feedback β€” Expandable panel to inspect transformation expression errors
  • Event editing β€” Event modifications at the type verification step; modified schema can be used as the source of truth for downstream steps, including when a schema is already present

πŸ” Filter Builder Revamp

The filter builder has been improved for reliability and flexibility:

  • Condition chaining β€” Filter conditions chain correctly
  • Manual input β€” Option to enter filter expressions manually

πŸ—ΊοΈ Pipeline Configuration Upload

You can upload a pipeline configuration instead of building it step-by-step:

  • Upload option β€” New option in the wizard to upload a pipeline JSON configuration file
  • Hydration β€” Uploaded config is hydrated so the wizard reflects the full configuration
  • Validation β€” Validation and error handling for uploaded configs

πŸ—‚οΈ Auto Mapping and Schema Handling

  • Auto mapping on demand β€” Auto mapping can be triggered at the mapping step when needed
  • Type verification β€” Event editing at the type verification step; modified schema is used as the source of truth for downstream steps

πŸ†• Patch Releases: v2.9.1 and v2.9.2

v2.9.1

  • Filter-only pipelines β€” Kubernetes orchestrator now enables the deduplication component when only filtering is enabled (no deduplication), so filter-only pipelines run correctly

v2.9.2

  • Sink read path β€” Fixed sink reading from the transform component when only filtering is enabled
  • Pipeline config generation β€” Fixed pipeline config generation to correctly include transformation expressions
  • Event fetching β€” Improved error display when reaching end-of-topic while fetching events
  • Config upload β€” Fixed pipeline config upload failing silently after hydration
  • Field mapper β€” Fixed search field alignment in the field mapper
  • Validation β€” Improved validation for topic selection and deduplication, with clearer error messages and correct submit button state when valid
  • UI β€” Styling changes to consolidate look and feel; new searchable select component (reused in transformation field select); fixed transformation select positioning; fixed help menu in light mode; ClickHouse mapper draft state preserved when revisiting the step; smart navigation with resume step and skipped event fetching when revisiting the Kafka selection form

Migration Notes

For Existing Users

  • No breaking changes β€” This release is fully backward compatible
  • Filter-only pipelines β€” Pipelines with only a filter (no deduplication) now correctly start the deduplication component; no config change needed

Configuration Updates

  • Filters β€” Default for NEXT_PUBLIC_FILTERS_ENABLED is now true in the UI
  • Transformations β€” Default for NEXT_PUBLIC_TRANSFORMATIONS_ENABLED is now true in the UI
  • Helm and build β€” No new required Helm values; build and image options updated for multi-arch and standalone output

Try It Out

To try the new features in v2.9.x:

  1. Deploy the latest version using our Kubernetes Helm charts
  2. Create a pipeline with transformations β€” Use the transformation configurator in the wizard (enabled by default)
  3. Use the revamped pipelines list β€” Filter by status, copy pipeline IDs, and use the new actions
  4. Upload a config β€” Upload an existing pipeline JSON from the creation flow

Full Changelog

For a complete list of changes, improvements, and bug fixes in the v2.9.x series, see the GitHub releases:

GlassFlow v2.9.x continues our commitment to making streaming ETL easier to configure, monitor, and operate for technical users and teams.

Last updated on