👍

New Features in v1.25!

• Databricks Runtime Update: Databricks has been upgraded to v14.3 for greater performance and functionality across Empower v1.25! View the changelog here. This runtime has demonstrated large speed improvements, such as up to 2x faster User Defined Functions and new Predictive I/O read capability for extremely fast reads.
• Metadata Catalog Updates: Now found on the Data Sources page, with new support for TableName (readonly) and WhereQueryPart fields. See our user guides for information on how to configure metadata.
• Advanced Options Upgrades: New filter and performance enhancements in the Advanced Options tables. Automated pagination on log tables enables support for extremely large logs.

📘

Metadata Catalog Updates

Metadata Catalogs are now viewable directly from the Data Source page, in addition to the Data Acquisition Page. As we start to rollout Data Flow's in the upcoming releases, our modifications to Empower's UI will enhance the user experience and provide greater self-service capability.

You can now view the TableName for objects (readonly) and define WhereQueryPart SQL statements for extraction. See our user guides for information on how to configure metadata.

📘

Advanced Options Upgrades

A highly requested feature, log tables in Advanced Options are now paginated (Object Extract, Object Ingest, and Object Model).

Log tables in Advanced Options are also ordered by Start Time in descending order -- meaning that the most recent log entries will appear at the top.

Entity: filter support for models.

Entity Column: filter support for models and entities.

Entity Dependency: filter support for models.

🚧

Notable Fixes

• Description field added to objects extracted from Dynamics FO via Synapse Link sources.
• Updated default logos for data sources and enterprises .
• Power BI System Reporting now properly displays in all environments.
• Data Migration comment box now moved to the bottom of the page for a better experience.

Itemized Changelog

Enhancements & New Features

• Updated Databricks Instance Pools to version 14.3 for Empower Spark.
• Modified policy to accommodate interactive computing with Dockerize Spark.
• Removed keycloak/empower-enterprise from Helm chart in version 1.25 to streamline Terraforms & Kubernetes deployments.
• Updated Textera to format timestamp columns to Spark type for better data handling.
• Enhanced Empower Spark with cleanups and improvements.
• Removed legacy environment variables from Data API as part of technical debt cleanup.
• Added Append-Only Mode to DDU for improved data management.
• Refined Connector Refactor by cleaning up the SourceBuilder base class and updating the network client.
• Supported a string datatype for the key column in DDU, enhancing flexibility.
• Removed the PyDantic dependency as part of technical debt reduction.
• Improved unit testing for Model Builder and added a retry policy to the Empower Client for enhanced reliability.
• Added a "description" field to objects extracted from Dynamics FO via Synapse Link.
• Updated default logos for sources and enterprises.
• Enabled updating enterprise logo via a new endpoint, enhancing brand customization.
• Included changes to payloads after QA feedback for better data handling.
• Filtered Source Type return based on active status.
• Added group endpoints to RBAC for enhanced security.
• Implemented server-side support for pagination and updated various API endpoints to support new features like Delta Ingestion and table name fields.
• Removed old KC client from Empower API service for cleaner architecture.
• Created a new endpoint for publishing entities by flow, improving data management.
• Implemented searchable dropdowns and updated tables to support PaginatedHttpService for better user experience in Advanced Options.
• Added support for filtering to various Entity pages and implemented UX support for pagination.
• Enhanced Metadata Catalog with support for readonly TableName
• Added polling to Flows pages for real-time log/status updates.
• Moved the 'Comment' section of config promo for better user interface design.

Bugfixes

• Fixed Power BI reports not displaying in System Reporting.
• Resolved issues with surrogate keys not being created when capitalized in Model Builder.
• Addressed Object Ingest failures and metadata extraction overwrites in CoreData.
• Fixed Dynamics publishing failure and various extract issues with Workday Raas, MariaDB, and AOD.
• Corrected Azure Devops connector errors and other data extraction and publishing issues.
• Fixed bulk load failure, broken user sign-in links, and image errors.
• Resolved UI issues including misaligned icons, visual glitches, and dropdown behavior across Empower UI.
• Addressed sorting issues in Object Ingest, Extract, and Model tables in Core API.
• Fixed filter dropdown reset and added globalId support for Data Flows.
• Corrected various UI issues in Advanced Options, Data Sources, and Flow Scheduling.