Analytics Engineering Monitoring: Analytics Engineering monitoring is now possible from the flow log page, giving an entity-by-entity breakdown of the run status.
Interactive Cluster Support: Empower now supports interactive cluster configuration in addition to job clusters for certain phases in load group pipelines to support large data movement requirements.
Microsoft Entra - Self Service Connector: New in the UI, you can now setup connections to Microsoft Entra, a comprehensive identity and access management (IAM) solution.
System Reporting Page Deprecation: We will be removing the System Reporting page in the UI as part of the v1.32 release as we continue to roll out new monitoring and logging features. Stay tuned for more updates in this space!
Data Acquisition Flow Monitoring and Logging: You can now observe historical and currently-running data acquisition flows in an intuitive way! Visit the docs to learn more about how to use this new feature in your deployment.
BETACustom Flows : Empower now allows for more flexibility than ever before. Want to execute a notebook on a schedule? You can now configure custom flows to do just that! Visit the docs to learn more about how to use this new feature in your deployment.
Dynamics FO & CE Publishing: These two sources are now also available as data targets for publishing data for both Publishing Flows and in Advanced Options with Load Groups.
Metadata Catalog Object Options: Inside a source's Metadata Catalog, a new column is available that allows key-value pairs to define custom acquisition configuration on an object-by-object basis.
Model Building Improvements: Missing values and ghost records are automatically handled for you within Model - Entity Column by default upon Model - Entity buildout. Direct SQL also now supports incremental entity buildout. See below for more details.
Analytics Engineering Entity Graphs: You can now visualize and manipulate entity dependencies for Analytics Engineering flows using our new graph interface. Create new nodes, edit existing connections, and remove obsolete dependencies in a new experience! View the documentation to learn more about dependencies.
New Self-Service AEC Connectors!: View our Source System Support page for details on all of our supported data source types. This release, we've expanded our Architecture-Engineering-Construction source type set with the following connectors:
Metadata Catalog Default Behavior Change: New objects discovered during all new metadata extractions will no longer be enabled by default. This change occurs for all new and existing data source connections you manage in your deployment.
Empower for Dynamics Accelerator Notebooks: Empower now ships with notebooks to assist Empower for Dynamics integrations. See the notebook documentation here.
Public Preview - Direct SQL Staging: We are publicly previewing a new feature in our model building process. You can write a SQL statement directly within a Databricks .SQL file, specify the filename in the Entity's notebook column, and the query will be run during entity buildout.
New Self-Service AEC Connectors! View our Source System Support page for details on all of our supported data source types. This release, we've expanded our Architecture-Engineering-Construction source type set with the following connectors:
Metadata Catalog UI has been enhanced with bulk edit object enablement/disablement. The Enable column has also been shifted farther left for easier manipulation. Read our Metadata Catalogs page for more.
Databricks Runtime Update: Databricks has been upgraded to v14.3 for greater performance and functionality across Empower v1.25! View the changelog here. This runtime has demonstrated large speed improvements, such as up to 2x faster User Defined Functions and new Predictive I/O read capability for extremely fast reads.
Metadata Catalog Updates: Now found on the Data Sources page, with new support for TableName (readonly) and WhereQueryPart fields. See our user guides for information on how to configure metadata.
Advanced Options Upgrades: New filter and performance enhancements in the Advanced Options tables. Automated pagination on log tables enables support for extremely large logs.
Data Source UI Improvements : Metadata Catalogs are now viewable directly from the Data Source page. Quickly configure global acquisition settings with fewer clicks!
Change Feed Ingestion Support: Empower's ingestion engine can now support Change Data style merges. Note, this feature is still in private preview!
Configuration Migration Improvements: You can now migrate archived data source credentials too.
New Data Connectors: Azure DevOps is now available from the UI. Connect, explore, and unleash your data's full potential!
