Empower Data Platform v1.40

๐Ÿ‘

Key Changes and Improvements

We have A LOT of great updates coming out in v1.40:

  • Self-Service Error Reset: You can now reset acquisition tasks on your own from the Dashboard module.
  • Email Notifications (BETA): Beta rollout of email notifications for key events and workflows.
  • Fivetran Connections GA: Fivetran Connections are now generally available. 100+ new connections are now instantly available for all in the Connections module!
  • Task Page Redesigns - Task pages have been redesigned from card-based to table-based layouts.(excluding Extend, coming soon!)
  • Model Entity Navigation Update: Modeling has been moved out of the Transform section into its own top-level menu item for better discoverability.
  • Transform Task Autocomplete: Model fields now autocomplete when configuring transform tasks for ease of use.
  • Improved Task Visibility on Connect Pages: Associated tasks are now shown in an accordion view for better clarity and navigation.

Empower Data Platform v1.39

๐Ÿ‘

Key Changes and Improvements

Empower v1.39 introduces powerful new features and usability improvements to help you manage your data estate with greater visibility and control.

  • New Health & Performance Dashboard: Get a high-level view of task and workflow health, object acquisitions, and runtime performanceโ€”all in one place.
  • Streamlined Navigation Menu: A redesigned sidepane makes it faster and easier to move across key Empower modules.
  • Metadata Catalog Bulk Editing: Save time by editing multiple metadata fields across many objects at once.
  • Fivetran Connect Cards (Private Preview): Start exploring our upcoming Fivetran integrationsโ€”available to early access users by request.

This release focuses on usability, insight, and efficiency. Dive into the details in the sections below or check out the docs to learn more.

Empower Data Platform v1.38

๐Ÿ‘

Key Changes & Improvements

  • Quick Help - In-App Documentation: Instantly access page-specific documentation guides directly within Empower via a new help button.
  • Change Tracking for SQL Server and Azure SQL DB: The ability to choose change tracking as the merge strategy from the metadata catalog for SQL Server and Azure SQL DB connections.
  • Group Role Assignment: RBAC functionality has been expanded by enabling the assignment of roles to entire user groups, simplifying role management and accelerating user onboarding.
  • View Trace Link for Errors: Easily debug the root cause of errors with a new "View Trace" link included directly within error message pop-up, providing quick access to detailed trace information.
  • DB2 Self-Service Connector: You can now setup DB2 connections from the Empower UI.

Empower Data Platform v1.37

๐Ÿ‘

Key Changes & Improvements

  • Batch and Cluster Configuration: Users with advanced options enabled can now choose to enable batch extraction and configure clusters for Data Flows.
  • Transform Flows - Skipped Status Support: Improved the Transform run history logs by clearly distinguishing entities that are skipped due to a predecessor's failure to enhance root cause identification and debugging efficiency.
  • Connection Schema Name Validation: Added validation to entering the same name for Bronze and Silver schema inputs when setting up a connection to avoid downstream failures.
  • Redshift Self-Service Connector: You can now setup Redshift connections from the Empower UI.
  • OneDrive Self-Service Connector: You can now setup OneDrive connections from the Empower UI.
  • Connector Support for Excel Files: Support for Excel files (.xls and .xlsx) has been added to the Sharepoint, AWS S3, SFTP connectors.

Empower Data Platform v1.36

๐Ÿ‘

Key Changes & Improvements

Note that due to the holidays, work for versions 1.35 and 1.36 has been combined into a single release: 1.36.

  • PowerBI Support for Publishing Data Flows: Empower now allows you to refresh a PowerBI dataset directly from the UI when adding a Publish step using Workflows and Data Flows.
  • Menu & Naming Convention Enhancements: Key changes have been made to naming conventions and menu navigation for improved intuitiveness, including a direct link to documentation and an improved menu collapse button.
  • Workflows Enhancements: A new "Runs" tab has been added to the Workflows Overview screen, providing a complete list of all runs along with detailed information about each workflow step. We've also added filtering and tooltips to make navigation use even easier.
  • Cornerstone Self-Service Connector: You can now setup Cornerstone connections from the Empower UI.
  • AWS S3 Bucket Self-Service Connector: You can now setup AWS S3 Bucket connections from the Empower UI.
  • SFTP Connector Enhancement - Support for CSV and JSON files: The SFTP connector now supports the ingestion of both CSV and JSON files.
  • Databricks Connector Enhancement - New Auth Type Option: A new authentication option using OAuth with a service principal has been added for Azure Databricks access.

Empower Data Platform v1.34

๐Ÿ‘

Key Changes and Improvements

  • Workflows: Create complete end-to-end data pipeline with ease from the Empower UI.
  • SharePoint Self-Service Connector: You can now setup Microsoft SharePoint connections from the Empower UI.
  • FTP Server Self-Service Connector: You can now setup FTP server connections from the Empower UI.

Empower Data Platform v1.33

๐Ÿ‘

Key Changes and Improvements

  • Publishing Flow Monitoring and Logging: Data publishing flows now provide robust logging with entity-by-entity run status granularity.
  • Data Flow Run Details Filtering & Search: Advanced filtering capabilities added to the object/entity details table in data flow run details views.
  • Metadata Catalog Merge Strategies: Users can now choose a merge strategy from the metadata catalog on a per-object level for tailored data ingestion.
  • Flow Error Upgrades: Two large improvements: stack trace URL links to debug Azure services and providing error messages at a global flow level for easier debugging and triage.
  • Databricks - Self-Service Connector: You can now setup Databricks Unity Catalog connections from the Empower UI.

Empower Data Platform v1.32

๐Ÿ‘

Key Changes and Improvements

  • Analytics Engineering Monitoring: Analytics Engineering monitoring is now possible from the flow log page, giving an entity-by-entity breakdown of the run status.
  • Interactive Cluster Support: Empower now supports interactive cluster configuration in addition to job clusters for certain phases in load group pipelines to support large data movement requirements.
  • Microsoft Entra - Self Service Connector: New in the UI, you can now setup connections to Microsoft Entra, a comprehensive identity and access management (IAM) solution.
  • System Reporting Page Deprecation: We will be removing the System Reporting page in the UI as part of the v1.32 release as we continue to roll out new monitoring and logging features. Stay tuned for more updates in this space!

Empower Data Platform v1.31

๐Ÿ‘

Key Changes and Improvements

  • Data Acquisition Flow Monitoring and Logging: You can now observe historical and currently-running data acquisition flows in an intuitive way! Visit the docs to learn more about how to use this new feature in your deployment.
  • BETA Custom Flows: Empower now allows for more flexibility than ever before. Want to execute a notebook on a schedule? You can now configure custom flows to do just that! Visit the docs to learn more about how to use this new feature in your deployment.

Empower Data Platform v1.30

๐Ÿ‘

Key Changes and Improvements

  • Dynamics FO & CE Publishing: These two sources are now also available as data targets for publishing data for both Publishing Flows and in Advanced Options with Load Groups.
  • Metadata Catalog Object Options: Inside a source's Metadata Catalog, a new column is available that allows key-value pairs to define custom acquisition configuration on an object-by-object basis.
  • Model Building Improvements: Missing values and ghost records are automatically handled for you within Model - Entity Column by default upon Model - Entity buildout. Direct SQL also now supports incremental entity buildout. See below for more details.