Empower Data Platform v1.37
13 days ago by [email protected]
Key Changes & Improvements
- Batch and Cluster Configuration: Users with advanced options enabled can now choose to enable batch extraction and configure clusters for Data Flows.
- Transform Flows - Skipped Status Support: Improved the Transform run history logs by clearly distinguishing entities that are skipped due to a predecessor's failure to enhance root cause identification and debugging efficiency.
- Connection Schema Name Validation: Added validation to entering the same name for Bronze and Silver schema inputs when setting up a connection to avoid downstream failures.
- Redshift Self-Service Connector: You can now setup Redshift connections from the Empower UI.
- OneDrive Self-Service Connector: You can now setup OneDrive connections from the Empower UI.
- Connector Support for Excel Files: Support for Excel files (.xls and .xlsx) has been added to the Sharepoint, AWS S3, SFTP connectors.
Empower Data Platform v1.36
3 months ago by [email protected]
Key Changes & Improvements
Note that due to the holidays, work for versions 1.35 and 1.36 has been combined into a single release: 1.36.
- PowerBI Support for Publishing Data Flows: Empower now allows you to refresh a PowerBI dataset directly from the UI when adding a Publish step using Workflows and Data Flows.
- Menu & Naming Convention Enhancements: Key changes have been made to naming conventions and menu navigation for improved intuitiveness, including a direct link to documentation and an improved menu collapse button.
- Workflows Enhancements: A new "Runs" tab has been added to the Workflows Overview screen, providing a complete list of all runs along with detailed information about each workflow step. We've also added filtering and tooltips to make navigation use even easier.
- Cornerstone Self-Service Connector: You can now setup Cornerstone connections from the Empower UI.
- AWS S3 Bucket Self-Service Connector: You can now setup AWS S3 Bucket connections from the Empower UI.
- SFTP Connector Enhancement - Support for CSV and JSON files: The SFTP connector now supports the ingestion of both CSV and JSON files.
- Databricks Connector Enhancement - New Auth Type Option: A new authentication option using OAuth with a service principal has been added for Azure Databricks access.
Empower Data Platform v1.34
5 months ago by [email protected]
Key Changes and Improvements
- Workflows: Create complete end-to-end data pipeline with ease from the Empower UI.
- SharePoint Self-Service Connector: You can now setup Microsoft SharePoint connections from the Empower UI.
- FTP Server Self-Service Connector: You can now setup FTP server connections from the Empower UI.
Empower Data Platform v1.33
5 months ago by [email protected]
Key Changes and Improvements
- Publishing Flow Monitoring and Logging: Data publishing flows now provide robust logging with entity-by-entity run status granularity.
- Data Flow Run Details Filtering & Search: Advanced filtering capabilities added to the object/entity details table in data flow run details views.
- Metadata Catalog Merge Strategies: Users can now choose a merge strategy from the metadata catalog on a per-object level for tailored data ingestion.
- Flow Error Upgrades: Two large improvements: stack trace URL links to debug Azure services and providing error messages at a global flow level for easier debugging and triage.
- Databricks - Self-Service Connector: You can now setup Databricks Unity Catalog connections from the Empower UI.
Empower Data Platform v1.32
6 months ago by [email protected]
Key Changes and Improvements
- Analytics Engineering Monitoring: Analytics Engineering monitoring is now possible from the flow log page, giving an entity-by-entity breakdown of the run status.
- Interactive Cluster Support: Empower now supports interactive cluster configuration in addition to job clusters for certain phases in load group pipelines to support large data movement requirements.
- Microsoft Entra - Self Service Connector: New in the UI, you can now setup connections to Microsoft Entra, a comprehensive identity and access management (IAM) solution.
- System Reporting Page Deprecation: We will be removing the System Reporting page in the UI as part of the v1.32 release as we continue to roll out new monitoring and logging features. Stay tuned for more updates in this space!
Empower Data Platform v1.31
7 months ago by [email protected]
Key Changes and Improvements
- Data Acquisition Flow Monitoring and Logging: You can now observe historical and currently-running data acquisition flows in an intuitive way! Visit the docs to learn more about how to use this new feature in your deployment.
BETA
Custom Flows: Empower now allows for more flexibility than ever before. Want to execute a notebook on a schedule? You can now configure custom flows to do just that! Visit the docs to learn more about how to use this new feature in your deployment.
Empower Data Platform v1.30
9 months ago by [email protected]
Key Changes and Improvements
- Dynamics FO & CE Publishing: These two sources are now also available as data targets for publishing data for both Publishing Flows and in Advanced Options with Load Groups.
- Metadata Catalog Object Options: Inside a source's Metadata Catalog, a new column is available that allows key-value pairs to define custom acquisition configuration on an object-by-object basis.
- Model Building Improvements: Missing values and ghost records are automatically handled for you within Model - Entity Column by default upon Model - Entity buildout. Direct SQL also now supports incremental entity buildout. See below for more details.
Empower Data Platform v1.29
10 months ago by [email protected]
Key Changes and Improvements
- Analytics Engineering Entity Graphs: You can now visualize and manipulate entity dependencies for Analytics Engineering flows using our new graph interface. Create new nodes, edit existing connections, and remove obsolete dependencies in a new experience! View the documentation to learn more about dependencies.
- New Self-Service AEC Connectors!: View our Source System Support page for details on all of our supported data source types. This release, we've expanded our Architecture-Engineering-Construction source type set with the following connectors:
- Metadata Catalog Default Behavior Change: New objects discovered during all new metadata extractions will no longer be enabled by default. This change occurs for all new and existing data source connections you manage in your deployment.
- Empower for Dynamics Accelerator Notebooks: Empower now ships with notebooks to assist Empower for Dynamics integrations. See the notebook documentation here.
- Public Preview - Direct SQL Staging: We are publicly previewing a new feature in our model building process. You can write a SQL statement directly within a Databricks .SQL file, specify the filename in the Entity's notebook column, and the query will be run during entity buildout.
Empower Data Platform v1.28
10 months ago by [email protected]
Key Changes and Improvements
- New Self-Service AEC Connectors! View our Source System Support page for details on all of our supported data source types. This release, we've expanded our Architecture-Engineering-Construction source type set with the following connectors:
- Metadata Catalog UI has been enhanced with bulk edit object enablement/disablement. The Enable column has also been shifted farther left for easier manipulation. Read our Metadata Catalogs page for more.
Empower Data Platform v1.27
11 months ago by [email protected]
Key Changes and Improvements
- Enterprise Logo Management: Administrators can now upload a new logo for their enterprise, expanding self-service capability to brand management.
- Data Flows & Sources Quality of Life Updates: We have improved the user experience for Flows and Sources based on feedback.