📘

What is a Data Source?

Data sources define the external locations from where data will be ingested into your Empower deployment. You can create Connections to Data Sources within Empower to contain the credentials and settings to sync data back to your Lakehouse.

Creating a new Data Source Connection

Navigate to the data sources tab on the left side of the screen. Click "+" to bring up the New Connection configuration screen.

Select the desired data source type from the list. Use the search bar at the top of the configuration screen to quickly find any supported data source.

After selecting the source type, fill out the fields required for this connection. Each source type has its own required configuration, so be sure to double check the fields for accuracy.

When all fields have been filled, click "Save and Test" to advance.

Defining Custom Bronze and Silver Schemas

Define custom bronze and silver schemas at the data source connection level.

🚧

You must define these fields BEFORE your first acquisition on this source!

If you define these fields BEFORE your initial acquisition, Empower will respect these fields and bring data into the schemas you have defined.

If you MODIFY these fields after your initial acquisition, they will be ignored!

Bronze and Silver schemas define the raw and current locations of this data source connection's objects and fields. Bronze and Silver schemas are defined by the following rules:

• Bronze
  • The value of the Bronze Schema field, if present.
  • Defaults to "(Display Name)".
• Silver
  • The value of the Silver Schema field, if present.
  • Defaults to "(Display Name)_silver".

Modifying an existing Data Source connection

Much like creating a new data source, modifying an existing source involves navigating to the Data Source page.

Select the data source you want to modify from the data source connection list. You will then see that data source's connection field details displayed to the right side of it.

Feel free to modify any of these values as you wish (or leave as is if you only want to view them). Make sure to press "Save and Test" to save any changes!

What happens under the hood?

• Your connection details will be saved for this source
• Empower will automatically test your connection for this data source if applicable.
  • If applicable, you may receive a testing status message on the page in a few moments. If this connection test fails, be sure to double check your connection details for accuracy.
  • Your connection details will be saved and you may attempt to extract metadata from this data source.

Archiving a Data Source

You may elect to archive a data source that you no longer wish to use.

🚧

You cannot extract data from Archived Data Sources!

In order to modify, trigger, or schedule data extraction from an archived data source, you must restore it first!

In the upper right corner of any selected data source, you can click on "..." to bring up a list of options.

Upon a successful Data Source archiving, you will see the an alert similar to the following on your screen:

🚧

Archive and Associated Data Flows

Archiving a data source will automatically archive any associated data flows. This means that these flows will not run when scheduled! You may not restore any archived data flows when their data source is still archived.

Restoring a Data Source Connection

You may wish to restore an archived data source conection. This is easily done by navigating to the desired Data Source and clicking "Restore" in the upper right hand corner.

Upon a successful Data Source restoration, an alert will appear on your screen.

Deleting a Data Source

Similar to archiving, navigate to the desired Data Source and click "..." to bring up a list of options.

Click on "Delete" to initiate the deletion action for this data source. Deletion is a permanent action! Once you delete a data source, you cannot restore it.

If you wish to proceed with deletion, confirm by clicking "Delete".

🚧

Deletion and Associated Data Flows

Deleting a data source will automatically permanently archive all associated data flows! This action will be irreversible!

Please consider archiving a data source instead if you anticipate wanting to restore any associated data flow.