Data Sources

Creating new or modifying data source connections in the UI

📘

What is a Data Source?

Data sources define the external locations from where data will be ingested into your Empower deployment. You can create Connections to Data Sources within Empower to contain the credentials and settings to sync data back to your Lakehouse.

Creating a new Data Source Connection

Navigate to the data sources tab on the left side of the screen. Click "+" to bring up the New Connection configuration screen.

1915

Data Sources Menu Item

Select the desired data source type from the list. Use the search bar at the top of the configuration screen to quickly find any supported data source.

1919

Selecting a new source

After selecting the source type, fill out the fields required for this connection. Each source type has its own required configuration, so be sure to double check the fields for accuracy.

1919

Setting the selected source

When all fields have been filled, click "Save and Test" to advance.

Clicking save and test after filling out fields

Clicking save and test after filling out fields

Defining Custom Bronze and Silver Schemas

Define custom bronze and silver schemas at the data source connection level.

Define bronze and silver schemas before your initial data acquisition.

Define bronze and silver schemas before your initial data acquisition.

🚧

You must define these fields BEFORE your first acquisition on this source!

If you define these fields BEFORE your initial acquisition, Empower will respect these fields and bring data into the schemas you have defined.

If you MODIFY these fields after your initial acquisition, they will be ignored!

Bronze and Silver schemas define the raw and current locations of this data source connection's objects and fields. Bronze and Silver schemas are defined by the following rules:

  • Bronze
    • The value of the Bronze Schema field, if present.
    • Defaults to "(Display Name)".
  • Silver
    • The value of the Silver Schema field, if present.
    • Defaults to "(Display Name)_silver".

Modifying an existing Data Source connection

Much like creating a new data source, modifying an existing source involves navigating to the Data Source page.

Select the data source you want to modify from the data source connection list. You will then see that data source's connection field details displayed to the right side of it.

Selecting the existing data source to modify and viewing its connection field values

Selecting the existing data source to modify and viewing its connection field values

Feel free to modify any of these values as you wish (or leave as is if you only want to view them). Make sure to press "Save and Test" to save any changes!

What happens under the hood?

  • Your connection details will be saved for this source
  • Empower will automatically test your connection for this data source if applicable.
    • If applicable, you may receive a testing status message on the page in a few moments. If this connection test fails, be sure to double check your connection details for accuracy.
    • Your connection details will be saved and you may attempt to extract metadata from this data source.

Archiving a Data Source

You may elect to archive a data source that you no longer wish to use.

🚧

You cannot extract data from Archived Data Sources!

In order to modify, trigger, or schedule data extraction from an archived data source, you must restore it first!

In the upper right corner of any selected data source, you can click on "..." to bring up a list of options.

Options menu on a selected Data Source

Options menu on a selected Data Source

Upon a successful Data Source archiving, you will see the an alert similar to the following on your screen:

Restoring a Data Source Connection

You may wish to restore an archived data source conection. This is easily done by navigating to the desired Data Source and clicking "Restore" in the upper right hand corner.

"Restore" is only available on archived Data Sources

"Restore" is only available on archived Data Sources

Upon a successful Data Source restoration, an alert will appear on your screen.

Deleting a Data Source

Similar to archiving, navigate to the desired Data Source and click "..." to bring up a list of options.

Options menu on a selected Data Source

Click on "Delete" to initiate the deletion action for this data source. Deletion is a permanent action! Once you delete a data source, you cannot restore it.

If you wish to proceed with deletion, confirm by clicking "Delete".


What’s Next

When you have a data source setup in Empower, you can extract metadata from it.