Overview

Data tasks can be triggered to run on-demand or as part of a schedule. Scheduled triggers can be configured to repeat on a user-defined cadence, like daily, weekly, or monthly. Empower provides great flexibility for scheduling cadences, as described below in the Scheduling Triggers section.

📘

Question: What if the task is already running?

If a task is triggered to run (either with an on-demand trigger or via scheduled trigger) and the flow is already queued or running, Empower will queue the flow to run again as soon as the current run is complete.

There will not be two instances of the same task running at the same point in time.

On-demand Triggers

Any task can be triggered to run on-demand at any moment in time. To do so, navigate to the proper module for the task (Data Acquisition, Analytics Engineering, or Data Publishing), and find the flow you wish to trigger.

Upon clicking Preview Run for this task, a modal will appear with a preview of what will happen during this flow run.

Acquire

When previewing a run of an Acquisition Task, you will see a list of all the objects set to be included with this task run and their respective load strategies.

Click "Run" to run this task. Clicking "Cancel" will abort the triggering process.

Transform

When previewing a run of an Transformation Task, you will see a list of model entities set to be built during this task run, including their type, source schema and source entity.

Click "Run" to run this task. Clicking "Cancel" will abort the triggering process.

Publish

When previewing a run of a Publishing Task, you will see a list of publish entities set to be published during this task run, including their source schema and entity.

Click "Run" to run this task. Clicking "Cancel" will abort the triggering process.

Scheduling Triggers

For data tasks that need to run at regular intervals (e.g., hourly, daily, weekly), setting up a recurring schedule automates the process, eliminating the need for manual intervention.

To set up a scheduled trigger, navigate to the proper module for the task (Acquire, Transform, or Publish), and find the task you wish to trigger.

Viewing a Task's Schedule

You can view the current schedule of a task below the "Task Status" field.

If a task has no schedule set, the schedule field will read "-".

Disabling a Task's Schedule

By toggling the Schedule Active field "Off," you can disable a task's schedule. This will temporarily negate any scheduled triggers for this task until Schedule Active is toggled back to "On". The task's schedule will reappear when Schedule Active field is toggled back on.

Setting a Task's Schedule

To set a task's schedule (including overwriting existing schedules), click the "Schedule" button.

This will bring up a preview modal identical to the one from "Preview Run."

Clicking "Schedule" will continue the schedule configuration process and bring up a second schedule modal.

Use the Start Date and Start Time fields to define when the schedule is set to begin. Use the Time Zone field to define the timezone for this schedule.

You can use the Repeat On field to define a custom frequency to run this schedule.

You can enable the task to run by the minute, hour, day, week, or month.

Use the Ends field to define a date where the recurrence will end.

When you are finished configuring the task's schedule, click "Done." The schedule for this task will now be set according to the schedule configuration. You will see your changes reflected in the Schedule field below the Task Status.

Best Practices

Testing: Before setting a recurring schedule, run the data task on-demand to ensure it executes as expected.

Monitoring: Regularly monitor your scheduled data task to catch and resolve any issues early. Use the relevant monitoring page for the flow to do so, or use the Dashboard!

Documentation: Keep documentation of all scheduled data tasks, including their purposes, schedules, and any dependencies. This practice is invaluable for maintenance and troubleshooting.