1. Provision a worker
In Schedules → Workers, create a worker and copy DP_SCHEDULER_WORKER_ID and DP_SCHEDULER_WORKER_KEY.
Tip: treat the key like a password and rotate it when needed.
Product
Run scheduled SQL behind your firewall with on-prem scheduler workers
Deploy a worker in your network, connect it to your saved connections via DP_CONN_* secrets, and keep the same workflow for the team: schedule → run → notify → download CSV/XLSX exports in the DataPilot workspace.
Supported databases: PostgreSQL, SQL Server, MySQL, Amazon Redshift. More databases are coming.
3-step quick start
2. Add secrets
For each saved connection, copy the generated DP_CONN_* variable name and set it in the same environment where the worker runs.
Keep secrets on the host (or secret store), never in source control.
3. Let the worker run
Start the container/service, let it pick up scheduled runs, and follow the workspace notifications to download exports as soon as they’re ready.
Same UI loop for everyone: schedules, runs, and notifications.
How local execution works
Worker credentials
Each on-prem worker authenticates using two environment variables: DP_SCHEDULER_WORKER_ID (stable identifier) and DP_SCHEDULER_WORKER_KEY (rotatable secret). This lets your deployment keep a consistent worker identity while you rotate access safely.
Screenshot placeholder
Scheduler workers list
File: /assets/imgs/screenshots/scheduler-workers-list.png
Show: worker id + rotate key action + last seen/health.
Screenshot needed
Screenshot needed: scheduler workers list showing worker ID, rotate key action, and last seen health.
Sizes: 1600x900 hero + OG 1200x630; Alt: "Scheduler workers list with rotate key action".
Connections & DP_CONN_*
Connections stay defined in the workspace, but the worker needs the matching secret at runtime. DataPilot shows a generated DP_CONN_* variable name per connection so your on-prem worker can run the same schedules near your databases.
Screenshot placeholder
Connections list with DP_CONN_* names
File: /assets/imgs/screenshots/connections-list.png
Show: DP_CONN_* label + copy action next to connection.
Screenshot needed
Screenshot needed: connections list showing DP_CONN_* names with copy actions.
Sizes: 1600x900 hero + OG 1200x630; Alt: "Connections list with DP_CONN env vars".
Monitor, audit, and deliver exports
You can monitor worker activity and run history inside the workspace. When a run completes, exports are delivered through the same notification loop your team already uses—so people always know where to find the latest CSV/XLSX file.