Skip to content

Databricks Optimization Action Plans & Automation

Action plans are generated from eligible insights. They describe a proposed remediation, expected savings, evidence, and the operational risk before anything is changed.

LakeSentry is approval-first: all generated action plans currently require review and approval before execution.

LakeSentry can generate plans for these findings:

Plan typeTypical source insightExecution today
Terminate idle clusterIdle clusterExecutable after approval
Cancel runaway runRunaway job or excessive durationExecutable after approval
Pause job scheduleRepeated waste or failuresReview/manual
Reduce auto-terminationLong auto-terminationReview/manual
Enable spot instancesSpot candidateReview/manual
Convert to single-nodeSingle-node candidateReview/manual
Scale down workersOverprovisioned workersReview/manual
Upgrade runtimeOutdated Databricks RuntimeReview/manual

The action executor currently performs Databricks mutations for terminating clusters and canceling runs. Other plan types are persisted with evidence and proposed changes for operator review until direct execution support is added.

TierMeaning
Tier 0 / AutoLow-risk action classification. In the current release, Tier 0 plans still require approval before execution.
Tier 1 / ReviewRequires human review and approval before execution.
Tier 2 / ManualLakeSentry provides instructions/evidence; the operator applies changes manually.

The UI labels these as Auto, Review, and Manual. Today those labels describe risk and handling, not unattended execution. Most production-impacting infrastructure changes should be treated as review or manual until your organization has built trust in the detector.

  1. An insight is detected.
  2. A background worker creates an action plan when the type is supported and required evidence exists.
  3. A user reviews the plan, evidence, savings estimate, and blast radius.
  4. The plan is approved, rejected, or left pending.
  5. If approved and executable, LakeSentry calls the relevant Databricks API.
  6. The timeline records success, failure, or manual completion.
  • Plans are tied to specific insight evidence.
  • Missing or contradictory evidence prevents plan generation.
  • Execution status is audited.
  • Admins can keep risky recommendations manual.
  • Treat generated plans as operational changes; follow your team’s change-management process.