Skip to main content

Overview

Publishing is the process of deploying your data mappings to production. When you publish, Entegrata generates Delta Live Tables (DLT) scripts and deploys them to your Databricks environment, where they run as automated data pipelines. This guide covers the complete publishing process, from pre-publish validation to monitoring deployed pipelines.
Required permissions
  • Data Pipelines: Access
  • Manage Silver Entities or Manage Gold Entities, for the layer: Update
  • Manage Production Pipelines (for production pipelines and the main pipeline) or Manage Dev Pipelines (for development pipelines): Update
Saving and publishing a mapping needs Update on both the layer and the pipeline. A role can limit pipeline Update to specific pipelines. See roles and permissions and permission dependencies.

Understanding Publishing

What Happens When You Publish?

When you click Publish, Entegrata:
  1. Validates your mapping configuration
  2. Generates Delta Live Tables (DLT) Python code
  3. Deploys the code to your Databricks workspace
  4. Creates or updates the DLT pipeline
  5. Schedules the pipeline to run automatically
  6. Starts initial data processing

Publishing Requirements

Before publishing, your mapping must meet these requirements:
Required for Publishing:
  • At least one data source configured
  • No validation errors
  • Valid join conditions (if using related sources)
  • Update on both the layer (Manage Silver Entities or Manage Gold Entities) and the pipeline

Publishing Your Mapping

1

Save Your Work

Click Save to ensure all changes are persisted. Publishing will fail if there are unsaved changes.
Save button and saved indicator
2

Click Publish

Click the Publish button in the top toolbar.
3

Verify Success

When complete, you’ll see a success message.

Data Mapping Editor

Learn the mapping editor before publishing

Managing Entities

Understand entity lifecycle and status

Entity Lineage

See which source columns feed each entity field

Access Controls

Control who can publish and access data