> ## Documentation Index
> Fetch the complete documentation index at: https://support.entegrata.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Understand resources and how they represent collectible data within connections

## Overview

Resources are the individual tables, views, API endpoints, or files within a connection that Entegrata collects. Each resource represents a specific dataset you want to synchronize to your data lakehouse.

## Key Concepts

### What is a Resource?

A **Resource** is a collectible data entity discovered within a connection:

<ResponseField name="Name" type="string" required>
  The resource identifier (table name, view name, API endpoint path, or file name)
</ResponseField>

<ResponseField name="Type" type="enum" required>
  The kind of resource:

  * **Table** - Database table with data rows
  * **View** - Database view (virtual table)
  * **Endpoint** - API endpoint providing data
  * **File** - Data file or spreadsheet
</ResponseField>

<ResponseField name="Status" type="enum" required>
  Collection state:

  * **Active** - Resource is collecting data
  * **Inactive** - Resource is not collecting
</ResponseField>

<ResponseField name="Fields" type="array">
  Columns or properties within the resource (e.g., customer\_id, name, email)
</ResponseField>

## Resource Lifecycle

<Steps>
  <Step title="Discovery">
    Resources are automatically discovered when you create a connection or when discovery runs (every 3 hours)
  </Step>

  <Step title="Configuration">
    Enable resources and configure collection settings (schedule, load type, filters)
  </Step>

  <Step title="Active Collection">
    Enabled resources collect data according to their configured schedules
  </Step>

  <Step title="Monitoring">
    Track collection jobs, performance, and data quality
  </Step>

  <Step title="Maintenance">
    Update settings, handle schema changes, or disable resources as needed
  </Step>
</Steps>

## Resource Types

### Tables

Database tables containing rows of structured data:

* Most common resource type
* Have defined schemas with columns and data types
* Support full and incremental loads
* May have primary keys defined by the database

### Views

Database views (virtual tables based on queries):

* Derived from one or more tables
* Schema defined by the view query
* Typically use full load (incremental may not be supported)
* Primary keys must be user-defined

### Endpoints

API endpoints providing structured data:

* REST API paths or GraphQL queries
* Schema discovered from API responses
* Support pagination and filtering
* May have rate limits

### Files

Files containing structured data:

* Excel spreadsheets, CSV files, JSON documents
* Schema inferred from file structure
* May contain multiple sheets or sections
* Typically use full load

## Resource vs. Connection

Understanding the relationship:

| Aspect             | Connection                | Resource                        |
| ------------------ | ------------------------- | ------------------------------- |
| **Scope**          | Entire data source        | Single table/view/endpoint      |
| **Discovery**      | Discovers all resources   | Discovered within connection    |
| **Schedule**       | Default for all resources | Can override connection default |
| **Enable/Disable** | Affects all resources     | Affects only this resource      |
| **Authentication** | Stores credentials        | Inherits from connection        |
| **Collection**     | May trigger all resources | Triggers single resource        |

## Collection Settings

Each resource can be configured with:

### supp

## Resource Status Indicators

Resources display status information:

### Active Resource

<Frame>
  <img src="https://mintcdn.com/entegrata/FZ7uPvdDC2XYN2d6/data/collector/resources/images/resource-active.png?fit=max&auto=format&n=FZ7uPvdDC2XYN2d6&q=85&s=923775629b632f96a52ada5035fbc916" alt="Active resource with toggle on" width="2176" height="57" data-path="data/collector/resources/images/resource-active.png" />
</Frame>

* Toggle is ON (green)
* Collects according to schedule
* Jobs appear in collection history

### Inactive Resource

<Frame>
  <img src="https://mintcdn.com/entegrata/FZ7uPvdDC2XYN2d6/data/collector/resources/images/resource-inactive.png?fit=max&auto=format&n=FZ7uPvdDC2XYN2d6&q=85&s=4342555de02b7687d69bff9bd93551d1" alt="Inactive resource with toggle off" width="2176" height="57" data-path="data/collector/resources/images/resource-inactive.png" />
</Frame>

* Toggle is OFF (gray)
* Does not collect data
* No jobs created

## Load Type Indicators

Resources show their configured load type:

<Frame>
  <img src="https://mintcdn.com/entegrata/FZ7uPvdDC2XYN2d6/data/collector/resources/images/load-type-badges.png?fit=max&auto=format&n=FZ7uPvdDC2XYN2d6&q=85&s=b28cfc6bc12bb2d2f0e76a28fa3a434d" alt="Load type badges" width="308" height="21" data-path="data/collector/resources/images/load-type-badges.png" />
</Frame>

* **Full** - Full load every collection
* **Incremental** - Incremental load with change tracking

Click the badge to quickly open collection settings.

## Getting Started with Resources

<CardGroup cols={2}>
  <Card title="Viewing Resources" icon="eye" href="/data/collector/resources/viewing-resources">
    Browse and search discovered resources
  </Card>

  <Card title="Enabling Resources" icon="toggle-on" href="/data/collector/resources/enabling-resources">
    Turn on data collection for specific resources
  </Card>

  <Card title="Collection Settings" icon="gear" href="/data/collector/resources/collection-settings">
    Configure schedules, load types, and filters
  </Card>

  <Card title="Triggering Collection" icon="play" href="/data/collector/resources/triggering-collection">
    Manually start collection jobs
  </Card>
</CardGroup>

## Common Workflows

### Initial Setup After Creating Connection

<Steps>
  <Step title="Wait for Discovery">
    Allow automatic discovery to complete (1-5 minutes)
  </Step>

  <Step title="Review Resources">
    Browse the discovered resources in the Resources table
  </Step>

  <Step title="Enable Required Resources">
    Toggle on the specific tables/endpoints you need
  </Step>

  <Step title="Configure Settings">
    Set load types, unique keys, and filters for each resource
  </Step>

  <Step title="Save and Monitor">
    Save changes and watch the first collection jobs
  </Step>
</Steps>

### Ongoing Maintenance

* **Monitor collection jobs** - Check for failures or performance issues
* **Handle schema changes** - Respond to discovery alerts about schema modifications
* **Adjust schedules** - Optimize timing based on data freshness needs
* **Update filters** - Refine data selection criteria

## Best Practices

<CardGroup cols={2}>
  <Card title="Start Small" icon="seedling">
    Enable a few resources first, verify they work, then add more
  </Card>

  <Card title="Use Incremental When Possible" icon="forward">
    Incremental loads are faster and more efficient for large tables
  </Card>

  <Card title="Set Unique Keys" icon="key">
    Always define unique keys to ensure proper deduplication
  </Card>

  <Card title="Apply Filters Early" icon="filter">
    Filter at the source to reduce data transfer and storage
  </Card>

  <Card title="Monitor First Collections" icon="chart-line">
    Watch initial jobs to catch configuration issues early
  </Card>

  <Card title="Document Decisions" icon="file-text">
    Keep notes on why certain resources are enabled/disabled
  </Card>
</CardGroup>

## Next Steps

<CardGroup cols={2}>
  <Card title="Viewing Resources" icon="eye" href="/data/collector/resources/viewing-resources">
    Learn how to browse and search resources
  </Card>

  <Card title="Discovery" icon="magnifying-glass" href="/data/collector/discovery/overview">
    Understand how resources are discovered
  </Card>

  <Card title="Monitoring Jobs" icon="chart-line" href="/data/collector/jobs/overview">
    Track collection execution and performance
  </Card>
</CardGroup>
