# Connect data

> The sources DataxLand accepts — Excel files, Shopee, TikTok Shop and Lazada, PostgreSQL with CDC, BigQuery, custom REST APIs and the connector library — and how to add one.

Data from every source is **copied into the workspace's own warehouse**; dashboards never query your source directly.

## Source types

| Type | How it connects | Notes |
| --- | --- | --- |
| Excel file (.xlsx) | Upload; one sheet per table plus a `data_dictionary` sheet | Up to 50 MB, 200,000 rows per sheet |
| PostgreSQL | Read-only credentials | Full, incremental or CDC (logical replication) |
| BigQuery | Service account key | Incremental; a scan limit (default 2 GB) caps query cost |
| Shopee, TikTok Shop, Lazada | Sign in on the marketplace's page (OAuth) | No password is shared; last 90 days by default |
| Any REST API returning JSON | Base URL, auth, endpoints, pagination | GET, POST or GraphQL; preview before adding |
| Ads, CRM, payments, analytics… | 560+ connectors in the library | Built on the open-source Airbyte protocol |

The **Free** plan accepts one Excel file. Paid plans accept every source type and scheduled refreshes.

## The `data_dictionary` sheet

| Column | Required | Content |
| --- | --- | --- |
| `table_name` | Yes | Sheet name |
| `column_name` | Yes | Column name; `*` describes the whole table |
| `data_type` | Yes | Type in the source system, e.g. `VARCHAR(50)`, `DATE` |
| `description` | Yes | What the column means |
| `key` | No | `PK`, `FK` or `PK, FK` |
| `references` | No | Referenced column, e.g. `products.sku` |
| `pii` | No | `Y` for personal data; always masked |

Without the sheet DataxLand still reads the file and infers types and meaning, with a warning.

## Add a source to an existing workspace

1. Open **Data sources**. You need the Admin or Owner role.
2. Click **Add source**.
3. Search in **Search connectors**, click **Select** on one or more connectors, then **Continue**.
4. Fill in each form and set **Source name** (lowercase letters, digits and underscores, starting with a letter, up to 16 characters).
5. Click **Test connection** until it shows **Connected**.
6. On **Review before adding**, click **Add N sources**. Marketplaces are connected last, on the marketplace's own page.
7. You confirm the personal-data columns again and Si proposes an updated mapping; the current dashboard stays available meanwhile.

A workspace holds up to 8 sources (Starter plan: 3).

## Sync modes

| Mode | What it does | Available for |
| --- | --- | --- |
| **Full** | Re-reads the whole table each refresh | Every source |
| **Incremental** | Reads rows whose cursor column is newer, merged by primary key; does not see deletes | PostgreSQL, BigQuery, marketplaces, connectors |
| **CDC (log-based)** | Reads the write-ahead log, sees updates and deletes | PostgreSQL |

For CDC, click **Check CDC requirements** on the source page. It checks `wal_level = logical` (RDS/Aurora: `rds.logical_replication = 1`; Cloud SQL: `cloudsql.logical_decoding = on`), the REPLICATION privilege, a free replication slot, a primary key or `REPLICA IDENTITY FULL` on each table, and permission to create a publication.

Set the refresh schedule in **Data refresh schedule**: every 15 or 30 minutes (only when every source is incremental or CDC; Small Business plan and above), hourly (Starter and above), daily, weekly or monthly.

## Passwords and personal data

Password fields are encrypted at rest and never shown again. Personal-data columns are masked before reaching Si's prompt and hashed in the warehouse. See [Security and privacy](/en/docs/security-privacy).

## Related

- [Quickstart](/en/docs/quickstart)
- [Ask Si in the app](/en/docs/ask/app)
- [Connector catalogue](/en/connectors)
