Connect data

The sources DataxLand accepts — Excel files, Shopee, TikTok Shop and Lazada, PostgreSQL with CDC, BigQuery, custom REST APIs and the connector library — and how to add one.

Data from every source is copied into the workspace's own warehouse; dashboards never query your source directly.

Source types

TypeHow it connectsNotes
Excel file (.xlsx)Upload; one sheet per table plus a data_dictionary sheetUp to 50 MB, 200,000 rows per sheet
PostgreSQLRead-only credentialsFull, incremental or CDC (logical replication)
BigQueryService account keyIncremental; a scan limit (default 2 GB) caps query cost
Shopee, TikTok Shop, LazadaSign in on the marketplace's page (OAuth)No password is shared; last 90 days by default
Any REST API returning JSONBase URL, auth, endpoints, paginationGET, POST or GraphQL; preview before adding
Ads, CRM, payments, analytics…560+ connectors in the libraryBuilt on the open-source Airbyte protocol

The Free plan accepts one Excel file. Paid plans accept every source type and scheduled refreshes.

The data_dictionary sheet

ColumnRequiredContent
table_nameYesSheet name
column_nameYesColumn name; * describes the whole table
data_typeYesType in the source system, e.g. VARCHAR(50), DATE
descriptionYesWhat the column means
keyNoPK, FK or PK, FK
referencesNoReferenced column, e.g. products.sku
piiNoY for personal data; always masked

Without the sheet DataxLand still reads the file and infers types and meaning, with a warning.

Add a source to an existing workspace

Add a source from the connector library · ~60s
  1. Open Data sources. You need the Admin or Owner role.
  2. Click Add source.
  3. Search in Search connectors, click Select on one or more connectors, then Continue.
  4. Fill in each form and set Source name (lowercase letters, digits and underscores, starting with a letter, up to 16 characters).
  5. Click Test connection until it shows Connected.
  6. On Review before adding, click Add N sources. Marketplaces are connected last, on the marketplace's own page.
  7. You confirm the personal-data columns again and Si proposes an updated mapping; the current dashboard stays available meanwhile.

A workspace holds up to 8 sources (Starter plan: 3).

Sync modes

ModeWhat it doesAvailable for
FullRe-reads the whole table each refreshEvery source
IncrementalReads rows whose cursor column is newer, merged by primary key; does not see deletesPostgreSQL, BigQuery, marketplaces, connectors
CDC (log-based)Reads the write-ahead log, sees updates and deletesPostgreSQL

For CDC, click Check CDC requirements on the source page. It checks wal_level = logical (RDS/Aurora: rds.logical_replication = 1; Cloud SQL: cloudsql.logical_decoding = on), the REPLICATION privilege, a free replication slot, a primary key or REPLICA IDENTITY FULL on each table, and permission to create a publication.

Set the refresh schedule in Data refresh schedule: every 15 or 30 minutes (only when every source is incremental or CDC; Small Business plan and above), hourly (Starter and above), daily, weekly or monthly.

Passwords and personal data

Password fields are encrypted at rest and never shown again. Personal-data columns are masked before reaching Si's prompt and hashed in the warehouse. See Security and privacy.

Markdown