Workspace and sync

Sync modes and refresh schedule

The three ways to sync data — full, incremental and CDC (change log) — which sources support which, and how to set an automatic refresh schedule.

Three sync modes

ModeHow it worksKeep in mind
FullRe-reads the whole table on every refreshSimplest; slow on large tables
IncrementalReads only rows whose cursor column (for example updated_at) is newer than last time, merged on the primary keyDoes not see rows deleted at the source
CDC (log-based)Reads the database's change log, including deleted rowsPostgreSQL only; logical replication must be enabled
SourceFullIncrementalCDC
Excel filesYes——
PostgreSQLYesYesYes
MySQL / MariaDB, SQL ServerYesYes—
BigQuery, marketplaces, connectorsYesYes—

File sources are always re-read in full. Marketplaces (Shopee, TikTok Shop, Lazada) are read incrementally by order update time.

Change the sync mode

  1. Go to Data sources, card Sync method, and click Edit sync method.
  2. Choose a mode for each table. For Incremental, pick the Cursor column (columns marked "(suggested)" are DataxLand's suggestions) and the Primary key.
  3. Click Save sync method. The next refresh does one full load for every table whose settings changed.

When a new workspace is created, every table is loaded in full; you can change the sync mode once the workspace exists. For CDC, read the requirements under PostgreSQL.

Refresh schedule

  1. On the Data refresh schedule card, choose a Frequency: every 15 minutes, every 30 minutes, hourly, daily, weekly or monthly.
  2. Choose the Time (for daily, weekly and monthly schedules), and the Day of week or Day of month (1–28).
  3. Switch on Turn on automatic refresh and click Save schedule. The default is daily at 06:00 in the workspace time zone.

Every 15 and every 30 minutes are only available when every source syncs incrementally or with CDC. Schedules only run once the workspace is approved.

PlanFrequencies available
FreeNo schedule; upload new files by hand (Thay file, replace file)
StarterHourly, daily, weekly, monthly
Small Business and aboveDown to every 15 minutes

A schedule your current plan does not include is skipped, with the reason logged. When storage goes above 110% of your quota, refreshes pause; see Plans and quotas.

Markdown