Operations / Field guide

Self-service data import & migration

Guide customers through mapping, validating and importing their existing data.

Validate before writing

SPREADSHEET PREVIEWROWNAMEEMAILSTATUS1Alexa@co.test2Sammissing email3Minam@co.testRow 2 needs correction before import

A dry run marks rows that need mapping or correction.

01 / CONTEXT

Why it matters

The first useful result may depend on bringing data from a spreadsheet or another product. A self-service importer must make errors understandable before it changes production records.

Import is an asynchronous, repeatable workflow: upload, map columns, preview validation, apply and reconcile. Customers need a way to correct only the failed rows.

02 / DESIGN

Decisions to make

  • Choose supported source formats and maximum import size.
  • Define matching and duplicate rules for existing records.
  • Decide whether an import can be rolled back or replayed.
  • Set how references between records are mapped.
  • Plan where sensitive import files are stored and when they expire.
03 / IMPLEMENTATION

Build checklist

  • Provide a dry-run preview with field mapping and sample rows.
  • Validate each row and produce an actionable error report.
  • Run large imports in resumable background batches.
  • Make retries idempotent to prevent duplicate records.
  • Show progress, totals and a post-import reconciliation summary.
04 / WATCH FOR

Common mistakes

  • Accepting a file and returning only a generic failed status.
  • Inserting half the rows without telling the customer which ones succeeded.
  • Using filename or row order as the only duplicate key.
05 / GO DEEPER

Tools & references

3 starting points to compare or study. Check fit, maintenance, terms and current capabilities before choosing one.

BUILDING THIS NOW?

Explore the SaaSLayer approach.

See the services and developer guides behind our AWS backed SaaS building blocks.

Read SaaSLayer docs
NEXT FEATUREObject-level version history & rollbacks