Skip to main content

Quality and packaging

Assess quality, encode reusable rules, and produce evidence before data is released.

Gate a dataset release

undatum validate data.csv --rules rules.yml --output-format json \
--violation-report violations.json --fail-on-warnings

Example rule files live in the examples/validation-rules directory.

Detect unintended changes

undatum diff previous.parquet current.parquet --key id --ignore-order \
--max-changed-rows 0 --summary-only

Publish a Frictionless package

undatum package create data.csv --package-dir release --output release/datapackage.json
undatum package validate release/datapackage.json

Prepare a safe public extract

undatum mask source.csv --fields email,phone --method hash --salt "$SALT" --output public.csv
undatum doc public.csv --pii-detect --pii-mask-samples --output DATASET.md

See validate, package, mask, and doc.