Topic: schema

• Schema evolution with Avro and Parquet: reader and writer schemas, merged files and compatibility modes

  Avro resolves a writer's schema against a reader's schema field by field, filling missing fields from reader defaults and ignoring unknown ones; Parquet files with different but compatible schemas can be merged by the reading engine at a cost; a schema registry enforces backward, forward or full compatibility. Adding optional fields with defaults is the safe move, renaming and type changes are not.

  article · en · unreviewed

Machine-readable: JSON