In Copy-on-Write, when a row is updated or deleted, the entire Parquet file containing that row is rewritten. Delta Lake doesn’t edit Parquet files in place — instead, it creates new files with updated content and marks the old ones as obsolete. Let’s say a Delta table contains 1 billion records spread across approximately 1000 Parquet files, and we need to update the salary for the record with id = 3. This particular record resides in file1.parquet.
Rohit Varma
As seen in:
Medium,
BrandEquity.com,
The Hindu Business Line,
GIGAZINE,
Sooper Articles,
touchOPHTHALMOLOGY
Is this you? As a journalist, you can create a free Muck Rack account to customize your profile, list your contact preferences, and upload a portfolio of your best work.
Claim your profile
Get in touch with Rohit
Contact Rohit, search articles and posts on X, monitor coverage, and track replies from one place.
Learn more about Muck Rack