You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Recently we focus on fixing the Iceberg tables which some files in the partitions were deleted. Unfortunately, the filesystem donot have audit log, we were unable capture any useful informations and donot find the issue at first time.
Amoro as a datalake management system, it can scans the tables on an ongoing cycle. Therefore, Amoro have the ability to catch the data issue with tables in the first place so that we address and fix them as quickly as possible.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Backgroud
Recently we focus on fixing the Iceberg tables which some files in the partitions were deleted. Unfortunately, the filesystem donot have audit log, we were unable capture any useful informations and donot find the issue at first time.
Amoro as a datalake management system, it can scans the tables on an ongoing cycle. Therefore, Amoro have the ability to catch the data issue with tables in the first place so that we address and fix them as quickly as possible.
Please drop comments below if you have any ideas
Beta Was this translation helpful? Give feedback.
All reactions