You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In Flink engine, if exception occurs when task writing data, it will be ignored and the exception will be reported to StreamWriteCoordinator with write event, StreamWriteCoordinator will decide whether to commit when there is write failure according to 'write.ignore.failed'.
Whether we should apply 'write.ignore.failed' ahead when write failure occurs, thus throw an exception faster.
To Reproduce
Expected behavior
promote 'write.ignore.failed' to hudi-client-common
@nbalajee Do you have some insights about promote the 'write.ignore.failed' as a basic option for all the engines? I kind of remember we had a discussion before and engine specific maintainance is prefferable.
Describe the problem you faced
In Flink engine, if exception occurs when task writing data, it will be ignored and the exception will be reported to StreamWriteCoordinator with write event, StreamWriteCoordinator will decide whether to commit when there is write failure according to 'write.ignore.failed'.
Whether we should apply 'write.ignore.failed' ahead when write failure occurs, thus throw an exception faster.
To Reproduce
Expected behavior
Environment Description
Additional context
related PR:#12150
Stacktrace
The text was updated successfully, but these errors were encountered: