You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am reading Hudi 0.15.0 source code, find there are two compaction inline options, one is hoodie.compact.inline,the other is hoodie.log.compaction.inline,
Both of them say that the compaction/log compaction service will be triggered after each write, I would ask what't the difference between these two services.
The defintion of the two options are as follows:
public static final ConfigProperty<String> INLINE_COMPACT = ConfigProperty
.key("hoodie.compact.inline")
.defaultValue("false")
.withDocumentation("When set to true, compaction service is triggered after each write. While being "
+ " simpler operationally, this adds extra latency on the write path.");
and
public static final ConfigProperty<String> INLINE_LOG_COMPACT = ConfigProperty
.key("hoodie.log.compaction.inline")
.defaultValue("false")
.markAdvanced()
.sinceVersion("0.13.0")
.withDocumentation("When set to true, log compaction service is triggered after each write. While being "
+ " simpler operationally, this adds extra latency on the write path.");
The text was updated successfully, but these errors were encountered:
log compaction is used for merging multiple log blocks into a larger one(also a log block); while compaction merges all the log files of the current version into a parquet file, also rolls over the current file slice version into new.
HI,
I am reading Hudi 0.15.0 source code, find there are two compaction inline options, one is
hoodie.compact.inline
,the other ishoodie.log.compaction.inline
,Both of them say that the compaction/log compaction service will be triggered after each write, I would ask what't the difference between these two services.
The defintion of the two options are as follows:
and
The text was updated successfully, but these errors were encountered: