This patch release addresses the following two issues:
spark.marklogic.read.snapshot
was added to allow a user to configure a non-consistent snapshot when reading documents by setting the option tofalse
. This avoids bugs where a consistent snapshot is not feasible and the downsides of reading at multiple times are not a concern.- Issues with importing JSON Lines files via Flux - such as keys being reordered and added - can be avoided by setting the existing
spark.marklogic.read.files.type
option to a value ofjson_lines
. The connector will read each line as a separate JSON document and will not perform any modifications on any line, thereby avoiding the issue in Flux of JSON documents being unexpectedly altered.