Skip to content

2.4.2

Latest
Compare
Choose a tag to compare
@rjrudin rjrudin released this 17 Oct 18:44
· 5 commits to master since this release
afd19a3

This patch release addresses the following two issues:

  1. spark.marklogic.read.snapshot was added to allow a user to configure a non-consistent snapshot when reading documents by setting the option to false. This avoids bugs where a consistent snapshot is not feasible and the downsides of reading at multiple times are not a concern.
  2. Issues with importing JSON Lines files via Flux - such as keys being reordered and added - can be avoided by setting the existing
    spark.marklogic.read.files.type option to a value of json_lines. The connector will read each line as a separate JSON document and will not perform any modifications on any line, thereby avoiding the issue in Flux of JSON documents being unexpectedly altered.