Replies: 1 comment
-
Have you considered spreading the string instead and reparsing it on each node? That should be much more efficient, as the string will be much more compact than serialized Java objects. The expression refers to Overall, I suspect spreading strings is probably better in pretty much every way. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I found that useful if it comes to spread transformation across nodes. In my use case this is Apache Beam. I compile the Expression in a constructor of DoFn but it fails during the serialization during spreading across all the computational nodes. I'm not sure if expression itself is already bound to something heavy which can't be serialized. Looking at the code this is just an interpretation of JSLT expression.
Beta Was this translation helpful? Give feedback.
All reactions