Skip to content

Latest commit

 

History

History
71 lines (46 loc) · 1.38 KB

README.MD

File metadata and controls

71 lines (46 loc) · 1.38 KB
Raw

FilterMap Operator Example

Example of how to use the filter-map operator. In this example, the filter-map operation transforms sentences over 10 characters in length to uppercase and drops all others.

Run DataFlow

With the dataflow.yaml file in the current directory, run the following commands:

sdf run

Test DataFlow

The sample data file used to run this test ./sample-data/data.txt has the following records:

say hello
say hello world

Produce the data to the sentences topic:

fluvio produce sentences -f ./sample-data/data.txt

Checkout the data in sentences topic:

fluvio consume sentences -Bd

Consume from capitalized to retrieve the result:

fluvio consume capitalized -Bd
SAY HELLO WORLD

Note: long sentences are capitalized, the other is filtered out.

Run SDF commands

Display the stateful dataflow stats in the sdf runtime >> terminal:

show state filter-map-service/long-sentence-to-uppercase/metrics
Key    Window  succeeded  failed
stats  *       2          0

Clean-up

Exit sdf terminal and clean-up. The --force flag removes the topics:

sdf clean --force