This project presents a distributable solution based on Spark Java, aiming to connect start and end session events together in a stateful manner. The project utilizes `flatMapGroupWithState`functionality which is a powerful feature for stateful stream processing in Spark. It enables you to maintain and update the state across batches.
java kafka state-management spark typesafe typesafe-config spark-structured-streaming memorystream flatmapgroupwithstate
-
Updated
Jun 28, 2023 - Java