Runner object that runs spark session
Reader object that reads data from data source
Writer object that writes pipelined data from operators
Message object that has one of messages object containing attributes related to controlling process pipelining
a list of BaseGenericOperator objects that processes data one by one.
Reader object that reads data from data source
Reader object that reads data from data source
Writer object that writes pipelined data from operators
Writer object that writes pipelined data from operators
a list of BaseGenericOperator objects that processes data one by one.
a list of BaseGenericOperator objects that processes data one by one.
Message object that has one of messages object containing attributes related to controlling process pipelining
Message object that has one of messages object containing attributes related to controlling process pipelining
Runner object that runs spark session
Runner object that runs spark session
:: ApplicationDeveloperApi ::
Controller that conduct windowing control to queuing data. This controller passes queued data to a consecutive operators. This can be run on streaming engine, and work as a streaming processing controller.
Data type class to be passes through data pipeline from reader to operators
Message type class
Data type for the final data format
Session type class for reader object
Session type class for writer object