Runner object that gets spark session
A series of reader objects that read data from data source
Message object that has one of messages object containing attributes related to controlling process pipelining
a series of BaseGenericPipeOperator objects that returns pipeline handle to process.
A series of reader objects that read data from data source
A series of reader objects that read data from data source
a series of BaseGenericPipeOperator objects that returns pipeline handle to process.
a series of BaseGenericPipeOperator objects that returns pipeline handle to process.
Message object that has one of messages object containing attributes related to controlling process pipelining
Message object that has one of messages object containing attributes related to controlling process pipelining
Pipelines data from readers to writers via operators.
Pipelines data from readers to writers via operators.
result
Runner object that gets spark session
Runner object that gets spark session
:: ApplicationDeveloperApi ::
Controller that manipulate reader, operator, and writer handles when engine starts.