Class

ksb.csle.component.pipe.controller

StreamingGenericController

Related Doc: package controller

Permalink

class StreamingGenericController extends BasGenericePipeController[DataFrame, DataFrame, StreamingQuery, Message, SparkSession]

:: ApplicationDeveloperApi ::

Controller that manipulate reader, operator, and writer handles when engine starts.

Linear Supertypes
BasGenericePipeController[DataFrame, DataFrame, StreamingQuery, Message, SparkSession], BaseController[DataFrame, BaseResult], BaseDoer, Logging, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StreamingGenericController
  2. BasGenericePipeController
  3. BaseController
  4. BaseDoer
  5. Logging
  6. Serializable
  7. Serializable
  8. AnyRef
  9. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StreamingGenericController(runner: BaseRunner[SparkSession, StreamRunnerInfo, Any], ins: Seq[BasePipeReader[DataFrame, StreamReaderInfo, SparkSession]], outs: Seq[BasePipeWriter[DataFrame, StreamingQuery, StreamWriterInfo, SparkSession]], p: StreamControllerInfo, ops: Seq[BaseGenericPipeOperator[_, _, DataFrame, StreamOperatorInfo, SparkSession]])

    Permalink

    runner

    Runner object that gets spark session

    ins

    A series of reader objects that read data from data source

    p

    Message object that has one of messages object containing attributes related to controlling process pipelining

    ops

    a series of BaseGenericPipeOperator objects that returns pipeline handle to process.

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  10. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  11. def init(): Unit

    Permalink
    Definition Classes
    StreamingGenericController → BaseController
  12. val ins: Seq[BasePipeReader[DataFrame, StreamReaderInfo, SparkSession]]

    Permalink

    A series of reader objects that read data from data source

    A series of reader objects that read data from data source

    Definition Classes
    StreamingGenericController → BasGenericePipeController
  13. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  14. val logger: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  15. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  16. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  18. val ops: Seq[BaseGenericPipeOperator[_, _, DataFrame, StreamOperatorInfo, SparkSession]]

    Permalink

    a series of BaseGenericPipeOperator objects that returns pipeline handle to process.

    a series of BaseGenericPipeOperator objects that returns pipeline handle to process.

    Definition Classes
    StreamingGenericController → BasGenericePipeController
  19. val outs: Seq[BasePipeWriter[DataFrame, StreamingQuery, StreamWriterInfo, SparkSession]]

    Permalink
    Definition Classes
    StreamingGenericController → BasGenericePipeController
  20. val p: StreamControllerInfo

    Permalink

    Message object that has one of messages object containing attributes related to controlling process pipelining

    Message object that has one of messages object containing attributes related to controlling process pipelining

    Definition Classes
    StreamingGenericController → BasGenericePipeController
  21. def progress(): BaseResult

    Permalink

    Pipelines data from readers to writers via operators.

    Pipelines data from readers to writers via operators.

    returns

    result

    Definition Classes
    StreamingGenericController → BasGenericePipeController → BaseController
  22. var query: Seq[StreamingQuery]

    Permalink
    Attributes
    protected
    Definition Classes
    BasGenericePipeController
  23. val runner: BaseRunner[SparkSession, StreamRunnerInfo, Any]

    Permalink

    Runner object that gets spark session

    Runner object that gets spark session

    Definition Classes
    StreamingGenericController → BasGenericePipeController
  24. def stop(): Any

    Permalink
    Definition Classes
    StreamingGenericController → BasGenericePipeController → BaseController
  25. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  26. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  27. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from BasGenericePipeController[DataFrame, DataFrame, StreamingQuery, Message, SparkSession]

Inherited from BaseController[DataFrame, BaseResult]

Inherited from BaseDoer

Inherited from Logging

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped