Package

ksb.csle.component.pipe.stream

operator

Permalink

package operator

Visibility
  1. Public
  2. All

Type Members

  1. class FilterOperator extends BaseSimplePipeOperator[DataFrame, StreamPipeOperatorInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Operator that selects which rows in a given column of input dataframe should be kept and which rows should be removed. Rows satisfying the given condition are kept, remaining rows are removed.

  2. class GroupByOperator extends BasePipeOperator[DataFrame, StreamPipeOperatorInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Operator that pipelines dataframe by aggregating records according to a given group condition.

  3. class OrderByOperator extends BasePipeOperator[DataFrame, StreamPipeOperatorInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Operator that performs to order by a specific column using a given condition.

  4. class RenameColumnsPipeOperator extends BasePipeOperator[DataFrame, StreamPipeOperatorInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Operator that changes the column names to be selected. In addition, changes the column type to be selected.

  5. class SelectColumnsPipeOperator extends BasePipeOperator[DataFrame, StreamPipeOperatorInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Operator that selects the columns that user wants to choose.

  6. class SparkMLPredictPipeOperator extends BaseSimplePipeOperator[DataFrame, StreamPipeOperatorInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Operator that performs predition with ML model in the given dataframe.

  7. class StreamAllJoinOperator[T] extends BaseJoinPipeOperator[DataFrame, StreamPipeOperatorInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Operator that full joins multiple dataframes by key.

  8. class StreamJoinOperator[T] extends BaseJoinPipeOperator[DataFrame, StreamPipeOperatorInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Operator that joins selected join columns by key with multiple dataframes and groups joined records by group-by key.

  9. class StreamTimeJoinOperator[T] extends BaseJoinPipeOperator[DataFrame, StreamPipeOperatorInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Operator that joins columns in multiple dataframes by key within time slot.

Value Members

  1. object RenameColumns

    Permalink
  2. object SelectColumns

    Permalink

Ungrouped