Object that contains message ksb.csle.common.proto.StreamOperatorProto.FilterInfo FilterInfo contains attributes as follows:
message FilterInfo { required string colName = 4; required Condition condition = 5 [default = EQUAL]; optional int32 value = 6; optional string pattern = 7; enum Condition { EQUAL = 0; LESS_THAN = 1; LARGE_THAN = 2; LESS_EQUAL = 3; LARGE_EQUAL = 4; EXIST = 5; LIKE = 6; } }
Operates filtering function for data cleaning
Operates filtering function for data cleaning
Input dataframe
DataFrame Output dataframe
:: ApplicationDeveloperApi ::
Operator that selects which rows in a given column of input dataframe should be kept and which rows should be removed. Rows satisfying the given condition are kept, remaining rows are removed.