Package

ksb.csle.component

reader

Permalink

package reader

Visibility
  1. Public
  2. All

Type Members

  1. class FileReader extends BaseReader[DataFrame, BatchReaderInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Reader that loads records from one or more files.

  2. trait HBaseFuncAPI extends Logging

    Permalink

    An utility class to interact with HBase.

  3. class HttpClientReader extends BaseReader[InputDStream[String], StreamReaderInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi :: A receiver that receives responses from a http server through http methods and store it in spark memory

  4. class HttpServerReader extends BaseReader[InputDStream[String], StreamReaderInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Reader that receives streaming data via HTTP POST request.

  5. class HttpWeatherClientReader extends BaseReader[InputDStream[String], StreamReaderInfo, SparkSession] with Logging

    Permalink

    :: ApplicationDeveloperApi :: A receiver that receives responses from a weather server provided by Korea Meteorological Administration

  6. class KafkaOnDemandReader extends BaseReader[(Long) ⇒ Option[String], OnDemandReaderInfo, Long]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Reader that fetchs data from Kafka.

  7. class KafkaReader extends BaseReader[InputDStream[ConsumerRecord[String, String]], StreamReaderInfo, StreamingContext]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Reader that receives streaming data from Kafka.

  8. class MongodbReader extends BaseReader[DataFrame, BatchReaderInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Reader that loads records from MongoDB.

  9. class MultipleReaders extends BaseReader[DataFrame, BatchReaderInfo, SparkSession] with HBaseFuncAPI

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Reader that loads multiple DataFrame from files and HBase tables and then merge them under given conditions.

  10. class Onem2mHttpReader extends BaseReader[InputDStream[String], StreamReaderInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Reader that receives streaming data via oneM2M HTTP binding. (Note: In the current version, assumes that container resource is already subscribed by the external system.)

  11. class PhoenixReader extends BaseReader[DataFrame, BatchReaderInfo, SparkSession] with HBaseFuncAPI

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Reader that loads records from HBase using Phoenix.

  12. class PhoenixReaderBySql extends BaseReader[DataFrame, BatchReaderInfo, SparkSession] with HBaseFuncAPI

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Reader that loads records from HBase using Phoenix SQL.

  13. class TableReader extends BaseReader[DataFrame, BatchReaderInfo, SparkSession]

    Permalink

    :: ApplicationDeveloperApi ::

    :: ApplicationDeveloperApi ::

    Reader that loads records from the target table in SQL Database. (e.g. PostgresQL, MySQL, ...).

Value Members

  1. object FileReader extends Serializable

    Permalink
  2. object KafkaOnDemandReader extends Serializable

    Permalink
  3. object KafkaReader extends Serializable

    Permalink
  4. object MongodbReader extends Serializable

    Permalink
  5. object MultipleReaders extends Serializable

    Permalink
  6. object PhoenixReader extends Serializable

    Permalink
  7. object PhoenixReaderBySql extends Serializable

    Permalink

Ungrouped