Object

ksb.csle.didentification.utilities

FileManager

Related Doc: package utilities

Permalink

object FileManager

This object provides the function to make a dataframe from the file info. The file location can be given by the form of directory or URL.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. FileManager
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  10. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  11. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  12. def makeDataFrame(spark: SparkSession, path: String, hasHeader: Boolean, delimiter: String, schema: StructType): DataFrame

    Permalink
  13. def makeDataFrame(spark: SparkSession, path: String, hasHeader: Boolean, delimiter: String): DataFrame

    Permalink
  14. def makeDataFrame(spark: SparkSession, path: String, hasHeader: Boolean): DataFrame

    Permalink
  15. def makeDataFrame(spark: SparkSession, path: String): DataFrame

    Permalink

    Makes a dataframe by reading the file.

    Makes a dataframe by reading the file. The path of its file is given by the format of directory.

    spark

    Spark Session

    path

    The path of file

    returns

    DataFrame

  16. def makeDataFrameHDFS(spark: SparkSession, path: String, hasHeader: Boolean, delimiter: String): DataFrame

    Permalink
  17. def makeDataFrameURL(spark: SparkSession, path: String, hasHeader: Boolean, delimiter: String): DataFrame

    Permalink
  18. def makeDataFrameURL(spark: SparkSession, path: String, hasHeader: Boolean): DataFrame

    Permalink
  19. def makeDataFrameURL(spark: SparkSession, path: String): DataFrame

    Permalink

    Makes a dataframe by reading the file

    Makes a dataframe by reading the file

    spark

    Spark Session

    path

    The path of file

    returns

    DataFrame

  20. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  21. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  22. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  23. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  24. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  25. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped