Class/Object

ksb.csle.component.runner

TensorflowServingRunner

Related Docs: object TensorflowServingRunner | package runner

Permalink

final class TensorflowServingRunner extends BaseRunner[ModelSession, OnDemandRunnerInfo, ModelServingState]

:: ApplicationDeveloperApi ::

Runner that serves a tensorflow model and provides RESTful APIs.

Linear Supertypes
BaseRunner[ModelSession, OnDemandRunnerInfo, ModelServingState], BaseDoer, Logging, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. TensorflowServingRunner
  2. BaseRunner
  3. BaseDoer
  4. Logging
  5. Serializable
  6. Serializable
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new TensorflowServingRunner(o: OnDemandRunnerInfo)

    Permalink

    o

    Object that contains message ksb.csle.common.proto.RunnerProto.TensorflowServingRunnerInfo TensorflowServingRunnerInfo containing attributes are as follows:

    • port: Port number for RESTful APIs (required)
    • modelName: Model name (required)
    • modelBasePath: Model location (required) if in the local file system, set '/model/base'. if in the HDFS, set 'hdfs://ip:port/model/base'. if gRPC model server, set 'grpc://ip:port'.
    • options: options of tensorflow model serving (repeated)

    TensorflowServingRunnerInfo

    message TensorflowServingRunnerInfo {
      required int32 port = 1 [default = 8001];
      required string modelName = 2 [default = "default"];
      required string modelBasePath = 3 [default = "/your/model/base"];
      repeated ServingOption options = 4;
    }

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  10. def getSession: ModelSession

    Permalink

    Get the session to access the model server.

    Get the session to access the model server.

    returns

    ModelSession Session to access the model server

    Definition Classes
    TensorflowServingRunner → BaseRunner
  11. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  12. def init(op: Any): ModelServingState

    Permalink

    Initialize the runner for tensorflow model serving.

    Initialize the runner for tensorflow model serving.

    op

    TensorflowServingOperator instance.

    returns

    ModelServingState State of model serving

    Definition Classes
    TensorflowServingRunner → BaseRunner
  13. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  14. val logger: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  15. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  16. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  18. def run(a: Any): ModelServingState

    Permalink

    Start the runner for tensorflow model serving.

    Start the runner for tensorflow model serving.

    returns

    ModelServingState State of model serving

    Definition Classes
    TensorflowServingRunner → BaseRunner
  19. def stop: Unit

    Permalink

    Stop the runner.

    Stop the runner.

    Definition Classes
    TensorflowServingRunner → BaseRunner
  20. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  21. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  22. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from BaseRunner[ModelSession, OnDemandRunnerInfo, ModelServingState]

Inherited from BaseDoer

Inherited from Logging

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped