Package prediction (1.70.0)

API documentation for aiplatform.prediction package.

Classes

DefaultSerializer

Default serializer for serialization and deserialization for prediction.

Handler

Interface for Handler class to handle prediction requests.

LocalEndpoint

Class that represents a local endpoint.

LocalModel

Class that represents a local model.

PredictionHandler

Default prediction handler for the prediction requests sent to the application.

Predictor

Interface of the Predictor class for Custom Prediction Routines.

The Predictor is responsible for the ML logic for processing a prediction request. Specifically, the Predictor must define: (1) How to load all model artifacts used during prediction into memory. (2) The logic that should be executed at predict time.

When using the default PredictionHandler, the Predictor will be invoked as follows:

predictor.postprocess(predictor.predict(predictor.preprocess(prediction_input)))

Serializer

Interface to implement serialization and deserialization for prediction.