o zi @sVddlmZmZddlmZmZmZmZddlZddlm Z Gdddeej j Z dS))ABCabstractmethod)AnyCallableDictTupleN)Tensorc @seZdZdZedeeeffddZede eee feee fffddZ ede de deee ffd d Z edeeeffd d Zd S)ServableModuleaIThe ServableModule provides a simple API to make your model servable. .. warning:: This is an :ref:`experimental ` feature. Here is an example of how to use the ``ServableModule`` module. .. code-block:: python from typing import Dict, Any, Callable import torch from pytorch_lightning import Trainer from pytorch_lightning.demos.boring_classes import BoringModel from pytorch_lightning.serve.servable_module_validator import ServableModule, ServableModuleValidator class ServableBoringModel(BoringModel, ServableModule): def configure_payload(self) -> Dict[str, Any]: return {"body": {"x": list(range(32))}} def configure_serialization(self) -> Tuple[Dict[str, Callable], Dict[str, Callable]]: def deserialize(x): return torch.tensor(x, dtype=torch.float) def serialize(x): return x.tolist() return {"x": deserialize}, {"output": serialize} def serve_step(self, x: torch.Tensor) -> Dict[str, torch.Tensor]: return {"output": torch.tensor([0, 1])} def configure_response(self): return {"output": [0, 1]} serve_cb = ServableModuleValidator() trainer = Trainer( max_epochs=1, limit_train_batches=2, limit_val_batches=0, callbacks=[serve_cb], ) trainer.fit(ServableBoringModel()) assert serve_cb.resp.json() == {"output": [0, 1]} returncCdS)z*Returns a request payload as a dictionary.Nselfr r [/home/ubuntu/.local/lib/python3.10/site-packages/pytorch_lightning/serve/servable_module.pyconfigure_payload:z ServableModule.configure_payloadcCr )aReturns a tuple of dictionaries. The first dictionary contains the name of the ``serve_step`` input variables name as its keys and the associated de-serialization function (e.g function to convert a payload to tensors). The second dictionary contains the name of the ``serve_step`` output variables name as its keys and the associated serialization function (e.g function to convert a tensors into payload). Nr r r r rconfigure_serialization>rz&ServableModule.configure_serializationargskwargscOr )a(Returns the predictions of your model as a dictionary. .. code-block:: python def serve_step(self, x: torch.Tensor) -> Dict[str, torch.Tensor]: return {"predictions": self(x)} Args: args: The output from de-serializer functions provided by the ``configure_serialization`` hook. kwargs: The keyword output of the de-serializer functions provided by the ``configure_serialization`` hook. Return: - ``dict`` - A dictionary with their associated tensors. Nr )rrrr r r serve_stepJrzServableModule.serve_stepcCr )z3Returns a response to validate the server response.Nr r r r rconfigure_response\rz!ServableModule.configure_responseN)__name__ __module__ __qualname____doc__rrstrrrrrrrrrr r r rr s1( r ) abcrrtypingrrrrtorchrnnModuler r r r rs