o zi @sddlmZddlZddlmZddlZddlmZm Z m Z m Z m Z ddl mZdeddfd d Zded ddfd d ZdeddfddZddde ddfddZdS))UnionN)OptimizedModule) DDPStrategyDeepSpeedStrategy FSDPStrategySingleDeviceStrategyStrategy)_check_mixed_importsmodelreturnpl.LightningModulecCst|tstdt|jd|j}t|tjs(t|tdt|jdd|j |j |j |j |j |jd|_| |j |_ | |j |_ | |j |_ | |j |_ | |j|_|S)aZReturns an instance LightningModule from the output of ``torch.compile``. .. warning:: This is an :ref:`experimental ` feature. The ``torch.compile`` function returns a ``torch._dynamo.OptimizedModule``, which wraps the LightningModule passed in as an argument, but doesn't inherit from it. This means that the output of ``torch.compile`` behaves like a LightningModule, but it doesn't inherit from it (i.e. `isinstance` will fail). Use this method to obtain a LightningModule that still runs with all the optimizations from ``torch.compile``. z8`model` is required to be a `OptimizedModule`. Found a `z ` instead.z?`model` is expected to be a compiled LightningModule. Found a `z ` insteaddynamo)compiler dynamo_ctxoriginal_forwardoriginal_training_steporiginal_validation_steporiginal_test_steporiginal_predict_step) isinstancer ValueErrortype__name__ _orig_modplLightningModuler rforward training_stepvalidation_step test_step predict_step _compiler_ctx)r orig_moduler#W/home/ubuntu/.local/lib/python3.10/site-packages/pytorch_lightning/utilities/compile.py from_compileds,   r%)r ztorch._dynamo.OptimizedModulecCst|tr|j}t|tjstdt|jnt|tjr+|jdur(t d|}nt d|j}|durR|d|_ |d|_ |d|_ |d|_ |d |_d|_|S) aReturns an instance of LightningModule without any compilation optimizations from a compiled model. .. warning:: This is an :ref:`experimental ` feature. This takes either a ``torch._dynamo.OptimizedModule`` returned by ``torch.compile()`` or a ``LightningModule`` returned by ``from_compiled``. Note: this method will in-place modify the ``LightningModule`` that is passed in. zGUnexpected error, the wrapped model should be a LightningModule, found Nzc`model` is required to be a compiled LightningModule. Found a non-compiled LightningModule instead.zH`model` must either be an instance of OptimizedModule or LightningModulerrrrr)rrrrr TypeErrorrrr!rrrrrr )r originalctxr#r#r$ to_uncompiledAs.         r)cCs@t|tr t|St|tjr|St|tdt|jd)NzM`model` must be a `LightningModule` or `torch._dynamo.OptimizedModule`, got ``) rrr%rrr r&r __qualname__)r r#r#r$_maybe_unwrap_optimizedis  r,strategycCs`|jdur,tttf}t||rt|tr.ddd|D}tdt|j d|ddSdS)Nz, css|]}|jVqdS)N)r).0sr#r#r$ xsz4_verify_strategy_supports_compile..zCUsing a compiled model is incompatible with the current strategy: `z`. Only zj support compilation. Either switch to one of the supported strategies or avoid passing in compiled model.) r!rrrrrjoin RuntimeErrorrr)r r-supported_strategiessupported_strategy_namesr#r#r$!_verify_strategy_supports_compilets  r5)typingrtorch torch._dynamorpytorch_lightningrpytorch_lightning.strategiesrrrrr)pytorch_lightning.utilities.model_helpersr r%r)objectr,r5r#r#r#r$s   )(