o ۷ia4@sddlmZddlZddlmZddlmZmZddl m Z ddl m Z m Z mZmZmZmZe eZejjGdd d ZeGd d d eZGd d d eeZdS)) dataclassN) ConfigMixinregister_to_config)logging)CommonSchedulerStateFlaxKarrasDiffusionSchedulersFlaxSchedulerMixinFlaxSchedulerOutputadd_noise_commonget_velocity_commonc @sdeZdZUeed<ejed<ejed<ejed<dZeed<e dedejdejdejfddZ dS) DDIMSchedulerStatecommonfinal_alpha_cumprodinit_noise_sigma timestepsNnum_inference_stepscCs|||||dS)Nrrrr)clsrrrrrr_/home/ubuntu/vllm_env/lib/python3.10/site-packages/diffusers/schedulers/scheduling_ddim_flax.pycreate0s zDDIMSchedulerState.create) __name__ __module__ __qualname__r__annotations__jnpndarrayrint classmethodrrrrrr&s     rc@seZdZUeed<dS)FlaxDDIMSchedulerOutputstateN)rrrrrrrrrr!@s r!c@seZdZUdZddeDZejed<e ddZ e ddd d d d d d ddej f de dedededejd Bdededede dedejfddZd;ded BdefddZ d;d ed!ejd"e d Bdejfd#d$Z %dFlaxDDIMSchedulera~ Denoising diffusion implicit models is a scheduler that extends the denoising procedure introduced in denoising diffusion probabilistic models (DDPMs) with non-Markovian guidance. [`~ConfigMixin`] takes care of storing all config attributes that are passed in the scheduler's `__init__` function, such as `num_train_timesteps`. They can be accessed via `scheduler.config.num_train_timesteps`. [`SchedulerMixin`] provides general loading and saving functionality via the [`SchedulerMixin.save_pretrained`] and [`~SchedulerMixin.from_pretrained`] functions. For more details, see the original paper: https://huggingface.co/papers/2010.02502 Args: num_train_timesteps (`int`): number of diffusion steps used to train the model. beta_start (`float`): the starting `beta` value of inference. beta_end (`float`): the final `beta` value. beta_schedule (`str`): the beta schedule, a mapping from a beta range to a sequence of betas for stepping the model. Choose from `linear`, `scaled_linear`, or `squaredcos_cap_v2`. trained_betas (`jnp.ndarray`, optional): option to pass an array of betas directly to the constructor to bypass `beta_start`, `beta_end` etc. clip_sample (`bool`, default `True`): option to clip predicted sample between for numerical stability. The clip range is determined by `clip_sample_range`. clip_sample_range (`float`, default `1.0`): the maximum magnitude for sample clipping. Valid only when `clip_sample=True`. set_alpha_to_one (`bool`, default `True`): each diffusion step uses the value of alphas product at that step and at the previous one. For the final step there is no previous alpha. When this option is `True` the previous alpha product is fixed to `1`, otherwise it uses the value of alpha at step 0. steps_offset (`int`, default `0`): An offset added to the inference steps, as required by some model families. prediction_type (`str`, default `epsilon`): indicates whether the model predicts the noise (epsilon), or the samples. One of `epsilon`, `sample`. `v-prediction` is not supported for this scheduler. dtype (`jnp.dtype`, *optional*, defaults to `jnp.float32`): the `dtype` used for params and computation. cCsg|]}|jqSr)name).0errr lszFlaxDDIMScheduler.dtypecCsdS)NTrselfrrr has_statepszFlaxDDIMScheduler.has_stateig-C6?g{Gz?linearNT?repsilonnum_train_timesteps beta_startbeta_end beta_schedule trained_betas clip_sampleclip_sample_rangeset_alpha_to_one steps_offsetprediction_typec Cstd| |_dS)NzFlax classes are deprecated and will be removed in Diffusers v1.0.0. We recommend migrating to PyTorch classes or pinning your version of Diffusers.)loggerwarningr() r*r/r0r1r2r3r4r5r6r7r8r(rrr__init__ts zFlaxDDIMScheduler.__init__rreturncCst|dur t|}|jjrtjd|jdn|jd}tjd|jd}td|jj  ddd}t j||||dS)Nr-)r(rr) rrconfigr6rarrayr(alphas_cumprodaranger/roundr)r*rrrrrrr create_states  zFlaxDDIMScheduler.create_stater"sampletimestepcCs|S)a Args: state (`PNDMSchedulerState`): the `FlaxPNDMScheduler` state data class instance. sample (`jnp.ndarray`): input sample timestep (`int`, optional): current timestep Returns: `jnp.ndarray`: scaled input sample r)r*r"rDrErrrscale_model_inputsz#FlaxDDIMScheduler.scale_model_inputrrshapecCs@|jj|}td||ddd|jj}|j||dS)a Sets the discrete timesteps used for the diffusion chain. Supporting function to be run before inference. Args: state (`DDIMSchedulerState`): the `FlaxDDIMScheduler` state data class instance. num_inference_steps (`int`): the number of diffusion steps used when generating samples with a pre-trained model. rNr=)rr)r>r/rrArBr7replace)r*r"rrG step_ratiorrrr set_timestepss &zFlaxDDIMScheduler.set_timestepsc CsP|jj|}t|dk|jj||j}d|}d|}||d||}|S)Nrr)rr@rwherer) r*r"rE prev_timestep alpha_prod_talpha_prod_t_prev beta_prod_tbeta_prod_t_prevvariancerrr _get_variances  zFlaxDDIMScheduler._get_variance model_outputeta return_dictcCsv|jdur td||jj|j}|jj}|j} ||} t|dk||| } d| } |jj dkrA|| d|| d} |}n>|jj dkrV|} || d| | d}n)|jj dkru| d|| d|} | d|| d|}n td |jj d |jj r| |jj |jj } | |||}||d}d| |d d|}| d| |}|s||fSt||d S) a Predict the sample at the previous timestep by reversing the SDE. Core function to propagate the diffusion process from the learned model outputs (most often the predicted noise). Args: state (`DDIMSchedulerState`): the `FlaxDDIMScheduler` state data class instance. model_output (`jnp.ndarray`): direct output from learned diffusion model. timestep (`int`): current discrete timestep in the diffusion chain. sample (`jnp.ndarray`): current instance of sample being created by diffusion process. return_dict (`bool`): option for returning tuple rather than FlaxDDIMSchedulerOutput class Returns: [`FlaxDDIMSchedulerOutput`] or `tuple`: [`FlaxDDIMSchedulerOutput`] if `return_dict` is True, otherwise a `tuple`. When returning a tuple, the first element is the sample tensor. NzaNumber of inference steps is 'None', you need to run 'set_timesteps' after creating the schedulerrrr.g?rD v_predictionzprediction_type given as z6 must be one of `epsilon`, `sample`, or `v_prediction`r) prev_sampler")r ValueErrorr>r/rr@rrrKr8r4clipr5rRr!)r*r"rTrErDrUrVrLr@rrMrNrOpred_original_sample pred_epsilonrQ std_dev_tpred_sample_directionrXrrrstepsB      zFlaxDDIMScheduler.steporiginal_samplesnoisercCt|j|||SN)r r)r*r"r`rarrrr add_noise3zFlaxDDIMScheduler.add_noisecCrbrc)r r)r*r"rDrarrrr get_velocity<rezFlaxDDIMScheduler.get_velocitycCs|jjSrc)r>r/r)rrr__len__EszFlaxDDIMScheduler.__len__rc)r)rST)rrr__doc__r _compatiblesrr(rpropertyr+rfloat32rfloatstrrboolr;rrrCrFtuplerJrRr!r_rdrfrgrrrrr#Es &         ]   r#) dataclassesrflax jax.numpynumpyrconfiguration_utilsrrutilsrscheduling_utils_flaxrr r r r r get_loggerrr9structrr!r#rrrrs