o ©Ì³inã@sTddlmZmZddlmZmZmZmZmZm Z ddl m Z m Z m Z mZgd¢ZdS)é)ÚPPOStatsÚ Trajectory)Úestimate_advantagesÚget_reward_penalty_maskÚget_rewards_ppoÚ masked_meanÚ masked_varÚwhiten)Úget_batch_log_probsÚlogits_to_logprobsÚ%truncate_sequence_at_first_stop_tokenÚtruncate_sequence_for_logprobs) r r r rrrr rrrr rN)Ú_typesrrÚrewardsrrrrrr Úsequence_processingr r r r Ú__all__©rrúK/home/ubuntu/.local/lib/python3.10/site-packages/torchtune/rlhf/__init__.pyÚs