o i @sGdddZdS)c@s,eZdZ   d ddZ   d ddZdS) BaseModelffffff?333333?333333?cCdS)zN Takes a list of prompts and returns the output hidden states N)selfpromptstop_p temperaturerepetition_penaltyrrI/home/ubuntu/.local/lib/python3.10/site-packages/soprano/backends/base.pyinferzBaseModel.infercCr)zT Takes a prompt and returns an iterator of the output hidden states Nr)rpromptr r r rrr stream_infer rzBaseModel.stream_inferN)rrr)__name__ __module__ __qualname__r rrrrr rs  rN)rrrrr s