o qmi@s^ddlZddlmZddlmZddlmZmZddlm Z m Z ddl m Z ddl mZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlm Z ddl!m"Z"ddl#m$Z$ddl%m&Z&ddl'm(Z(ddl)m*Z*ddl+m,Z,ddl-m.Z.ddl/m0Z0ddl1m2Z2e3ej4dZ5GdddZ6GdddZ7dS) N)JSONDecodeError)ApiError)AsyncClientWrapperSyncClientWrapper)AsyncHttpResponse HttpResponse) parse_obj_as)RequestOptions)BadRequestError)ForbiddenError)InternalServerError)TooManyRequestsError)UnprocessableEntityError)LanguageIdentificationResponse)NumeralsFormat)SpokenFormNumeralsFormat) TranslateMode)TranslateModel)TranslateSourceLanguage)TranslateSpeakerGender)TranslateTargetLanguage)TranslationResponse)TranslatiterateTargetLanguage)TransliterateMode)TransliterateSourceLanguage)TransliterationResponse.c@eZdZdefddZeeeeedddededed e j e d e j e d e j e d e j ed e j ede j edeefddZdddede j edeefddZeeedddededed e j ede j ede j ede j edeefddZdS) RawTextClientclient_wrappercC ||_dSN_client_wrapperselfrr&L/home/ubuntu/.local/lib/python3.10/site-packages/sarvamai/text/raw_client.py__init__# zRawTextClient.__init__Nspeaker_gendermodemodel output_scriptnumerals_formatrequest_optionsinputsource_language_codetarget_language_coder+r,r-r.r/r0returnc Cs|jjjd|jjd||||||||dddi| td} zd| jkr)dkr>nntt t t | d } t | | d WS| jd kr^t t| jttjtjt tjtj| d d | jd kr~tt| jttjtjt tjtj| d d | jdkrtt| jttjtjt tjtj| d d | jdkrtt| jttjtjt tjtj| d d | jdkrtt| jttjtjt tjtj| d d | } Wntyt| jt| j| jdwt| jt| j| d)u **Translation** converts text from one language to another while preserving its meaning. For Example: **'मैं ऑफिस जा रहा हूँ'** translates to **'I am going to the office'** in English, where the script and language change, but the original meaning remains the same. Available languages: - **`bn-IN`**: Bengali - **`en-IN`**: English - **`gu-IN`**: Gujarati - **`hi-IN`**: Hindi - **`kn-IN`**: Kannada - **`ml-IN`**: Malayalam - **`mr-IN`**: Marathi - **`od-IN`**: Odia - **`pa-IN`**: Punjabi - **`ta-IN`**: Tamil - **`te-IN`**: Telugu ### Newly added languages: - **`as-IN`**: Assamese - **`brx-IN`**: Bodo - **`doi-IN`**: Dogri - **`kok-IN`**: Konkani - **`ks-IN`**: Kashmiri - **`mai-IN`**: Maithili - **`mni-IN`**: Manipuri (Meiteilon) - **`ne-IN`**: Nepali - **`sa-IN`**: Sanskrit - **`sat-IN`**: Santali - **`sd-IN`**: Sindhi - **`ur-IN`**: Urdu For hands-on practice, you can explore the notebook tutorial on [Translate API Tutorial](https://github.com/sarvamai/sarvam-ai-cookbook/blob/main/notebooks/translate/Translate_API_Tutorial.ipynb). Parameters ---------- input : str The text you want to translate is the input text that will be processed by the translation model. The maximum is 1000 characters for Mayura:v1 and 2000 characters for Sarvam-Translate:v1. source_language_code : TranslateSourceLanguage Source language code for translation input. **mayura:v1 Languages:** Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Punjabi, Tamil, Telugu **sarvam-translate:v1 Languages:** All mayura:v1 languages and Assamese, Bodo, Dogri, Konkani, Kashmiri, Maithili, Manipuri, Nepali, Sanskrit, Santali, Sindhi, Urdu **Note:** mayura:v1 supports automatic language detection using 'auto' as the source language code. target_language_code : TranslateTargetLanguage The language code of the translated text. This specifies the target language for translation. **mayura:v1 Languages:** Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Punjabi, Tamil, Telugu **sarvam-translate:v1 Languages:** All mayura:v1 and Assamese, Bodo, Dogri, Konkani, Kashmiri, Maithili, Manipuri, Nepali, Sanskrit, Santali, Sindhi, Urdu speaker_gender : typing.Optional[TranslateSpeakerGender] Please specify the gender of the speaker for better translations. mode : typing.Optional[TranslateMode] Specifies the tone or style of the translation. **Model Support:** - **mayura:v1**: Supports formal, classic-colloquial, and modern-colloquial modes - **sarvam-translate:v1**: Only formal mode is supported **Default:** formal model : typing.Optional[TranslateModel] Specifies the translation model to use. - mayura:v1: Supports 12 languages with all modes, output scripts, and automatic language detection. - sarvam-translate:v1: Supports all 22 scheduled languages of India, formal mode only. output_script : typing.Optional[TransliterateMode] **output_script**: This is an optional parameter which controls the transliteration style applied to the output text. **Transliteration**: Converting text from one script to another while preserving pronunciation. For mayura:v1 - We support transliteration with four options: - **`null`**(default): No transliteration applied. - **`roman`**: Transliteration in Romanized script. - **`fully-native`**: Transliteration in the native script with formal style. - **`spoken-form-in-native`**: Transliteration in the native script with spoken style. For sarvam-translate:v1 - Transliteration is not supported. ### Example: English: Your EMI of Rs. 3000 is pending. Default modern translation: आपका Rs. 3000 का EMI pending है (when `null` is passed). With postprocessing enabled: - **roman output**: aapka Rs. 3000 ka EMI pending hai. numerals_format : typing.Optional[NumeralsFormat] `numerals_format` is an optional parameter with two options (supported for both mayura:v1 and sarvam-translate:v1): - **`international`** (default): Uses regular numerals (0-9). - **`native`**: Uses language-specific native numerals. ### Example: - If `international` format is selected, we use regular numerals (0-9). For example: `मेरा phone number है: 9840950950`. - If `native` format is selected, we use language-specific native numerals, like: `मेरा phone number है: ९८४०९५०९५०`. request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[TranslationResponse] Successful Response translatePOSTr1r2r3r+r,r-r.r/ content-typeapplication/jsonbase_urlmethodjsonheadersr0omit,type_object_responsedatar>body status_coder>rJ)r# httpx_clientrequestget_environmentbaseOMITrPtypingcastrr r=rr dictr>OptionalAnyr rrr rrtext r%r1r2r3r+r,r-r.r/r0 _response_data_response_jsonr&r&r'r5&s{                  zRawTextClient.translater0c Cs|jjjd|jjdd|iddi|td}zd|jkr"dkr7nntt t t | d }t ||d WS|jd krWt t|jttjtjt tjtj| d d |jd krwtt|jttjtjt tjtj| d d |jdkrtt|jttjtjt tjtj| d d |jdkrtt|jttjtjt tjtj| d d |jdkrtt|jttjtjt tjtj| d d | }Wntyt|jt|j|jdwt|jt|j|d)a Identifies the language (e.g., en-IN, hi-IN) and script (e.g., Latin, Devanagari) of the input text, supporting multiple languages. Parameters ---------- input : str The text input for language and script identification. Max Input Limit is 1000 characters request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[LanguageIdentificationResponse] Successful Response text-lidr6r1r8r9r:r@rArBrErHrIrKrLrMrNrO)r#rQrRrSrTrUrPrVrWrr r=rr rXr>rYrZr rrr rrr[r%r1r0r]r^r_r&r&r'identify_languages                  zRawTextClient.identify_languager/spoken_form_numerals_language spoken_formr0rerfc Cs|jjjd|jjd||||||dddi|td}zd|jkr'dkrrYrZr rrr rrr[ r%r1r2r3r/rerfr0r]r^r_r&r&r'rgas`                  zRawTextClient.transliterate)__name__ __module__ __qualname__rr(rUstrrrrVrYrrrrrr rrr5rrcrrrboolrrgr&r&r&r'r"v     W l  rc@r)AsyncRawTextClientrcCr r!r"r$r&r&r'r(r)zAsyncRawTextClient.__init__Nr*r1r2r3r+r,r-r.r/r0r4c s |jjjd|jjd||||||||dddi| tdIdH} zd| jkr-d krBnntt t t | d } t | | d WS| jd krbt t| jttjtjt tjtj| d d | jdkrtt| jttjtjt tjtj| d d | jdkrtt| jttjtjt tjtj| d d | jdkrtt| jttjtjt tjtj| d d | jdkrtt| jttjtjt tjtj| d d | } Wntyt| jt| j| jdwt| jt| j| d)u **Translation** converts text from one language to another while preserving its meaning. For Example: **'मैं ऑफिस जा रहा हूँ'** translates to **'I am going to the office'** in English, where the script and language change, but the original meaning remains the same. Available languages: - **`bn-IN`**: Bengali - **`en-IN`**: English - **`gu-IN`**: Gujarati - **`hi-IN`**: Hindi - **`kn-IN`**: Kannada - **`ml-IN`**: Malayalam - **`mr-IN`**: Marathi - **`od-IN`**: Odia - **`pa-IN`**: Punjabi - **`ta-IN`**: Tamil - **`te-IN`**: Telugu ### Newly added languages: - **`as-IN`**: Assamese - **`brx-IN`**: Bodo - **`doi-IN`**: Dogri - **`kok-IN`**: Konkani - **`ks-IN`**: Kashmiri - **`mai-IN`**: Maithili - **`mni-IN`**: Manipuri (Meiteilon) - **`ne-IN`**: Nepali - **`sa-IN`**: Sanskrit - **`sat-IN`**: Santali - **`sd-IN`**: Sindhi - **`ur-IN`**: Urdu For hands-on practice, you can explore the notebook tutorial on [Translate API Tutorial](https://github.com/sarvamai/sarvam-ai-cookbook/blob/main/notebooks/translate/Translate_API_Tutorial.ipynb). Parameters ---------- input : str The text you want to translate is the input text that will be processed by the translation model. The maximum is 1000 characters for Mayura:v1 and 2000 characters for Sarvam-Translate:v1. source_language_code : TranslateSourceLanguage Source language code for translation input. **mayura:v1 Languages:** Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Punjabi, Tamil, Telugu **sarvam-translate:v1 Languages:** All mayura:v1 languages and Assamese, Bodo, Dogri, Konkani, Kashmiri, Maithili, Manipuri, Nepali, Sanskrit, Santali, Sindhi, Urdu **Note:** mayura:v1 supports automatic language detection using 'auto' as the source language code. target_language_code : TranslateTargetLanguage The language code of the translated text. This specifies the target language for translation. **mayura:v1 Languages:** Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Punjabi, Tamil, Telugu **sarvam-translate:v1 Languages:** All mayura:v1 and Assamese, Bodo, Dogri, Konkani, Kashmiri, Maithili, Manipuri, Nepali, Sanskrit, Santali, Sindhi, Urdu speaker_gender : typing.Optional[TranslateSpeakerGender] Please specify the gender of the speaker for better translations. mode : typing.Optional[TranslateMode] Specifies the tone or style of the translation. **Model Support:** - **mayura:v1**: Supports formal, classic-colloquial, and modern-colloquial modes - **sarvam-translate:v1**: Only formal mode is supported **Default:** formal model : typing.Optional[TranslateModel] Specifies the translation model to use. - mayura:v1: Supports 12 languages with all modes, output scripts, and automatic language detection. - sarvam-translate:v1: Supports all 22 scheduled languages of India, formal mode only. output_script : typing.Optional[TransliterateMode] **output_script**: This is an optional parameter which controls the transliteration style applied to the output text. **Transliteration**: Converting text from one script to another while preserving pronunciation. For mayura:v1 - We support transliteration with four options: - **`null`**(default): No transliteration applied. - **`roman`**: Transliteration in Romanized script. - **`fully-native`**: Transliteration in the native script with formal style. - **`spoken-form-in-native`**: Transliteration in the native script with spoken style. For sarvam-translate:v1 - Transliteration is not supported. ### Example: English: Your EMI of Rs. 3000 is pending. Default modern translation: आपका Rs. 3000 का EMI pending है (when `null` is passed). With postprocessing enabled: - **roman output**: aapka Rs. 3000 ka EMI pending hai. numerals_format : typing.Optional[NumeralsFormat] `numerals_format` is an optional parameter with two options (supported for both mayura:v1 and sarvam-translate:v1): - **`international`** (default): Uses regular numerals (0-9). - **`native`**: Uses language-specific native numerals. ### Example: - If `international` format is selected, we use regular numerals (0-9). For example: `मेरा phone number है: 9840950950`. - If `native` format is selected, we use language-specific native numerals, like: `मेरा phone number है: ९८४०९५०९५०`. request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[TranslationResponse] Successful Response r5r6r7r8r9r:Nr@rArBrErHrIrKrLrMrNrO)r#rQrRrSrTrUrPrVrWrr r=rr rXr>rYrZr rrr rrr[r\r&r&r'r5s{                   zAsyncRawTextClient.translater`c s|jjjd|jjdd|iddi|tdIdH}zd|jkr&d kr;nntt t t | d }t ||d WS|jd kr[t t|jttjtjt tjtj| d d |jdkr{tt|jttjtjt tjtj| d d |jdkrtt|jttjtjt tjtj| d d |jdkrtt|jttjtjt tjtj| d d |jdkrtt|jttjtjt tjtj| d d | }Wntyt|jt|j|jdwt|jt|j|d)a Identifies the language (e.g., en-IN, hi-IN) and script (e.g., Latin, Devanagari) of the input text, supporting multiple languages. Parameters ---------- input : str The text input for language and script identification. Max Input Limit is 1000 characters request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[LanguageIdentificationResponse] Successful Response rar6r1r8r9r:Nr@rArBrErHrIrKrLrMrNrO)r#rQrRrSrTrUrPrVrWrr r=rr rXr>rYrZr rrr rrr[rbr&r&r'rcs                   z$AsyncRawTextClient.identify_languagerdrerfc s|jjjd|jjd||||||dddi|tdIdH}zd|jkr+d kr@nntt t t | d } t || d WS|jd kr`t t|jttjtjt tjtj| d d |jdkrtt|jttjtjt tjtj| d d |jdkrtt|jttjtjt tjtj| d d |jdkrtt|jttjtjt tjtj| d d |jdkrtt|jttjtjt tjtj| d d | } Wntyt|jt|j|jdwt|jt|j| d)u **Transliteration** converts text from one script to another while preserving the original pronunciation. For example, **'नमस्ते'** becomes **'namaste'** in English, and **'how are you'** can be written as **'हाउ आर यू'** in Devanagari. This process ensures that the sound of the original text remains intact, even when written in a different script. Transliteration is useful when you want to represent words phonetically across different writing systems, such as converting **'मैं ऑफिस जा रहा हूँ'** to **'main office ja raha hun'** in English letters. **Translation**, on the other hand, converts text from one language to another while preserving the meaning rather than pronunciation. For example, **'मैं ऑफिस जा रहा हूँ'** translates to **'I am going to the office'** in English, changing both the script and the language while conveying the intended message. ### Examples of **Transliteration**: - **'Good morning'** becomes **'गुड मॉर्निंग'** in Hindi, where the pronunciation is preserved but the meaning is not translated. - **'सुप्रभात'** becomes **'suprabhat'** in English. Available languages: - **`en-IN`**: English - **`hi-IN`**: Hindi - **`bn-IN`**: Bengali - **`gu-IN`**: Gujarati - **`kn-IN`**: Kannada - **`ml-IN`**: Malayalam - **`mr-IN`**: Marathi - **`od-IN`**: Odia - **`pa-IN`**: Punjabi - **`ta-IN`**: Tamil - **`te-IN`**: Telugu For hands-on practice, you can explore the notebook tutorial on [Transliterate API Tutorial](https://github.com/sarvamai/sarvam-ai-cookbook/blob/main/notebooks/transliterate/Transliterate_API_Tutorial.ipynb). Parameters ---------- input : str The text you want to transliterate. source_language_code : TransliterateSourceLanguage The language code of the input text. This specifies the source language for transliteration. Note: The source language should either be an Indic language or English. As we supports both Indic-to-English and English-to-Indic transliteration. target_language_code : TranslatiterateTargetLanguage The language code of the transliteration text. This specifies the target language for transliteration. Note:The target language should either be an Indic language or English. As we supports both Indic-to-English and English-to-Indic transliteration. numerals_format : typing.Optional[NumeralsFormat] `numerals_format` is an optional parameter with two options: - **`international`** (default): Uses regular numerals (0-9). - **`native`**: Uses language-specific native numerals. ### Example: - If `international` format is selected, we use regular numerals (0-9). For example: `मेरा phone number है: 9840950950`. - If `native` format is selected, we use language-specific native numerals, like: `मेरा phone number है: ९८४०९५०९५०`. spoken_form_numerals_language : typing.Optional[SpokenFormNumeralsFormat] `spoken_form_numerals_language` is an optional parameter with two options and only works when spoken_form is true: - **`english`** : Numbers in the text will be spoken in English. - **`native(default)`**: Numbers in the text will be spoken in the native language. ### Examples: - **Input:** "मेरे पास ₹200 है" - If `english` format is selected: "मेरे पास टू हन्डर्ड रूपीस है" - If `native` format is selected: "मेरे पास दो सौ रुपये है" spoken_form : typing.Optional[bool] - Default: `False` - Converts text into a natural spoken form when `True`. - **Note:** No effect if output language is `en-IN`. ### Example: - **Input:** `मुझे कल 9:30am को appointment है` - **Output:** `मुझे कल सुबह साढ़े नौ बजे को अपॉइंटमेंट है` request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[TransliterationResponse] Successful Response rgr6rhr8r9r:Nr@rArBrErHrIrKrLrMrNrO)r#rQrRrSrTrUrPrVrWrr r=rr rXr>rYrZr rrr rrr[rir&r&r'rgYs`                   z AsyncRawTextClient.transliterate)rjrkrlrr(rUrmrrrVrYrrrrrr rrr5rrcrrrrnrrgr&r&r&r'rprorp)8rV json.decoderrcore.api_errorrcore.client_wrapperrrcore.http_responserrcore.pydantic_utilitiesr core.request_optionsr errors.bad_request_errorr errors.forbidden_errorr errors.internal_server_errorr errors.too_many_requests_errorr!errors.unprocessable_entity_errorr&types.language_identification_responsertypes.numerals_formatr!types.spoken_form_numerals_formatrtypes.translate_modertypes.translate_modelrtypes.translate_source_languagertypes.translate_speaker_genderrtypes.translate_target_languagertypes.translation_responser%types.translatiterate_target_languagertypes.transliterate_moder#types.transliterate_source_languagertypes.transliteration_responserrWrZrUrrpr&r&r&r's>                      {