o Ti @sRddlZddlZddlZddlZddlmZddlmZmZGdddej Z dS)N)Optional)ACCEPTED_MODEL_TYPES ModelSpecc @szeZdZdZedejdejfddZdejde fddZ dd e d e e d e e de de f ddZ ejddZd S) Converterz Base class for model converters.parserreturncCsF|jdddd|jdddd|jd dtd d |jd d dd|S)zAdds common conversion options to the command line parser. Arguments: parser: Command line argument parser. z --output_dirTzOutput model directory.)requiredhelpz--vocab_mappingNz#Vocabulary mapping file (optional).)defaultr z--quantizationzWeight quantization type.)r choicesr z--force store_truez=Force conversion even if the output directory already exists.)actionr ) add_argumentr)rrT/home/ubuntu/.local/lib/python3.10/site-packages/ctranslate2/converters/converter.pydeclare_argumentss$zConverter.declare_argumentsargscCs|j|j|j|j|jdS)aHelper function to call :meth:`ctranslate2.converters.Converter.convert` with the parsed command line options. Arguments: args: Namespace containing parsed arguments. Returns: Path to the output directory. )vmap quantizationforce)convert output_dir vocab_mappingrr)selfrrrrconvert_from_args(s  zConverter.convert_from_argsNFrrrrcCstj|r|std||}|durtd|dur#||||j|dtj|r8t |t || ||S)a)Converts the model to the CTranslate2 format. Arguments: output_dir: Output directory where the CTranslate2 model is saved. vmap: Optional path to a vocabulary mapping file that will be included in the converted model directory. quantization: Weight quantization scheme (possible values are: int8, int8_float32, int8_float16, int8_bfloat16, int16, float16, bfloat16, float32). force: Override the output directory if it already exists. Returns: Path to the output directory. Raises: RuntimeError: If the output directory already exists and :obj:`force` is not set. NotImplementedError: If the converter cannot convert this model to the CTranslate2 format. z;output directory %s already exists, use --force to overrideNzs