o ;i-9@sddlZddlZddlmZddlmZddlmZmZm Z ddl m Z ddl m Z mZddlmZdd lmZdd lmZdd lmZdd lmZmZdd lmZddlmZddlm Z ddl!m"Z"ddl#m$Z$m%Z%m&Z&m'Z'ddl(m)Z)ddl*m+Z+m,Z,m-Z-m.Z.ddZ/ddZ0de1fddZ2de fddZeee3dZ4eGd d!d!Z5ej6dCd#e7d$eede8e5fd%d&Z9ej6ddd'd(e7d#ee7d$eeddfd)d*Z:ej6ddd'd+e7d#ee7d$eede;e7e ee fffd,d-Zej6   .dEd3e7d4ee)d5ed6d0e=de&f d7d8Z?de7fd9d:Z@ej6dd.d;dZAej6dd?d@e7d$eeddfdAdBZBdS)FN) dataclass)Path)LiteralOptionalUnion)api_pb2) ClusterInfoget_cluster_info) _Function)_get_environment_name) _clustered)_ContainerIOManager)synchronize_api synchronizer)_App)_Client)_Cls) InvalidError)DockerfileSpecImageBuilderVersion_Image_ImageRegistryConfig)_Secret) flash_forwardflash_get_containersflash_prometheus_autoscaler http_servercCs tdS)zDon't fetch any more inputs from the server, after the current one. The container will exit gracefully after the current input is processed.N)rstop_fetching_inputsr r O/home/ubuntu/.local/lib/python3.10/site-packages/modal/experimental/__init__.pyrs rcCstS)zGet the container's local input concurrency. If recently reduced to particular value, it can return a larger number than set due to in-progress inputs.)rget_input_concurrencyr r r r!get_local_input_concurrency$sr# concurrencycCst|dS)zSet the container's local input concurrency. Dynamic concurrency will be disabled. When setting to a smaller value, this method will not interrupt in-progress inputs. N)rset_input_concurrency)r$r r r!set_local_input_concurrency+sr&returncCstS)N)_get_cluster_infor r r r!r 2sr ) target_modulec@s&eZdZUeed<eed<eed<dS)AppInfoapp_idname containersN)__name__ __module__ __qualname__str__annotations__intr r r r!r*9s  r*environment_nameclientcsl|p tIdH}|jtjt|dIdH}g}|jD]}|jtj kr3| t |j |j |jdq|S)zIList deployed Apps along with the number of containers currently running.Nr5)r+r,r-)rfrom_envstubAppListrAppListRequestr appsstateAPP_STATE_DEPLOYEDappendr*r+ descriptionn_running_tasks)r5r6resp app_infos app_statsr r r!list_deployed_apps@s"    rEr5r6r,csR|p tIdH}tj|||dIdH}tj|jtjd}|j |IdHdS)zStop a deployed App. This interface is experimental and may change in the future, although the functionality will continue to be supported. NrF)r+source) rr8rlookuprAppStopRequestr+APP_STOP_SOURCE_PYTHON_CLIENTr9AppStop)r,r5r6client_appreqr r r!stop_app]s rOapp_namec s|dur tIdH}tj|||dIdH}tj|jd}|j|IdH}i}|j j D] }t j |||d||<q-|j j D]}|drFq>tj |||d||<q>|S)awExperimental interface for retrieving a dictionary of the Functions / Clses in an App. The return value is a dictionary mapping names to unhydrated Function or Cls objects. We plan to support this functionality through a stable API in the future. It's likely that the stable API will look different (it will probably be a method on the App object itself). NrF)r+r7z.*)rr8rrHrAppGetLayoutRequestr+r9 AppGetLayout app_layout class_idsr from_name function_idsendswithr ) rPr5r6rMrNapp_layout_resp app_objectscls_name func_namer r r!get_app_objectsjs   r\Fpath force_buildcs&dtdtffdd }tj||dS)a Build a Modal Image from a local Dockerfile recipe without any changes. Unlike for `modal.Image.from_dockerfile`, the provided recipe will not be embellished with steps to install dependencies for the Modal client package. As a consequence, the resulting Image cannot be used with a modal Function unless those dependencies are already included as part of the base Dockerfile recipe or are added in a subsequent layer. The Image _can_ be directly used with a modal Sandbox, which does not need the Modal client. We expect to support this experimental function until the `2025.04` Modal Image Builder is stable, at which point Modal Image recipes will no longer install the client dependencies by default. At that point, users can upgrade their Image Builder Version and migrate to `modal.Image.from_dockerfile` for usecases supported by this function. versionr'csJttj}|d}Wdn1swYt|idS)N commands context_files)openosr] expanduserreadsplitr)r_frbr]r r!build_dockerfiles z.raw_dockerfile_image..build_dockerfile)dockerfile_functionr^)rrr _from_args)r]r^rkr rjr!raw_dockerfile_images rntagregistry_secretcredential_type)staticawsgcpNcsdtdtffdd }|r;|durtd|dkrtj}n|dkr&tj}n|d kr.tj}ntd |t||}nd}tj |||d S) a Build a Modal Image from a public or private image registry without any changes. Unlike for `modal.Image.from_registry`, the provided recipe will not be embellished with steps to install dependencies for the Modal client package. As a consequence, the resulting Image cannot be used with a modal Function unless those dependencies are already included as part of the registry Image or are added in a subsequent layer. The Image _can_ be directly used with a modal Sandbox, which does not need the Modal client. We expect to support this experimental function until the `2025.04` Modal Image Builder is stable, at which point Modal Image recipes will no longer install the client dependencies by default. At that point, users can upgrade their Image Builder Version and migrate to `modal.Image.from_registry` for usecases supported by this function. r_r'csdg}t|idS)NzFROM rar)r_rbror r!rks  z,raw_registry_image..build_dockerfileNz=credential_type must be provided when using a registry_secretrrrsrtzInvalid credential_type: )rlimage_registry_configr^) rrrrREGISTRY_AUTH_TYPE_STATIC_CREDSREGISTRY_AUTH_TYPE_AWSREGISTRY_AUTH_TYPE_GCPrrrm)rorprqr^rk auth_typeregistry_configr rvr!raw_registry_images& r}cCsfd}d}d}d|d|d|}d\}}|d|}d|d d |d d |d d |S) z:Command to install CUDA Toolkit (nvcc) inside a container.x86_64debian12zcuda-keyring_1.1-1_all.debz9https://developer.download.nvidia.com/compute/cuda/repos//) -zwget z && zdpkg -i zrm -f z/apt-get update && apt-get install -y cuda-nvcc-r )archdistrofilenamecuda_keyring_urlmajorminormax_cuda_versionr r r!_install_cuda_commands   r)python_versionr^rc stj|d}gd}gd}ddtdddtt|dtt|gd td tffd d }tjd |i||t j dS)a Default image used for Modal notebook kernels, with common libraries. This can be used to bootstrap development workflows quickly. We don't recommend using this image for production Modal Functions though, as it may change at any time in the future. )r)1 accelerateaiohttpaltair anthropicasyncpgbeautifulsoup4bokehz boto3[crt]clickzdiffusers[torch,flax]z dm-sonnetflaxftfyh5pyurllib3httpxzhuggingface-hub ipywidgetsz jax[cuda12]keras matplotlibnbformatnumbanumpyopenaioptaxpandaszplotly[express]polarspsycopg2requests safetensorsz scikit-imagez scikit-learnscipyseaborn sentencepiece sqlalchemy statsmodelssympytabulate tensorboardtoml transformerstritontyperz vega-datasets watchfiles websockets)z authlib>=1.3zbasedpyright>=1.28zfastapi>=0.100z ipykernel>=6z pydantic>=2z pyzmq>=26z ruff>=0.11z uvicorn>=0.32zapt-get updateznapt-get install -y libpq-dev pkg-config cmake git curl wget unzip zip libsqlite3-dev openssh-server vim ffmpegzpip install uvz[pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu129zuv pip install --system r_r'cs tdgddDdidS)Nz FROM basecss|]}d|VqdS)zRUN Nr ).0cmdr r r! Ysz@notebook_base_image..build_dockerfile..z"ENV PATH=/usr/local/cuda/bin:$PATHraru)r_rbr r!rkUs z-notebook_base_image..build_dockerfilebase) base_imagesrlr^ _namespace) r debian_slimrshlexjoinsortedrrrmrDEPLOYMENT_NAMESPACE_GLOBAL)rr^ base_imageenvironment_packageskernelshim_packagesrkr rr!notebook_base_images& 5   r)r6image_idcs:|dur tIdH}tj|d}|j|IdHdS)aDelete an Image by its ID. Deletion is irreversible and will prevent Functions/Sandboxes from using the Image. This is an experimental interface for a feature that we will be adding to the main Image class. The stable form of this interface may look different. Note: When building an Image, each chained method call will create an intermediate Image layer, each with its own ID. Deleting an Image will not delete any of its intermediate layers, only the image identified by the provided ID. N)r)rr8rImageDeleteRequestr9 ImageDelete)rr6rNr r r! image_deletegs  r)r4N)F)NNF)Crer dataclassesrpathlibrtypingrrr modal_protor_clustered_functionsr r r( _functionsr _objectr _partial_functionr _runtime.container_io_managerr_utils.async_utilsrrrMrr6rclsr exceptionrimagerrrrsecretrflashrrrrrr#r3r&r. clusteredr*create_blockingr1listrErOdictr\boolrnr}rrrr r r r!s             ",  ,   0$l