o iE@sddlZddlZddlZddlmZddlZddlZddlm Z ddl m Z ddl m Z ddl mZddlmZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlm Z ddl!m"Z"ddl!m#Z#ddl!m$Z$ddl!m%Z%ddl!m&Z&ddl!m'Z'ddl!m(Z(ddl)m*Z*ddl+m,Z,ddl-m.Z.ddl-m/Z/e0e1Z2GdddZ3de4e5e5fd ej6e5fd!d"Z7dS)#N)Path) APIClient)CITag)DEFAULT_SERVICE_NAME)ITRSkippingLevel) get_env_tags)Git)GitTag)BackendConnectorSetup)get_platform_tags)AttemptToFixHandler)AutoTestRetriesHandler)EarlyFlakeDetectionHandler) RetryHandler)TestProperties) TelemetryAPI)SuiteRef)Test) TestModule)TestRef) TestSession) TestSuite)TestTag) Codeowners)asbool)TestCoverageWriter) TestOptWriterc @s4eZdZdeddfddZd*ddZd*dd Zd*d d Z d+d ed e de j e e e fde fddZd*ddZdede jegdfde jegdfde jegdfdeeeeff ddZdede j efddZdeddfddZde fddZd*d d!Zdede fd"d#Zde fd$d%Zd*d&d'Zd*d(d)ZdS),SessionManagersessionreturnNcCst|_t|jd|_t|_|jtj }rt ||_ nt |_ t |_t|_t|_d|_tj|_|tjd}|rHd|_||_n d|_t|jpQt|_ttdd|_tdtdd|_|jdurr|j |_t!|j|j|j|j|j|j|jd |_"|j"#|_$|%|&|j$j'r|j"(nt|_)|j$j*j+r|j",ni|_-|.|j$j/r|j"0\|_|_nt|_d|_|j$j1r|j"#|_$|j"2g|_3t4|jd|_5t6|jd|_7||_8|j89|j|j8j:|j$j/|j$j;|jd |j5|j8j?t=j@|j8jAt=jB|j8jCt=jD|Et=jF|j8jAt=jG|ji|jrK|jtjkr?d nd }|j5<|d|jid|_Hz tItJ|j d|_HWdStKyjtLMdYdStNy{tLjMdddYdSw)N)connector_setup DD_SERVICETF-DD_CIVISIBILITY_AUTO_INSTRUMENTATION_PROVIDER _CI_DD_ENVDD_ENV)serviceenvenv_tagsitr_skipping_levelconfigurationsr telemetry_api) itr_enabledskipping_enabledskipping_level*testtest_suite_enditr_correlation_id)cwdz CODEOWNERS file is not availablezFailed to load CODEOWNERS)exc_info)Or detect_setupr rr+rr(getrWORKSPACE_PATHrworkspace_pathr3r platform_tagssetcollected_testsskippable_itemsr2rTESTr)osenvironis_user_provided_servicer&_get_service_name_from_git_reporboolgetenvis_auto_injectedr' default_envr api_client get_settingssettingsoverride_settings_with_env_vars show_settingsknown_tests_enabledget_known_tests known_teststest_managementenabledget_test_management_propertiestest_propertiesupload_git_datar,get_skippable_tests require_gitcloseretry_handlersrwriterrcoverage_writerr set_serviceset_itr_attributesr- add_metadatar TEST_COMMAND test_commandTEST_FRAMEWORKtest_frameworkTEST_FRAMEWORK_VERSIONtest_framework_versionTEST_SESSION_NAME_get_test_session_name COMPONENTENV codeownersrstr ValueErrorlogwarning Exception)selfrr8 dd_service itr_eventro\/home/ubuntu/.local/lib/python3.10/site-packages/ddtrace/testing/internal/session_manager.py__init__(s               zSessionManager.__init__cCs||jdSN)setup_retry_handlersr;clearrlrororpfinish_collectionsz SessionManager.finish_collectioncCs|jjjr |jt||jjjrX|jrS|j|j}t |t |j}t ||d}t ||jjj ko;||jjj k}|rJt d|j dn|jt|nt d|jjjrg|jt|dSdS)Ndz6Not enabling Early Flake Detection: too many new testsfaultyz2Not enabling Early Flake Detection: no known tests)rHrNrOrVappendr early_flake_detectionrMr;lenfaulty_session_thresholdridebugr&set_early_flake_detection_abort_reasonrauto_test_retriesr )rl new_tests total_testsnew_tests_percentageis_faulty_sessionrororprss$       z#SessionManager.setup_retry_handlerscCs$|j|jt|jdSrr)rWstartrXatexitregisterfinishrurororprs  zSessionManager.startcoverage_report_bytescoverage_formattagsc CsJz |j|||}|WSty$}z td|WYd}~dSd}~ww)a Upload a coverage report to Datadog CI Intake. This creates a temporary API client connection to upload the coverage report. Args: coverage_report_bytes: The coverage report content (will be gzipped by the API client) coverage_format: The format of the report (lcov, cobertura, jacoco, clover, opencover, simplecov) tags: Optional additional tags to include in the event Returns: True if upload succeeded, False otherwise z#Error uploading coverage report: %sNF)rFupload_coverage_reportrkrirj)rlrrrresulterororprs z%SessionManager.upload_coverage_reportcCsBt|j|j|j|j|j|jdSrr)r unregisterrrW signal_finishrXr+ wait_finishrurororprs     zSessionManager.finishtest_ref on_new_module on_new_suite on_new_testc Cs(|j|jjj\}}|r#z||Wnty"td|Ynw||jj\}}|rDz||WntyCtd|Ynw||j\}}|rz1| o_t |j dko_||j v} |j |pht } |j| | j| j| jd||||Wntytd|Ynw|||fS)ar Return the module, suite and test objects for a given test reference, creating them if necessary. When a new module, suite or test is discovered, the corresponding `on_new_*` callback is invoked. This can be used to perform test framework specific initialization (such as setting pathnames from data colleced by the framework). z#Error during discovery of module %sz"Error during discovery of suite %sr)is_newis_quarantined is_disabledis_attempt_to_fixz!Error during discovery of test %s)rget_or_create_childsuitemodulenamerkrirjhas_parametersr{rMrQr6rset_attributes quarantineddisabledattempt_to_fix_set_codeowners) rlrrrr test_modulecreated test_suiter0rrQrororp discover_tests>    "  zSessionManager.discover_testcCsN|jj|jjj}|sdS|j|jj}|sdS|j|j}|s%dS|Srr)rchildrenr6rrr)rlrrrr0rororpget_testszSessionManager.get_testr0cCs||jsdS|}|std|dSz tt||j}Wnty0td||}Ynw|j |}| |dS)Nz%Could not get source file for test %sz'Could not get repo relative path for %r) rfget_source_filerir}rgr relative_tor8rhofset_codeowners)rlr0 source_filerepo_relative_pathrfrororprs    zSessionManager._set_codeownerscCs@tjd}r |S|jtj}r|d|jjS|jjS)NDD_TEST_SESSION_NAME-)r>r?r6r(rJOB_NAMErr])rl session_namejob_namerororprc(s z%SessionManager._get_test_session_namec Cst}|}|j|}tt|t|}t|dkr$tddS| rX| dkrXtd| }|rStd|}|j|}tt|t|}nt d|j ||d}d}d}||D]} |j| } | dur||| 7}|d7}qht||dS) Nrz=All latest commits found in backend, skipping metadata upload)rz@Shallow repository detected on git > 2.27 detected, unshallowingzVUnshallow successful, getting latest commits from backend based on unshallowed commitszCode coverage report upload is enabled by environment variable)rr>r?r6rir}rHr,rzrOrr-coverage_enabledcoverage_report_upload_enabledrurororprI`s&         z.SessionManager.override_settings_with_env_varscCsvtd|j|jtd|jj|jj|jjtd|jjj td|jj td|jj j td|jj dS)NzService: %s (env: %s)z`Test Optimization settings: Test Impact Analysis: %s, test skipping: %s, coverage collection: %sz=Test Optimization settings: Early Flake Detection enabled: %sz3Test Optimization settings: Known Tests enabled: %sz9Test Optimization settings: Auto Test Retries enabled: %sz>Test Optimization settings: Coverage Report Upload enabled: %s) riinfor&r'rHr,r-rrzrOrKrrrurororprJs  zSessionManager.show_settings)rNrr)__name__ __module__ __qualname__rrqrvrsrbytesrgtOptionaldictrBrrrCallablerrrtuplerrrrcrRrrrIrJrorororpr'sF f     / & rr(rcCs2|tj}|rtd|}r|dSdS)Nz.*/([^/]+)(?:.git)/?r)r6r REPOSITORY_URLrematchgrouplower)r( repo_namemrororprAs rA)8rloggingr>pathlibrrtypingr#ddtrace.testing.internal.api_clientrddtrace.testing.internal.cir"ddtrace.testing.internal.constantsrr!ddtrace.testing.internal.env_tagsrddtrace.testing.internal.gitrr ddtrace.testing.internal.httpr !ddtrace.testing.internal.platformr 'ddtrace.testing.internal.retry_handlersr r rr&ddtrace.testing.internal.settings_datar"ddtrace.testing.internal.telemetryr"ddtrace.testing.internal.test_datarrrrrrr#ddtrace.testing.internal.tracer_apirddtrace.testing.internal.utilsrddtrace.testing.internal.writerrr getLoggerrrirrrgrrArorororpsJ                            $m