-P`/_@sddlZddlZddlZddlmZddlZddlZddlZddlmZddlm Z ddl m Z ddl j jZddlmZddlmZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZddlm Z ddl!m"Z"m#Z#m$Z$ddlm%Z%ddl&m'Z'ddl(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4ej5e6Z7dZ8ddiZ9dddgZ:dZ;dddgZ<dddgZ=dZ>d Z?d!Z@d"ZAd#ZBd$ZCd%ZDd&ZEd'ZFd(ZGd)ZHd*ZId+ZJd,ZKGd-d.d.eZLd/ZMd0d1d2d3gZNd4d5gZOd6d7ZPd8d9ZQd:d;ZRdd<d=ZSd>d?ZTd@dAZUdBdCZVdDdEZWe%jXrpdFZ?dGZ@dHZAeWdIZYeYdk r]e7jZdJdKeYZ>n e7jZdLdZMdMe;dNeGdOdPdQdRe?dSdPdTdUdVdWidXdYe>idZe@d[d\iZ[d]dYd^d_d`dagdbdPiidcddeAdedfigiZ\dge8gZ]dhZ^diZ_djZ`dWdkdlZadWdmdOZbe+ejcdWdndoZdGdpdqdqejeZfdrdsdtZge+dudvZhe+dwdxZie+e>d\d\dydzZje+d{d|Zke+dd}d~Zle+ddZme+dddZne+ddZoddZpe+ddZqe+ddZre+ddZse+ddZte+ddZudddZve+ddZwe+eMddZxe+ddZye+ddZze+e{dddZ|e+e{dddZ}e+e{dddZ~e+eLjeJddZe+eLjeJddZe+dddZddZGdddeZGdddeZefZefejffgZddZdS)N)partial)time)sleep)minidom)Enum)dmi)log)net) EventType) device_driver)EphemeralDHCPv4)sources)netlink)subp)UrlErrorreadurlretry_on_url_exc)util)events) +DEFAULT_REPORT_FAILURE_USER_VISIBLE_MESSAGEazure_ds_reporterazure_ds_telemetry_reporterget_metadata_from_fabricget_boot_telemetryget_system_inforeport_diagnostic_eventEphemeralDHCPv4WithReportingis_byte_swapped dhcp_log_cbpush_log_to_kvpreport_failure_to_fabricAzurez instance-idziid-AZURE-NODEserviceZ walinuxagentstartZ __builtin__shz-xcz>i=$interface; x=0; ifdown $i || x=$?; ifup $i || x=$?; exit $xzLi=$interface; x=0; ifconfig down $i || x=$?; ifconfig up $i || x=$?; exit $xz/dev/disk/cloud/azure_resourceZeth0z"/var/lib/dhcp/dhclient.eth0.leasesZext4z 7783-7084-3265-9085-8269-3286-77z/var/lib/cloud/data/poll_imdsz'/var/lib/cloud/data/wait_for_nic_attachz /var/lib/cloud/data/nic_detachedz"/var/lib/cloud/data/reported_readyz/var/lib/waagentzhttp://169.254.169.254/metadataz 2019-06-01z 2020-09-01c@s=eZdZdjeZdjeZdjeZdS) metadata_typez {}/instancez{}/instance/networkz{}/reprovisiondataN)__name__ __module__ __qualname__formatIMDS_URLcomputenetworkreprovisiondatar/r/C/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceAzure.pyr&Vs r&z/sys/firmware/acpi/tables/OEM0z"/etc/netplan/90-hotplug-azure.yamlz /usr/local/sbin/ephemeral_eth.shz+/etc/udev/rules.d/10-net-device-added.rulesz#/run/network/interfaces.ephemeral.dZ mlx4_coreZ mlx5_corecCsx|jD]}tjd|r |j}t|dkr |djd}t|dkr |ddkr |dj|r |djd}|dSq Wd S) z dev.storvsc.1.%pnpinfo: classid=32412632-86cb-44a2-9b5c-50d1417354f5 deviceid=00000000-0001-8899-0000-000000000000 Zpnpinfor%=rdeviceid.N) splitlinesresearchsplitlen startswith) sysctl_outr3lineZfieldscolumnscompsr/r/r0"find_storvscid_from_sysctl_pnpinfo{s  r@cCsAx:|jD],}tj||r |j}|dSq WdS)z scbus0 on ata0 bus 0 scbus1 on ata1 bus 0 scbus2 on blkvsc0 bus 0 scbus3 on blkvsc1 bus 0 scbus4 on storvsc2 bus 0 scbus5 on storvsc3 bus 0 scbus-1 on xpt0 bus 0 rN)r6r7r8r9)camcontrol_outZdisk_drvr=itemsr/r/r0find_busdev_from_disks   rCcCsixb|jD]T}tj||r |jd}t|dkr |djd}|dSq WdS)z at scbus1 target 0 lun 0 (cd0,pass0) at scbus2 target 0 lun 0 (da0,pass1) at scbus3 target 1 lun 0 (da1,pass2) (r%r4,rN)r6r7r8r9r:)rAZbusdevr=rBZdev_passr/r/r0find_dev_from_busdevs rFc CsNytj|dSWn2tjk rItjddj||SYnXdS)NrzFailed to execute: %s )rProcessExecutionErrorLOGdebugjoin)cmdfail_retr/r/r0execute_or_debugs rNcCstddgddS)NZsysctlz dev.storvscrM)rNr/r/r/r0get_dev_storvsc_sysctlsrPcCstdddgS)N camcontroldevlistz-b)rNr/r/r/r0get_camcontrol_dev_bussrScCstddgS)NrQrR)rNr/r/r/r0get_camcontrol_devsrTc Cs1d}|dkr"d}|d}dt|}dj||}t}t||}|sstjddSt}t}dj|}t||} | rt || } | dkrtjd dS| Sd j|} t|| } | r-t || } | dkr)tjd dS| SdS) NZ00000000r4Z00000001r%Z000z{0}-{1}z#Fail to find storvsc id from sysctlz blkvsc{0}zFail to find /dev/daXz storvsc{0}) strr*rPr@rIrJrSrTrCrF) Zport_idZg0Zg1Zg0g1r<Z storvscidZcamcontrol_b_outrAZblkvscZscbusxZdevnameZstorvscr/r/r0get_resource_disk_on_freebsds<          rVZhn0z/var/db/dhclient.leases.hn0z freebsd-ufsr4zresource disk is not Nonez/dev/zresource disk is None agent_commanddata_dir set_hostnameThostname_bounce interfacepolicycommandbuiltinhostname_commandhostname disk_aliasesZ ephemeral0dhclient_lease_fileapply_network_configF disk_setupZ table_typeZgptZlayoutdZ overwriteZfs_setupZ filesystemZdevicez ephemeral0.1 datasourceZnever_destroy_ntfszTemporary StorageZREDACTEDcCs;t|ttfs|f}tj|dddjS)NcaptureTr) isinstancelisttuplerstrip)r_r/r/r0 get_hostname"s rlcCstj||gdS)N)r)r`r_r/r/r0rY(sccs|dd}t|}tj|jd sZtj|sZ||krc|dkrcdVdSyt||WnEtk r}z%td|dtj dVdSWYdd}~XnXz |VWdt||XdS)z Set a temporary hostname, restoring the previous hostname on exit. Will have the value of the previous hostname when used as a context manager, or None if the hostname was not changed. rZr\rYZforceNz%Failed setting temporary hostname: %s logger_func) rlris_truegetis_falserY ExceptionrrIwarning) temp_hostnamecfgr_r\Zprevious_hostnameer/r/r0temporary_hostname,s$     rvcsneZdZdZdZejZddZddZ e ddZ e d d Z d d Z e d dZddZffddZe ddZe ejddZddZe ddZddZddZdd d!Ze d"d#Ze d$d%Ze d&d'Ze d(d)Ze d*d+Ze d,d-Ze d.d/Z e d0d1Z!e d2d3Z"e de#d4d5d6Z$e%e#d7d8d9Z&e#d4d:d;Z'd<d=Z(d>d?Z)e d@dAZ*e dBdCZ+e,dDdEZ-e,dFdGZ.e,dHdIZ/S)JDataSourceAzurer!FcCstjj||||tjj|jd|_i|_d|_t j t j |t it g|_|jjd|_d|_|jdjtjd|_d|_dS)NZazurerbr-F)r DataSource__init__ospathrKseed_dirrtseedr mergemanydictget_cfg_by_path DS_CFG_PATHBUILTIN_DS_CONFIGds_cfgrorb_network_configZ update_eventsaddr BOOT_ephemeral_dhcp_ctxfailed_desired_api_version)selfsys_cfgdistropathsr/r/r0ryPs    zDataSourceAzure.__init__cCs#tjj|}d||jfS)Nz %s [seed=%s])r rx__str__r})rrootr/r/r0r`szDataSourceAzure.__str__cCs|jjd}tjd||jdd}t||jd|}|dk rtj|jjdr|jd}ytd|d|d|SWnLt k r}z,t d |d tj tj td WYdd}~XnXWdQRXd S) Nzlocal-hostnamezHostname in metadata is %srZr_rYr`rt prev_hostnamezFailed publishing hostname: %srmzhandling set_hostname failedF) metadatarorIrJrrvrrnperform_hostname_bouncerqrrrlogexc)rZazure_hostnamer_Z previous_hnrtrur/r/r0"bounce_network_with_azure_hostnameds&       *z2DataSourceAzure.bounce_network_with_azure_hostnamec Cs|jjd}|jd}tjd|||jyt|Wn/tjk r{t j td|jdYnX|jd}g}d}x|j jdgD]o}|jddr|d}tjdqt |d d }|t jj||g7}tjd qWtjd d dddtQt jdtjdddt jd|df}t|rtjd|WdQRXi} |pt|| d<| S)Nzlocal-hostnamerWz/Getting metadata via agent. hostname=%s cmd=%szagent command '%s' failed.rX_pubkeysvaluez+SSH authentication: using value from fabric fingerprintz.crtz1SSH authentication: using fingerprint from fabricnamezwaiting-for-ssh-public-key descriptionz$wait for agents to retrieve SSH keysparentlogfuncmsgz waiting for SSH public key filesfuncargsiz$Did not find files, but going on: %sz public-keys)rrorrIrJr invoke_agentrrHrrrtrUrzr{rKrReportEventStackrlog_timeZwait_for_filesr:rrpubkeys_from_crt_files) rrsZ agent_cmdddirZfp_files key_valueZpkZbnameZmissingrr/r/r0get_metadata_from_agentsB           z'DataSourceAzure.get_metadata_from_agentcCs2|jjdrd}nd}d||jfS)z/Return the subplatform metadata source details.z/devz config-diskzseed-dirz%s (%s))r}r;)rZsubplatform_typer/r/r0_get_subplatforms z DataSourceAzure._get_subplatformcCsi}|jd}|jg}tjjtr[|jddtdtdtj n9tjjt r|jddtdt dtj |j t |r|j |d}d }d }x]|D]U}y|dkrd}d }nr|dkrd}d }nW|jd rZtjrEtj|td d }qftj|t}n t|}Wntk rtd|dtj wYntk r} z1d| } t| dtjtj| WYdd} ~ Xn/tjk rtd|dtjwYnX|p&|j|} |p;|j|} | sJ| rtjr~d} t| dtjtj| | r|j|j}|j|jdd} |\}}}}||_ |j!d|d|dtj"|d| igd|i|}td|dtj PqW|sWd} t| dtjtj| ||krztd|dtj t#}|r||dd<|j$|dd<| s| rtj%d|j&j'j(|jot)|dd}|r|j*d |j+j,|j+j-nly*t.t/}|j*d |WdQRXWn?t0k r}ztd!|dtjWYdd}~XnX|S)"aWalk all instance metadata sources returning a dict on success. @return: A dictionary of any metadata content for this instance. @raise: InvalidMetaDataException when the expected metadata service is unavailable, broken or disabled. rXrZIMDSzJReprovision marker file already present before crawling Azure metadata: %srmZNIC_ATTACH_MARKER_PRESENTzUReprovision nic attach marker file already present before crawling Azure metadata: %sNFTz/dev/mtypeudfz$Did not find Azure data source in %szBrokenAzureDataSource: %sz%s was not mountablez%Free BSD is not supported for PPS VMsretries rtfilesrimds userdata_rawzfound datasource in %szNo Azure metadata foundzusing files cached in %sZ random_seedz instance-idz6Reporting ready to Azure after getting ReprovisionDatarleasez#exception while reporting ready: %s)1rr|rzr{isfileREPROVISION_MARKER_FILEinsertrrIrJ"REPROVISION_NIC_ATTACH_MARKER_FILEextendlist_possible_azure_ds_devsappendr;r is_FreeBSDmount_cbload_azure_ds_dirNonAzureDataSourceBrokenAzureDataSourceerrorr InvalidMetaDataExceptionMountFailedErrorrr_should_reprovision$_should_reprovision_after_nic_attach_wait_for_all_nics_ready _reprovisionget_imds_data_with_api_fallbackfallback_interfacer}updater~_get_random_seed_iidinfor networkingis_upgetattr _report_readyrr clean_networkrrrq)r crawled_datarZ candidatesfoundZ reprovisionZreprovision_after_nic_attachZcdevretexcrZperform_reprovisionZ$perform_reprovision_after_nic_attachimds_mdmdrrtrr}Zuse_cached_ephemeralrrur/r/r0crawl_metadatas                !                zDataSourceAzure.crawl_metadatacCs t|jS)z@Check platform environment to report if this datasource may run.)_is_platform_viabler|)rr/r/r0r?sz#DataSourceAzure._is_platform_viablecs&tt|j|tj|_dS)z.Reset any cached class attributes to defaults.N)superrwclear_cached_attrsr UNSET_metadata_imds)rZ attr_defaults) __class__r/r0rCsz"DataSourceAzure.clear_cached_attrsc/CsU|jsdSy tWn5tk rR}ztjd|WYdd}~XnXy tWn5tk r}ztjd|WYdd}~XnXt|jj_ y(t j dtj ddd|j }WnPtk r}z0td |d tj|jd tdSWYdd}~XnX|jrT|jjd krT|jjd rTtt}tjj|rtd|d tj t j|dtg|_n$td|d tj |d|_|dd|_t j|dtg|_|d|_ t j!|jt"i}t j||jg|_t#|jd|ddddS)zCrawl and process datasource metadata caching metadata as attrs. @return: True on success, False on error, invalid or disabled datasource. Fz Failed to get boot telemetry: %sNz$Failed to get system information: %srrzCrawl of metadata servicerz"Could not crawl Azure metadata: %srmrZubunturczXEphemeral resource disk '%s' exists. Merging default Azure cloud ephemeral disk configs.rtzdEphemeral resource disk '%s' does not exist. Not merging default Azure cloud ephemeral disk configs.rrrrXrdirmodeiT)$rrrqrIrrrBLACKLIST_DRIVERSrrblacklist_driversrrrJrrr_report_failurerrrro*maybe_remove_ubuntu_network_config_scriptsRESOURCE_DISK_PATHrzr{existsr~#BUILTIN_CLOUD_EPHEMERAL_DISK_CONFIGrtrDEFAULT_METADATArrrr write_files)rrurdevpathZ user_ds_cfgr/r/r0 _get_dataHs^  # #        zDataSourceAzure._get_datacCs|jsxt|D]}y3tjdttd|ddd|dtSWqtk r}zPtjdt|jdkrd jt }t |d tjd |_PWYd d }~XqXqWtjd t td|d|d|dt S)a= Wrapper for get_metadata_from_imds so that we can have flexibility in which IMDS api-version we use. If a particular instance of IMDS does not have the api version that is desired, we want to make this fault tolerant and fall back to a good known minimum api version. zAttempting IMDS api-version: %s fallback_nicrrmd_type api_versionz"UrlError with IMDS api-version: %siz!Fall back to IMDS api-version: {}rmTNzUsing IMDS api-version: %s) rrangerIr IMDS_VER_WANTget_metadata_from_imdsrcoder* IMDS_VER_MINr)rrrr_errlog_msgr/r/r0rs:     z/DataSourceAzure.get_imds_data_with_api_fallbackcCs|jdj|S)Nra)rro)rrr/r/r0device_name_to_devicesz%DataSourceAzure.device_name_to_devicecCstjdg}y?tddd|jdddD}tjdWnwtk rd }t|d tjy|jd }tjd Wn+tk rd }t|d tjYnXYnX|S)aw Try to get the ssh keys from IMDS first, and if that fails (i.e. IMDS is unavailable) then fallback to getting the ssh keys from OVF. The benefit to getting keys from IMDS is a large performance advantage, so this is a strong preference. But we must keep OVF as a second option for environments that don't have IMDS. zRetrieving public SSH keysz#Not using public SSH keys from IMDScSsg|]}|dqS)ZkeyDatar/).0Z public_keyr/r/r0 s z7DataSourceAzure.get_public_ssh_keys..rr, publicKeyszRetrieved SSH keys from IMDSz1Unable to get keys from IMDS, falling back to OVFrmz public-keyszRetrieved keys from OVFzNo keys available from OVF)rIrJKeyErrorrr)rZssh_keysrr/r/r0get_public_ssh_keyss$      z#DataSourceAzure.get_public_ssh_keyscCs|jS)N)rt)rr/r/r0get_config_objszDataSourceAzure.get_config_objcCstj|jS)N)r Zinstance_id_matches_system_uuidget_instance_id)rrr/r/r0check_instance_idsz!DataSourceAzure.check_instance_idNcCstjj|jjdd}tjdj}tjj|rt j |j }|j|krs|St |j|r|S|S)Ndataz instance-idz system-uuid) rzr{rKrZ get_cpathr read_dmi_datalowerrr load_filerkr)rZpreviousZ prev_iid_pathZiidr/r/r0rs zDataSourceAzure._iidcCs|jdkrftjd|j||j}tjd||rZ|jj|d|_ntjd|jdS)NFz$negotiating for %s (new_instance=%s)znegotiating returned %sTznegotiating already done for %s) _negotiatedrIrJr _negotiaterr)ris_new_instance fabric_datar/r/r0setups    zDataSourceAzure.setupcCsyd}tjdddddttj|}WdQRX|dkrfd}t|dtjntd |dtjt}tj d |t j |d j d t jd tWn;tk r}zt|dtjWYdd}~XnXdS)zUse the netlink socket provided to wait for nic detach event. NOTE: The function doesn't close the socket. The caller owns closing the socket and disposing it safely. Nrzwait-for-nic-detachrzwait for nic detachrzHPreprovisioned nic not detached as expected. Proceeding without failing.rmz%The preprovisioned nic %s is detachedz+Creating a marker file for nic detached: %sz{pid}: {time} pidr)rrrrZwait_for_nic_detach_eventrrIrr$REPROVISION_NIC_DETACHED_MARKER_FILErr write_filer*rzgetpidrAssertionErrorr)rnl_sockifnamerr{rr/r/r0_wait_for_nic_detachs&   z$DataSourceAzure._wait_for_nic_detachcCs5|jjj|r0td|dtjdStjd|d}xtjd|tj|djd}t j d |t j d ||d }|jjj|rd ||f}t|dtjdSd }d ||f}|ddkrt|dtjn tj|t |qIWdS)atIn cases where the link state is still showing down after a nic is hot-attached, we can attempt to bring it up by forcing the hv_netvsc drivers to query the link state by unbinding and then binding the device. This function attempts infinitely until the link is up, because we cannot proceed further until we have a stable link.zThe link %s is already up.rmNzAttempting to bring %s uprz&Unbinding and binding the interface %szdevice/device_idz{}z'/sys/bus/vmbus/drivers/hv_netvsc/unbindz%/sys/bus/vmbus/drivers/hv_netvsc/bindr4z#The link %s is up after %s attemptszHLink is not up after %d attempts with %d seconds sleep between attempts.r) rrZtry_set_link_uprrIrr Z read_sys_netrkrrr)rrZattemptsZ devicenamerZsleep_durationr/r/r0wait_for_link_up1s6         z DataSourceAzure.wait_for_link_upcCsXt}tjd|tj|djdtjdtt ddtj dS)Nz*Creating a marker file to report ready: %sz{pid}: {time} rrzRSuccessfully created reported ready marker file while in the preprovisioning pool.rm) REPORTED_READY_MARKER_FILErIrrrr*rzrrrrJ)rr{r/r/r0_create_report_ready_marker]s z+DataSourceAzure._create_report_ready_markercCstjjt }|rtddtjy*tt}|j d|WdQRXWn?t k r}ztd|dtj WYdd}~XnX|j ntdtdtj dS)zlReport ready to the platform if the marker file is not present, and create the marker file. z!Reporting ready before nic detachrmrNzFException reporting ready during preprovisioning before nic detach: %szLAlready reported ready before nic detach. The marker file already exists: %s) rzr{rr rrIrrrrrqrr )rZhave_not_reported_readyrrur/r/r0_report_ready_if_neededis   z'DataSourceAzure._report_ready_if_neededc&Csxd}d}d}yMtjdddd|dt$td |d t}|jWdQRXWnEtk r}z%td ||fd tj WYdd}~XnXz[y|j |d t j }Wn8tk r}ztj d||WYdd}~XnXWd|dkr|jX|dk rntjd|d}||_t|d}td|d tj||fS)zCheck if a given interface is the primary nic or not. If it is the primary nic, then we also get the expected total nic count from IMDS. IMDS will process the request and send a response only for primary NIC. Fr4Nrzobtain-dhcp-leaserzlobtain dhcp lease for %s when attempting to determine primary NIC during reprovision of a pre-provisioned VMrZiface dhcp_log_funczsGiving up. Failed to obtain dhcp lease for %s when attempting to determine primary NIC during reprovision due to %srmzFailed to get network metadata using nic %s. Attempt to contact IMDS failed with error %s. Assuming this is not the primary nic.z%s is the primary nicTr[zExpected nic count: %d)rrrr r obtain_leaserqrrIrrr&r-rrrrrr:)rrZ is_primaryexpected_nic_countrZdhcp_ctxrur/r/r0_check_if_nic_is_primarysJ   !     z(DataSourceAzure._check_if_nic_is_primarycCs9tjdyg}d}d}xd}tjddddt|d ttj||}WdQRX|j|t d |d tj|j ||stjd ||j |\}}|dkr%t||kr%tjd Pq%WWn8t k r4}zt |d tj WYdd}~XnXdS)zWait until all the expected nics for the vm are hot-attached. The expected nic count is obtained by requesting the network metadata from IMDS. z#Waiting for nics to be hot-attachedFr4Nrzwait-for-nic-attachrz4wait for nic attach after %d nics have been attachedrzDetected nic %s attached.rmz!Checking if %s is the primary niczFound all the nics for this VM.rr)rIrrrr:rrZwait_for_nic_attach_eventrrr rrr)rrZ nics_foundZprimary_nic_foundrrrr/r/r0_wait_for_hot_attached_nicss8             z+DataSourceAzure._wait_for_hot_attached_nicscCsd}zytj}ttjjt}|jttjjt}|srt j d|j ||j s|j |ntd|dt j Wn>tjk r}zt|dt jWYdd}~XnXWd|r|jXdS)aWait for nic(s) to be hot-attached. There may be multiple nics depending on the customer request. But only primary nic would be able to communicate with wireserver and IMDS. So we detect and save the primary nic to be used later. NzNIC has not been detached yet.zSkipping waiting for nic attach because we already have a fallback interface. Report Ready marker present before detaching nics: %srm)rcreate_bound_netlink_socketboolrzr{rr r rrIrrrrrNetlinkCreateSocketErrorrrclose)rrZreport_ready_marker_presentZhas_nic_been_detachedrur/r/r0rs*     z(DataSourceAzure._wait_for_all_nics_readyc8sNdjtjjt}ddi}d}ttjjt  }d_ d_ d}d}d}fdd }j dk } d } | r|rt | d tjt| xWz?y| stjd d dddt&tdt_ j j} WdQRX|r|d7}|rytj}WnMtjk r} z*t d| d tjj jPWYdd} ~ XnXjd| } | sd} t | d tjj jtj| jd}tj dtjd ddddt]ytj!|| dWn=t"k re} zt d| d tjPWYdd} ~ XnXWdQRXd}j jnTtjd ddddt2t#|dt$d|d|d dd!dj%}WdQRXPWnt&k rj jYnXWd|r|j'XqW|rJt d"|d tj t d#j d tj |S)$ztPoll IMDS for the new provisioning data until we get a valid response. Then return the returned JSON object.z{}?api-version={}MetadatatrueNr4rFcst|tr|jd krjjkrxjd9_tjdjtd||j|jfdtjjd7_dStd||j|jfdtj d Std |dtj d S) Nr%z:Backing off logging threshold for the same exception to %dz4poll IMDS with %s failed. Exception: %s and code: %srmr4TFz1poll IMDS failed with an unexpected exception: %s)rr) rhrrimds_poll_counterimds_logging_thresholdrIrJrcauserr)rZ exception)rr/r0exc_cb?s,         z*DataSourceAzure._poll_imds..exc_cbzeUnexpected error. Dhcp context is not expected to be already set when we need to wait for vnet switchrmrzobtain-dhcp-leaserzobtain dhcp leaserr z)Failed to create bound netlink socket: %srz9Failed reporting ready while in the preprovisioning pool.zWait for vnetswitch to happenz!wait-for-media-disconnect-connectzwait for vnet switchr[z'Error while waiting for vnet switch: %sTzget-reprovision-data-from-imdszget reprovision data from imdstimeoutheaders exception_cbZinfiniteZ log_req_respz#attempted dhcp %d times after reusez polled imds %d times after reuse)(r*r&r.rrrrzr{rr rrrrrIr RuntimeErrorrrrr rrrrrrrrrr rr rJZ!wait_for_media_disconnect_connectrrIMDS_TIMEOUT_IN_SECONDScontentsrr)rurlr!rZ report_readyZ dhcp_attemptsZ vnet_switchedZ return_valrZis_ephemeral_ctx_presentrrruZreport_ready_succeededr/)rr0 _poll_imds.s     #                       zDataSourceAzure._poll_imds)returnc,Csd}y|jjj|jrt|ddrt|jddr||jjkrtddtj t d|jj|d||jj d SWn<t k r}ztd |dtj WYdd}~XnXyHtd dtj tt}t d||d|WdQRXd SWn<t k ra}ztd |dtj WYdd}~XnXy(td t d|jd|d SWn<t k r}ztd|dtj WYdd}~XnXdS)zTells the Azure fabric that provisioning has failed. @param description: A description of the error encountered. @return: The success status of sending the failure signal. z unknown-245rNrz>Using cached ephemeral dhcp context to report failure to AzurermZ dhcp_optsrTz@Failed to report failure using cached ephemeral dhcp context: %sz3Using new ephemeral dhcp to report failure to Azurez5Failed to report failure using new ephemeral dhcp: %sz/Using fallback lease to report failure to Azurefallback_lease_filez1Failed to report failure using fallback lease: %sF)rrrrrrrrrIrJr rrqrrrrb)rrZunknown_245_keyrurr/r/r0rsX       zDataSourceAzure._report_failure)rr(cCs`ytd|ddSWn@tk r[}z td|dtjdSWYdd}~XnXdS)zTells the fabric provisioning has completed. @param lease: dhcp lease to use for sending the ready signal. @return: The success status of sending the ready signal. Nz unknown-245TzQError communicating with Azure fabric; You may experience connectivity issues: %srmF)rrqrrIrr)rrrur/r/r0rszDataSourceAzure._report_readycCs|s dS|\}}}}t}|jdddksLtjj|rtjj|stjd|tj|dj dtj dt d SdS) aIWhether or not we should wait for nic attach and then poll IMDS for reprovisioning data. Also sets a marker file to poll IMDS. The marker file is used for the following scenario: the VM boots into wait for nic attach, which we expect to be proceeding infinitely until the nic is attached. If for whatever reason the platform moves us to a new host (for instance a hardware issue), we need to keep waiting. However, since the VM reports ready to the Fabric, we will not attach the ISO, thus cloud-init needs to have a way of knowing that it should jump back into the waiting mode in order to retrieve the ovf_env. @param candidate_metadata: Metadata obtained from reading ovf-env. @return: Whether to reprovision after waiting for nics to be attached. FPreprovisionedVMTypeNZSavablez1Creating a marker file to wait for nic attach: %sz{pid}: {time} rrT) rrorzr{rrIrrrr*rr)rZcandidate_metadata_md _userdata_rawrt_filesr{r/r/r0rs z4DataSourceAzure._should_reprovision_after_nic_attachcCs|s dS|\}}}}t}|jddksa|jdddksatjj|rtjj|stjd|tj|dj d tj d t dSdS) aWhether or not we should poll IMDS for reprovisioning data. Also sets a marker file to poll IMDS. The marker file is used for the following scenario: the VM boots into this polling loop, which we expect to be proceeding infinitely until the VM is picked. If for whatever reason the platform moves us to a new host (for instance a hardware issue), we need to keep polling. However, since the VM reports ready to the Fabric, we will not attach the ISO, thus cloud-init needs to have a way of knowing that it should jump back into the polling loop in order to retrieve the ovf_env.FPreprovisionedVmTr*NZRunningz'Creating a marker file to poll imds: %sz{pid}: {time} rr) rrorzr{rrIrrrr*rr)rrr+r,rtr-r{r/r/r0r!s  z#DataSourceAzure._should_reprovisionc Csa|j}tjdddddt0t|\}}}|||d|ifSWdQRXdS)z%Initiate the reprovisioning workflow.rzreprovisioning-read-azure-ovfrz$read azure ovf during reprovisioningrz ovf-env.xmlN)r'rrrread_azure_ovf)rr%rudrtr/r/r0r;s   zDataSourceAzure._reprovisioncCsm|jdtkr|jd}yMtd|jddd}tjd|dk rht|ndWn4tk rtjd |jj d d}YnXt t d |j d |}n |j }tjd |jdy |}Wn@tk r4}z td|dtjdSWYdd}~XnXtjttjttjttjt|S)zNegotiate with fabric and return data from it. On success, returns a dictionary including 'public_keys'. On failure, returns False. rWNz#Not using public SSH keys from IMDSrr,rz*Successfully retrieved %s key(s) from IMDSrzMUnable to retrieve SSH keys from IMDS during negotiation, falling back to OVFrr) pubkey_infoz,negotiating with fabric via agent command %szQError communicating with Azure fabric; You may experience connectivity issues: %srmF)rAGENT_START_BUILTINrrrrIrJr:rtrorrrbrrqrrrrdel_filer rrr)rr1Z public_keysZ metadata_funcrrur/r/r0rEsB              zDataSourceAzure._negotiatec Cs?z&td|d|jjtdWdt|jdXdS)Nr preserve_ntfsFZ def_log_file)address_ephemeral_resizerroDS_CFG_KEY_PRESERVE_NTFSrr)rrtrr/r/r0activate{s   zDataSourceAzure.activatecCs(|jjdijdijdS)Nrr,ZplatformFaultDomain)rro)rr/r/r0availability_zones z!DataSourceAzure.availability_zonecCsV|j s|jtjkrO|jjdr:|j}nd}t||_|jS)aGenerate a network config like net.generate_fallback_network() with the following exceptions. 1. Probe the drivers of the net-devices present and inject them in the network configuration under params: driver: value 2. Generate a fallback network config that does not include any of the blacklisted devices. rcN)rr rrrorparse_network_config)rZnc_srcr/r/r0network_configs  zDataSourceAzure.network_configcCs(|jjdijdijdS)Nrr,location)rro)rr/r/r0regionszDataSourceAzure.region)0r'r(r)Zdsnamerr rrryrrrrrrrrrr&r,rrrrrrrrr r r rrrr'rrdictrrrrrr7propertyr8r:r<r/r/)rr0rwJsN    /  I. $  , D707  6 rwcCsx}dD]u}g}x\td|D]K}||t|}tjj|r#|j|tjj|fq#W|r|SqWgS)N-partprOr4)r@rArO)rrUrzr{rrrealpath)rZmaxnumZsuffrZpnumZppathr/r/r0_partitions_on_devices #rCcCs;tjddd}tjd|tjj||kS)Nz TYPE=ntfsZno_cacheTzntfs_devices found = %s)rfind_devs_withrIrJrzr{rB)rZ ntfs_devicesr/r/r0_has_ntfs_filesystemsrEc Csj|r)ddjttf}d|fStjj|sIdd|fStjd|tjj|t |}t |dkrdd|fSt |dkrd |d jd d |Df}d|fSt |dkr|d \}}n|d\}}t |s4d|||f}d|fSt dd}d|||f}t jdddddt}y(tj||dddddi} Wnitjk r } zFd|_dt| krd|dfSd|d|| ffSWYd d } ~ XnX| dkrUd!| |_tjd"djttd|d#| fSWd QRXd|d$fS)%aDetermine if the ephemeral drive at devpath should be reformatted. A fresh ephemeral disk is formatted by Azure and will: a.) have a partition table (dos or gpt) b.) have 1 partition that is ntfs formatted, or have 2 partitions with the second partition ntfs formatted. (larger instances with >2TB ephemeral disk have gpt, and will have a microsoft reserved partition as part 1. LP: #1686514) c.) the ntfs partition will have no files other than possibly 'dataloss_warning_readme.txt' User can indicate that NTFS should never be destroyed by setting DS_CFG_KEY_PRESERVE_NTFS in dscfg. If data is found on NTFS, user is warned to set DS_CFG_KEY_PRESERVE_NTFS to make sure cloud-init does not accidentally wipe their data. If cloud-init cannot mount the disk to check for data, destruction will be allowed, unless the dscfg key is set.z:config says to never destroy NTFS (%s.%s), skipping checksr5Fzdevice %s does not existzResolving realpath of %s -> %srzdevice %s was not partitionedr%z&device %s had 3 or more partitions: %srGcSsg|]}|dqS)r4r/)rrAr/r/r0rs z*can_dev_be_reformatted..r4z5partition %s (%s) on device %s was not ntfs formattedcs5tdgtfddtj|DS)Nzdataloss_warning_readme.txtcs(g|]}|jkr|qSr/)r)rf)ignoredr/r0rs z?can_dev_be_reformatted..count_files..)setr:rzlistdir)Zmpr/)rGr0 count_filessz+can_dev_be_reformatted..count_filesz1partition %s (%s) on device %s was ntfs formattedrzmount-ntfs-and-countrrrZntfsZupdate_env_for_mountZLANGCzcannot mount ntfszunknown filesystem type 'ntfs'Tz^ but this system cannot mount NTFS, assuming there are no important files. Formatting allowed.z but mount of %s failed: %sNzmounted and counted %d fileszxit looks like you're using NTFS on the ephemeral disk, to ensure that filesystem does not get wiped, set %s.%s in configz but had %d files on it.z3 and had no important files. Safe for reformatting.)rKrr6rzr{rrIrJrBrCr:rErrrrrrrrrUrr) rr4rZ partitionsZ cand_partZ cand_pathrJbmsgevtZ file_countrur/r/r0can_dev_be_reformattedsZ   #      +    rNc CsMtjj|s-td|dtjdStd|dtjd}d}|red\}}nt||\}}tjd|||sdSxdd gD]}d |}d ||f}tjj|r5y!tj|tjd |WqEtk r1}ztj d ||WYdd}~XqEXqtjd|qWdS)Nz,Ephemeral resource disk '%s' does not exist.rmz$Ephemeral resource disk '%s' exists.FTFirst instance boot.zreformattable=%s: %srdZmountsz#/var/lib/cloud/instance/sem/config_zMarker "%s" for module "%s"z %s removed.z%s: remove failed! (%s)z%s did not exist.)TrO) rzr{rrrIrJrNunlinkrqrr) rrr4resultrmodZsempathrLrur/r/r0r5 s6      )r5c Cs|d}|d}|d}d|||f}tjj}||d<||d<||d<|dkrtjrt}n)tjdrt}nt j d d St j d |t |t t f }tjd t j d ddddtjdd|d|dd d|idS)Nr]r[r\z"hostname=%s policy=%s interface=%sr`Z old_hostnamer^Zifupz7Skipping network bounce: ifupdown utils aren't present.Fz"pubhname: publishing hostname [%s]rrzpublishing hostnameZ get_uptimeTrkwargsrshellrgenv)rzenvironcopyrrBOUNCE_COMMAND_FREEBSDrZwhichBOUNCE_COMMAND_IFUPrIrJrhrirjr) r`rtrr]r[r\rrUrTr/r/r0r0s0           rcCs=d}tjdd||gddd|\}}|jS)NzHopenssl x509 -noout -pubkey < "$0" |ssh-keygen -i -m PKCS8 -f /dev/stdinr$z-crgTr)rrstrip)fnamerZpipelineoutZ_errr/r/r0crtfile_to_pubkeyTsr]c Cszg}g}xJ|D]B}y|jt|Wqtjk rT|j|YqXqW|rvtd|dtj|S)Nz-failed to convert the crt files to pubkey: %srm)rr]rrHrrIrr)Zflistpubkeyserrorsr[r/r/r0r]s   rcCsdd}|sdS|s"i}tj||xf|jD]X\}}tjj||}d|kr{|||}tjd|d|ddq?WdS)Nc Ssy^tj|}x;|jD]-}d|jkr|jtkrt|_qWtj|SWn&tk rtj d||SYnXdS)z>Azure provides the UserPassword in plain text. So we redact itZ UserPasswordz#failed to redact userpassword in %sN) ETZ fromstringitertagtextDEF_PASSWD_REDACTIONZtostringrqrIZcritical)Zcntr[relemr/r/r0_redact_passwordrs  z%write_files.._redact_passwordz ovf-env.xmlfilenamecontentmodei)rZ ensure_dirrBrzr{rKr)Zdatadirrrrfrrhr[r/r/r0ros  rcCsG|r6tjd|tj|dt|t n tjddS)Nzinvoking agent: %srTznot invoking agent)rIrJrrhri)rLr/r/r0rs rcCsGg}|js|Sx*|jD]}||r |j|q W|S)N) hasChildNodes childNodesr)ZnodeZ filter_funcrchildr/r/r0 find_childs  rmc Cst|dd}t|dkr+gSt|dkrStdt||d}t|dd}t|dkrgSg}tjj}x|D]}|jsqddd dd di}x|jD]}|j|ks|j rq|j j } | |j krqt|jdks|jdj|krLq|jdj j || sz(load_azure_ovf_pubkeys..rr4z%Multiple 'PublicKeys'(%s) in SSH nodecSs |jdkS)NZ PublicKey)rn)ror/r/r0rpsrrOr{r)rmr:rrZDocument TEXT_NODErjrknodeTypernrkeys wholeTextrkr) ZsshnoderesultsZ pubkeys_noder^rZ text_nodeZpk_nodeZcurrlrr/r/r0load_azure_ovf_pubkeyss8     rvcCsLytj|}WnQtk rf}z1d|}t|dtjt||WYdd}~XnXt|jdd}t |dkrt dt |dkrtdt ||d}t|d d}t |dkrt d t |dkr0td t |d f|d}|j sRtd d}dii} i} d} d} d} x#|j D]}|j |jks|j rq|jj}d}d}t |j dkr |j dj |jkr d}|j dj}tdd|jjD}|dksD|dkr|jdd*krztjdj|j} q|} q|dkr|} q|dkr|} q|dkr|| d.rzNo ProvisioningSectionr4z$found '%d' ProvisioningSection itemscSs |jdkS)N!LinuxProvisioningConfigurationSet)rn)ror/r/r0rpsz$No LinuxProvisioningConfigurationSetzfound '%d' %ssrwz#no child nodes of configuration setZseedfromZ azure_datarOFTcSs"g|]\}}||fqSr/r/)rkvr/r/r0r s z"read_azure_ovf..ZuserdataZ customdataencodingbase64usernameZ userpasswordr`zlocal-hostnamedscfgdefaultrfZsshrZ disablesshpasswordauthenticationZ ssh_pwauthrZ lock_passwdZpasswdpasswordZ default_userZ system_info)Nbase64)Nr)#rZ parseStringrqrrIrrrrmdocumentElementr:rrjrkrrrqrnrrtr=Z attributesrBror{Z b64decoderKr9DS_NAMErZ load_yamlrvrprd encrypt_pass_get_preprovisioning_cfgsr~)r%domruZ error_strruZ provSectionZ lpcs_nodesZlpcsZmd_propsrrtr0rr|rlrZsimplerZattrsr}ZdefuserZpreprovisioning_cfgr/r/r0r/s "          "!        !"         r/cCsddddi}t|jdd}| sCt|dkrTtjd|St|dd d}| st|dkrtjd |St||d.rz!PlatformSettingsSection not foundcSs |jdkS)NZPlatformSettings)rn)ror/r/r0rp\szPlatformSettings not found)rmrr:rIrJ_get_preprovisionedvm_cfg_value#_get_preprovisionedvmtype_cfg_value)rrtZplatform_settings_sectionplatform_settingsr/r/r0r=s&     rcCs}d}t|ddd}| s8t|dkrItjd|Stj|djj}td|dtj |S)NFrcSs |jdkS)Nr.)rn)ror/r/r0rpusz1_get_preprovisionedvm_cfg_value..zPreprovisionedVm not foundzPreprovisionedVm: %srm) rmr:rIrJrZtranslate_bool firstChild nodeValuerr)rZpreprovisionedVmZpreprovisionedVmValr/r/r0rls rcCsd}t|ddd}| sKt|dksK|djdkr\tjd|S|djj}td|dtj|S)NrcSs |jdkS)Nr*)rn)ror/r/r0rpsz5_get_preprovisionedvmtype_cfg_value..zPreprovisionedVMType not foundzPreprovisionedVMType: %srm)rmr:rrIrJrrr)rZpreprovisionedVMTypeZpreprovisionedVMTypeValr/r/r0rs    rz$6$cCs tj||tjddS)NZstrlenr?)cryptrZrand_str)rZsalt_idr/r/r0rsrcCsTy+t|}|jddSWdQRXWn"tk rOtjd|YnXdS)z;Return boolean indicating path to cdrom device has content.iTNzcdrom (%s) is not configuredF)openreadIOErrorrIrJ) cdrom_devfpr/r/r0_check_freebsd_cdroms  rcCsD|dkrdStj|dddd}tj|j}|S)zLReturn content random seed file if available, otherwise, return None.NquietTdecodeF)rrr{Z b64encoder)sourcer}r/r/r0rs   rcCsmg}tjr.d}t|rY|gSn+x(dD] }|jtjd|q5W|jdd|S)Nz/dev/cd0iso9660rzTYPE=%sreverseT)rzudf)rrrrrDsort)rRrZfstyper/r/r0rs    rc Cstjj|d}tjj|s3tdt|d}|j}WdQRXt|\}}}|||d|ifS)Nz ovf-env.xmlzNo ovf-env file foundrb)rzr{rKrrrrr/)Z source_dirZovf_filerr%rr0rtr/r/r0rs r)r(cCs|tjkra|rayt|SWn;tk r`}ztjdt|WYdd}~XnXy tSWn;tk r}ztjdt|WYdd}~XnXiS)a_Convert imds_metadata dictionary to network v2 configuration. Parses network configuration from imds metadata if present or generate fallback network config excluding mlx4_core devices. @param: imds_metadata: Dict of content read from IMDS network service. @return: Dictionary containing network version 2 standard configuration. z?Failed generating network config from IMDS network metadata: %sNz-Failed generating fallback network config: %s)r r+_generate_network_config_from_imds_metadatarqrIrrU-_generate_network_config_from_fallback_config) imds_metadatarur/r/r0r9s   )r9c Csdddii}|d}xt|dD]\}}d}djd|}d |d d i}d d d|ddi}xd&D]} |j| ijdg} | sqd }| dkrd} n d} | rd |d<||ds(      R            +              [ T%$ 5i/ = "!$