관리-도구
편집 파일: __init__.cpython-39.pyc
a '�Dg�� � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlmZ d dl m Z m Z d dl m Z mZmZmZmZmZ d dlmZmZmZmZmZmZmZ d dlmZ d dlm Z d dl m Z d d l m!Z! d d l"m#Z#m$Z$ d d l%m&Z& d d l'm(Z( d d l)m*Z* d dl+m,Z, dZ-dZ.dZ/dZ0e-e.e/gZ1dZ2dZ3dZ4dZ5dZ6dZ7dZ8dZ9e�:e;�Z<dd d � fd d d � fd d!d � fd"�Z=e G d#d$� d$e ��Z>G d%d&� d&e �Z?G d'd(� d(e@�ZAG d)d*� d*e@�ZBG d+d,� d,e@�ZCdYd/d0�ZDe6fd1d2�ZEed3g d4��ZFed5d6d7g�ZGG d8d� de*e jHd9�ZId:d;� ZJeeIeKf d<�d=d>�ZLd?d@� ZMdZeKeNdB�dCdD�ZOdEdF� ZPd[dHdI�ZQG dJdK� dKeR�ZSdLdM� ZTeIeKeNdN�dOdP�ZUeKeeI dQ�dRdS�ZVeKd<�dTdU�ZWeKeKdV�dWdX�ZXdS )\� N)� namedtuple)�Enum�unique)�Any�Dict�List�Optional�Tuple�Union)� atomic_helper�dmi�importer� lifecycle�net� performance� type_utils)� user_data)�util)� write_json)�Distro)� EventScope� EventType)� launch_index)�Paths)�CloudInitPickleMixin)�eventsZdisabled�localr �passZ FILESYSTEM�NETWORK� DataSourcez|EXPERIMENTAL: The structure and format of content scoped under the 'ds' key may change in subsequent releases of cloud-init.zredacted for non-root user� cloud-nameZ_unset�unknownz aws-chinac C s | dkS �NZaws� ��cr# r# �>/usr/lib/python3.9/site-packages/cloudinit/sources/__init__.py�<lambda>G � r' zaws-govc C s | dkS r" r# r$ r# r# r& r' H r( z azure-chinac C s | dkS )NZazurer# r$ r# r# r& r' I r( )zcn-zus-gov-Zchinac @ s2 e Zd ZdZdZdZdZdZdZe d�dd �Z d S ) �NetworkConfigSourcezb Represents the canonical list of network config sources that cloud-init knows about. Zcmdline�dsZ system_cfg�fallbackZ initramfs��returnc C s | j S �N��value��selfr# r# r& �__str__Z s zNetworkConfigSource.__str__N) �__name__� __module__� __qualname__�__doc__�CMD_LINE�DS� SYSTEM_CFGZFALLBACK� INITRAMFS�strr3 r# r# r# r& r) M s r) c @ s& e Zd ZdZdZdZed�dd�ZdS )�NicOrderz Represents ways to sort NICsZmacZnic_namer, c C s | j S r. r/ r1 r# r# r& r3 d s zNicOrder.__str__N)r4 r5 r6 r7 ZMACZNIC_NAMEr< r3 r# r# r# r& r= ^ s r= c @ s e Zd ZdZdS )� DatasourceUnpickleUserDataErrorzERaised when userdata is unable to be unpickled due to python upgradesN�r4 r5 r6 r7 r# r# r# r& r> h s r> c @ s e Zd ZdS )�DataSourceNotFoundExceptionN�r4 r5 r6 r# r# r# r& r@ l s r@ c @ s e Zd ZdZdS )�InvalidMetaDataExceptionz8Raised when metadata is broken, unavailable or disabled.Nr? r# r# r# r& rB p s rB � r# c C s� t �| �}g }g }| �� D ]�\}}|r4|d | }n|}|�� |v sP|�� |v rZ|�|� t|t�r�|�d�r�|�|� |�dd�||< t|t �rt |||�} |� | � d�� |� | � d�� | ||< qt |�|d< t |�|d< |S )z�Process all instance metadata cleaning it up for persisting as json. Strip ci-b64 prefix and catalog any 'base64_encoded_keys' as a list @return Dict copy of processed metadata. �/zci-b64:rC �base64_encoded_keys�sensitive_keys)�copy�deepcopy�items�lower�append� isinstancer< � startswith�replace�dict�process_instance_metadata�extend�pop�sorted) �metadata�key_pathrF �md_copyrE Z sens_keys�key�valZ sub_key_pathZ return_valr# r# r& rP t s2 � � � rP c C s� | � dg �s| S t�| �}| � d�D ]V}|�d�}|}|D ].}||v r:t|| t�r:||d kr:|| }q:||v r$|||< q$|S )z�Redact any sensitive keys from to provided metadata dictionary. Replace any keys values listed in 'sensitive_keys' with redact_value. rF rD ���)�getrG rH �splitrL rO )rT Z redact_valuerV rU � path_parts�obj�pathr# r# r& �redact_sensitive_keys� s" � � � r_ � URLParams)Zmax_wait_secondsZtimeout_secondsZ num_retries�sec_between_retries�DataSourceHostname�hostname� is_defaultc @ s� e Zd ZU eZdZdZdZee e d< dZ dZ dZ eeee f e d< ejejejejfZeedf e d< dZd Zd Zd Zej e j e j e j e j!hiZ"ej e j hiZ#d e$fd e$fdi fddddddf Z%eee e&f df e d< dZ'dZ(ee df e d< dZ)dZ*ee e d< d Z+d|e,e-d�dd �Z.e/dd �d d �Z0d d!� Z1e2d"�d#d$�Z3e2d"�d%d&�Z4d'd(� Z5d)d*� Z6d}d,d-�Z7e8j9d.d/d0�e2d"�d1d2��Z:d~d4d5�Z;e2d"�d6d7�Z<d8d9� Z=dd:d;�Z>d<d=� Z?d>d?� Z@eAd@dA� �ZBeAdBdC� �ZCdDdE� ZDeAdFdG� �ZEdHdI� ZFeAdJdK� �ZGdLdM� ZHdNdO� ZIdPdQ� ZJdRdS� ZKdTdU� ZLdVdW� ZMdXdY� ZNdZd[� ZOd\d]� ZPd^d_� ZQeAd`da� �ZReAdbdc� �ZSddde� ZTd�dfdg�ZUdhdi� ZVeWe dj�dkdl�ZXeWe e2dm�dndo�ZYdpdq� ZZdrds� Z[e\d�dtdu��Z]eAdvdw� �Z^dxdy� Z_dzd{� Z`dS )�r z en_US.UTF-8Z_undefN� _cloud_name�_crawled_metadata.�network_config_sourcesrY � � � � ec2_metadata� network_jsonrT )�userdataN)� userdata_rawN)� vendordataN)�vendordata_rawN)� vendordata2N)�vendordata2_rawN�cached_attr_defaultsF) Zcombined_cloud_config� merged_cfg�merged_system_cfgzsecurity-credentialsrm � user-datar ro � vendor-datazds/vendor_data�sensitive_metadata_keys�extra_hotplug_udev_rules)�distro�pathsc C s� || _ || _|| _d | _i | _d | _d | _d | _d | _d | _ d | _ t | _ t | _ t�| j d| jfi �| _| jsri | _|s�t�| j�| _n|| _d S )NZ datasource)�sys_cfgrz r{ rm rT rn ro rq rp rr �metadata_address�UNSETrl rk r Zget_cfg_by_path�dsname�ds_cfg�udZUserDataProcessor�ud_proc)r2 r| rz r{ r� r# r# r& �__init__D s* �zDataSource.__init__)�ci_pkl_versionr- c C s� dddt ddt dddd� }|�� D ] \}}t| |�s"t| ||� q"t| d�s\t| ddd� � t| d�r�| jdur�zt| j� W n8 ty� } z t�d|� t � |�W Y d}~n d}~0 0 dS ) z(Perform deserialization fixes for Paths.NF) rf �_platform_type� _subplatformrk ry r} rl �skip_hotplug_detectrq rr � check_if_fallback_is_allowedc S s dS �NFr# r# r# r# r& r' q r( z&DataSource._unpickle.<locals>.<lambda>rm z:Unable to unpickle datasource: %s. Ignoring current cache.) r~ rI �hasattr�setattrrm r< �AttributeError�LOG�debugr> )r2 r� Zexpected_attrsrW r0 �er# r# r& � _unpickle^ s2 � �zDataSource._unpicklec C s t �| �S r. �r �obj_namer1 r# r# r& r3 � s zDataSource.__str__r, c C s dS )z#Check if running on this datasourceTr# r1 r# r# r& � ds_detect� s zDataSource.ds_detectc C sN | j �� t� �� kr$t�d| � dS | j�dg �| j gkrJt�d| � dS dS )aJ Override if either: - only a single datasource defined (nothing to fall back to) - command line argument is used (ci.ds=OpenStack) Note: get_cmdline() is required for the general case - when ds-identify does not run, _something_ needs to detect the kernel command line definition. z6Kernel command line set to use a single datasource %s.TZdatasource_listz2Datasource list set to use a single datasource %s.F)r rJ � parse_cmdliner� r� r| rZ r1 r# r# r& �override_ds_detect� s ��z DataSource.override_ds_detectc C s@ | � � r| �� S | �� r,t�d| � | �� S t�d| � dS dS )z&Overrides runtime datasource detectionz Detected %szDid not detect %sFN)r� � _get_datar� r� r� r1 r# r# r& �_check_and_get_data� s � z DataSource._check_and_get_datac C s� | � � j}| �� }| j}|d }ddg||t| j| j| j�| j| j|d d |d d |d d | j| �� |d |||d d |||d d | j| j |d |d d �iS )z2Return a dictionary of standardized metadata keys.�sys_info�v1� subplatformZdistr rj � Zpython�uname� �platform�variant)Z _beta_keys�availability-zone�availability_zone�cloud_idr � cloud_namerz Zdistro_versionZdistro_releaser� Zpublic_ssh_keysZpython_version� instance-id� instance_idZkernel_release�local-hostname�local_hostname�machine�regionr� Zsystem_platformr� ) � get_hostnamerc �get_instance_idr� �canonical_cloud_idr� r� � platform_type�get_public_ssh_keysr� )r2 � instance_datar� r� r� Zsysinfor# r# r& �_get_standardized_metadata� s> � ��z%DataSource._get_standardized_metadatar# c C sL | j s dS |r|}n| j}|D ] \}}t| |�r t| ||� q |sHd| _ dS )z�Reset any cached metadata attributes to datasource defaults. @param attr_defaults: Optional tuple of (attr, value) pairs to set instead of cached_attr_defaults. NF)� _dirty_cachers r� r� )r2 Z attr_defaultsZ attr_valuesZ attributer0 r# r# r& �clear_cached_attrs� s z DataSource.clear_cached_attrszGetting metadata�always)Zlog_modec C s" d| _ | �� }|s|S | �� |S )z�Datasources implement _get_data to setup metadata and userdata_raw. Minimally, the datasource should return a boolean True on success. T)r� r� �persist_instance_data)r2 Z return_valuer# r# r& �get_data� s zDataSource.get_dataTc C s\ |r&t j�| jj�r&t| | j�d�� | jdur^t� | j�}|� dd� |� dd� d|i}n>dd| j ii}| j t kr�| j |d d< | jt kr�| j|d d< t|d d < t� | j�|d < d |d d < t� |d �|d < d |d d < t�� |d< |�| �|�� z"t�|�}tt�|�| jd�}W nn t�yX } z t � dt |�� W Y d}~dS d}~0 t �y� } z t � dt |�� W Y d}~dS d}~0 0 | j� d�}|d �!dd�}t j�"| jj#d�} t�$| � d|� �|� d�� d} | � d|� �} t j�%| ��rt j�&| �} tj'| | dd� | �r0| | k�r0t�(| � t)||dd � | j� d �} t)| t*|�� dS ) aP Process and write INSTANCE_JSON_FILE with all instance metadata. Replace any hyphens with underscores in key names for use in template processing. :param write_cache: boolean set True to persist obj.pkl when instance_link exists. @return True on successful write, False otherwise. Zobj_pklNrv rw r* Z meta_datarl rk Z_docrt z<DEPRECATED: Use merged_system_cfg. Will be dropped from 24.1ru zUMerged cloud-init system config from /etc/cloud/cloud.cfg and /etc/cloud/cloud.cfg.d/r� )rF z'Error persisting instance-data.json: %sFZinstance_data_sensitiver� r� Znonezcloud-id�-� T)�forcei� )�moder� )+�osr^ �lexistsr{ Z instance_link� pkl_storeZ get_ipath_currf rG rH rR rT rl r~ rk �EXPERIMENTAL_TEXTr| r Z system_info�updater� r Z json_dumpsrP �json�loadsrx � TypeErrorr� �warningr< �UnicodeDecodeErrorZ get_runpathrZ �joinZrun_dir� write_file�exists�realpathZsym_linkZdel_filer r_ ) r2 Z write_cacheZcrawled_metadatar� ZcontentZprocessed_datar� Zjson_sensitive_filer� Z cloud_id_fileZprev_cloud_id_fileZnew_cloud_id_fileZ json_filer# r# r& r� � sh ���� � z DataSource.persist_instance_datac C s t d��dS )z@Walk metadata sources, process crawled data and save attributes.zlSubclasses of DataSource must implement _get_data which sets self.metadata, vendordata_raw and userdata_raw.N)�NotImplementedErrorr1 r# r# r& r� E s �zDataSource._get_datac C sD | j }zt| j�d| j ��}W n* tyH t�td| j�d�|� Y n0 | j}z t dt| j�d| j���}W n0 ty� | j}t�td| j�d�|� Y n0 | j }zt| j�d| j ��}W n* t y� t�td| j�d�|� Y n0 | j }zt| j�d| j ��}W n, t �y4 t�td | j�d�|� Y n0 t ||||�S ) z�Return the Datasource's preferred url_read parameters. Subclasses may override url_max_wait, url_timeout, url_retries. @return: A URLParams object with max_wait_seconds, timeout_seconds, num_retries. �max_waitz6Config max_wait '%s' is not an int, using default '%s'r �timeoutz5Config timeout '%s' is not an int, using default '%s'�retriesz5Config retries '%s' is not an int, using default '%s'ra zAConfig sec_between_retries '%s' is not an int, using default '%s')� url_max_wait�intr� rZ � ValueErrorr �logexcr� � url_timeout�max� url_retries� Exception�url_sec_between_retriesr` )r2 r� r� r� ra r# r# r& �get_url_paramsL s\ � � � �� � zDataSource.get_url_paramsc C s2 | j d u r | j�| �� �| _ |r,| �| j �S | j S r. )rm r� �process�get_userdata_raw� _filter_xdata)r2 Z apply_filterr# r# r& � get_userdata� s zDataSource.get_userdatac C s" | j d u r | j�| �� �| _ | j S r. )ro r� r� �get_vendordata_rawr1 r# r# r& �get_vendordata� s zDataSource.get_vendordatac C s" | j d u r | j�| �� �| _ | j S r. )rq r� r� �get_vendordata2_rawr1 r# r# r& �get_vendordata2� s zDataSource.get_vendordata2c C s | j s| j�� | _ | j S r. )r� r rJ r1 r# r# r& r� � s zDataSource.platform_typec C s | j s| �� | _ | j S )a� Return a string representing subplatform details for the datasource. This should be guidance for where the metadata is sourced. Examples of this on different clouds: ec2: metadata (http://169.254.169.254) openstack: configdrive (/dev/path) openstack: metadata (http://169.254.169.254) nocloud: seed-dir (/seed/dir/path) lxd: nocloud (/seed/dir/path) )r� �_get_subplatformr1 r# r# r& r� � s zDataSource.subplatformc C s | j rd| j � d�S tS )z?Subclasses should implement to return a "slug (detail)" string.z metadata (�))r} �METADATA_UNKNOWNr1 r# r# r& r� � s zDataSource._get_subplatformc C sv | j r | j S | jrb| j�t�rb| j�t�}t|t�r@|�� | _ qp| �� �� | _ t� dtt |�� n| �� �� | _ | j S )z�Return lowercase cloud name as determined by the datasource. Datasource can determine or define its own cloud product name in metadata. z5Ignoring metadata provided key %s: non-string type %s) re rT rZ �METADATA_CLOUD_NAME_KEYrL r< rJ �_get_cloud_namer� r� �type)r2 r� r# r# r& r� � s �zDataSource.cloud_namec C s | j S )z�Return the datasource name as it frequently matches cloud name. Should be overridden in subclasses which can run on multiple cloud names, such as DatasourceEc2. )r r1 r# r# r& r� � s zDataSource._get_cloud_namec C s" | j s d S d| j v r | j d S d S )Nz launch-index)rT r1 r# r# r& r � s zDataSource.launch_indexc C s0 t �t�| j ��g}|}|D ]}|�|�}q |S r. )r ZFilterr Zsafe_intZapply)r2 Z processed_ud�filtersZnew_ud�fr# r# r& r� � s � zDataSource._filter_xdatac C s | j S r. )rn r1 r# r# r& r� � s zDataSource.get_userdata_rawc C s | j S r. )rp r1 r# r# r& r� � s z DataSource.get_vendordata_rawc C s | j S r. )rr r1 r# r# r& r� � s z DataSource.get_vendordata2_rawc C s i S r. r# r1 r# r# r& �get_config_obj� s zDataSource.get_config_objc C s t | j�d��S )Nz public-keys)�normalize_pubkey_datarT rZ r1 r# r# r& r� � s z DataSource.get_public_ssh_keysc C s dS )a5 Publish the public SSH host keys (found in /etc/ssh/*.pub). @param hostkeys: List of host key tuples (key_type, key_value), where key_type is the first field in the public key file (e.g. 'ssh-rsa') and key_value is the key itself (e.g. 'AAAAB3NzaC1y...'). Nr# )r2 Zhostkeysr# r# r& �publish_host_keys� s z DataSource.publish_host_keysc C sd ddi}|� � D ]N\}}|�|�s$q|D ]4}d||t|�d � f }tj�|�r(| S q(qd S )N�sd)ZvdZxvdZvtbz /dev/%s%s)rI rM �lenr� r^ r� )r2 Z short_nameZmappingsZnfromZtlistZntoZcandr# r# r& � _remap_device s zDataSource._remap_devicec C s d S r. r# )r2 �_namer# r# r& �device_name_to_device s z DataSource.device_name_to_devicec C s, | j }z| j�� }W n ty& Y n0 |S )z<Default locale is en_US.UTF-8, but allow distros to override)�default_localerz � get_localer� )r2 �localer# r# r& r� s zDataSource.get_localec C s2 | j �d| j �d��}|r |S | j �di ��d�S )Nr� r� Z placement�rT rZ )r2 Z top_level_azr# r# r& r� " s �z DataSource.availability_zonec C s | j �d�S )Nr� r� r1 r# r# r& r� + s zDataSource.regionc C s" | j rd| j vrdS t| j d �S )Nr� ziid-datasource)rT r< r1 r# r# r& r� / s zDataSource.get_instance_idc C s^ d}d}|}d}| j r"| j �d�s�|r0td|�S g }t�� } | dkrHd}t�| �} | rt| �d�dkrtt| ��d�}n8| r�| �d�dkr�t| ��d�}n| r�| |g}n||g}nX| j d } t � | �r�g }|r�t� | �}|r�t|��d�}nd | � dd � g}n | �d�}t |�d k�r0|d } d�|d d� �}n|d } |�rT||k�rTd | |f } t| |�S ) a� Get hostname or fqdn from the datasource. Look it up if desired. @param fqdn: Boolean, set True to return hostname with domain. @param resolve_ip: Boolean, set True to attempt to resolve an ipv4 address provided in local-hostname meta-data. @param metadata_only: Boolean, set True to avoid looking up hostname if meta-data doesn't have local-hostname present. @return: a DataSourceHostname namedtuple <hostname or qualified hostname>, <is_default> (str, bool). is_default is a bool and it's true only if hostname is localhost and was returned by util.get_hostname() as a default. This is used to differentiate with a user-defined localhost hostname. Optionally return (None, False) when metadata_only is True and local-hostname data is not available. Z localdomainZ localhostFr� NT�.r zip-%sr� rj z%s.%s)rT rZ rb r r� Zget_fqdn_from_hosts�findr< r[ r Zis_ipv4_addressZ gethostbyaddrrN r� r� ) r2 ZfqdnZ resolve_ipZ metadata_onlyZ defdomainZdefhost�domainrd Ztoksrc Z hosts_fqdnZlhostr# r# r& r� 5 sF zDataSource.get_hostnamec C s | j j| d�S )N)Z data_source)rz �get_package_mirror_infor1 r# r# r& r� } s z"DataSource.get_package_mirror_info)�source_event_typesc C sP i }|D ]B}| j �� D ]2\}}||v r|�|�s:t� ||< || �|� qq|S r. )�supported_update_eventsrI rZ �set�add)r2 r� �supported_events�eventZ update_scopeZ update_eventsr# r# r& �get_supported_events� s � z DataSource.get_supported_events)r� r- c C s� | � |�}|�� D ]<\}}t�d|jd�dd� |D ��� | �d| tff� q|rl| �� | �� }|rldS t�d| d�dd� |D ��� d S ) a� Refresh cached metadata if the datasource supports this event. The datasource has a list of supported_update_events which trigger refreshing all cached metadata as well as refreshing the network configuration. @param source_event_types: List of EventTypes which may trigger a metadata update. @return True if the datasource did successfully update cached metadata due to source_event_type. z:Update datasource metadata and %s config due to events: %s�, c S s g | ] }|j �qS r# r/ ��.0r� r# r# r& � <listcomp>� r( z;DataSource.update_metadata_if_supported.<locals>.<listcomp>z _%s_configTz(Datasource %s not updated for events: %sc S s g | ] }|j �qS r# r/ r� r# r# r& r � r( F) r� rI r� r� r0 r� r� r~ r� )r2 r� r� ZscopeZmatched_events�resultr# r# r& � update_metadata_if_supported� s& ��z'DataSource.update_metadata_if_supportedc C s dS r� r# )r2 r| r# r# r& �check_instance_id� s z DataSource.check_instance_idc C s dS )a check_if_fallback_is_allowed() Checks if a cached ds is allowed to be restored when no valid ds is found in local mode by checking instance-id and searching valid data through ds list. @return True if a ds allows fallback, False otherwise. Fr# r1 r# r# r& r� � s z'DataSource.check_if_fallback_is_allowedc C sV |d u r t }|d u rt}| D ]4}|d u r*q ||v r:| S t�d||� | S q |S )Nz%invalid dsmode '%s', using default=%s)�DSMODE_NETWORK� VALID_DSMODESr� r� )Z candidates�defaultZvalid� candidater# r# r& �_determine_dsmode� s � z DataSource._determine_dsmodec C s d S r. r# r1 r# r# r& �network_config� s zDataSource.network_configc C s dS )a( setup(is_new_instance) This is called before user-data and vendor-data have been processed. Unless the datasource has set mode to 'local', then networking per 'fallback' or per 'network_config' will have been written and brought up the OS at this point. Nr# )r2 �is_new_instancer# r# r& �setup� s zDataSource.setupc C s dS )a� activate(cfg, is_new_instance) This is called before the init_modules will be called but after the user-data and vendor-data have been fully processed. The cfg is fully up to date config, it contains a merged view of system config, datasource config, user config, vendor config. It should be used rather than the sys_cfg passed to __init__. is_new_instance is a boolean indicating if this is a new instance. Nr# )r2 Zcfgr r# r# r& �activate� s zDataSource.activate)N)r# )T)F)FFF)NN)ar4 r5 r6 r Zdsmoder� r re r r< �__annotations__r� r� rf r r r) r8 r; r: r9 rg r r� r� r� r� r r r �BOOT_NEW_INSTANCEZBOOTZ BOOT_LEGACYZHOTPLUGr� Zdefault_update_eventsr~ rs r r� rx r� ry Z_ci_pkl_versionr r r� r� r� r3 �boolr� r� r� r� r� r Ztimedr� r� r� r� r� r� r� �propertyr� r� r� r� r� r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r� r r r� � staticmethodr r r r r# r# r# r& r � s� � �� �� � $& L< H� & )� metaclassc C s� g }| s |S t | t�r | �� S t | ttf�r4t| �S t | t�r�| �� D ]>\}}t |t�r^|g}t |ttf�rF|D ]}|rp|�|� qpqF|S r. )rL r< � splitlines�listr� rO rI rK )Z pubkey_data�keysZ_keynameZklistZpkeyr# r# r& r� � s r� r, c C s6 t |||�}dd� |D �}t|v r&dnd} t�d| |� t||�D ]�\} } tjd| �dd� d | | f d | | f |d �} z~| �f t�d | � | | ||�} | �t j g�r�d | | f | _ | t � | �fW d � W S W d � n1 s�0 Y W qB t�y t�td| � Y qB0 qBdd�|� }t|��d S )Nc S s g | ]}t �|��qS r# r� )r� r� r# r# r& r r( z find_source.<locals>.<listcomp>�networkr z#Searching for %s data source in: %sz search-%sr rC z searching for %s data from %szno %s data found from %s)�name� description�message�parentz%Seeing if we can get any data from %szfound %s data from %szGetting data from %s failedz4Did not find any data source, searched classes: (%s)r� )� list_sources� DEP_NETWORKr� r� �zipr ZReportEventStackrN r r r r r r� r� r r� r� r@ )r| rz r{ Zds_deps�cfg_list�pkg_listZreporter�ds_listZds_namesr� r �clsZmyrep�s�msgr# r# r& � find_source s4 � �D�r$ c C s� g }t �d| ||� | D ]j}t�|�}t�||dg�\}}|sJt �d|� |D ]2}t�|�} t| d�} | |�} | rN|�| � qqNq|S )z�Return a list of classes that have the same depends as 'depends' iterate through cfg_list, loading "DataSource*" modules and calling their "get_datasource_list". Return an ordered list of classes that match (if any) zLLooking for data source in: %s, via packages %s that matches dependencies %sZget_datasource_listzDCould not import %s. Does the DataSource exist and is it importable?) r� r� r Z"match_case_insensitive_module_name� find_module�error� import_module�getattrrQ ) r �dependsr Zsrc_listr* Zds_nameZm_locsZ _looked_locsZm_loc�modZlister�matchesr# r# r& r 3 s2 � �� r � system-uuid)�fieldr- c C s* | sdS t �|�}|sdS | �� |�� kS r� )r Z read_dmi_datarJ )r� r- Z dmi_valuer# r# r& � instance_id_matches_system_uuidW s r. c C sl | st } |st }|t kr(| t kr$| S |S t�� D ]*\}}|\}}|�|�r0|| �r0| S q0| t krh| S |S )z@Lookup the canonical cloud-id for a given cloud_name and region.)r� �CLOUD_ID_REGION_PREFIX_MAPrI rM )r� r� r� �prefixZ cloud_id_testr� Z valid_cloudr# r# r& r� e s r� Tc C sj | sdS t | t�r| S t | t�r*t�| �S t | t�rV|du rNt| �d�dd�S td��tdt | � ��dS )aL data: a loaded object (strings, arrays, dicts). return something suitable for cloudinit vendordata_raw. if data is: None: return None string: return string list: return data the list is then processed in UserDataProcessor dict: return convert_vendordata(data.get('cloud-init')) NTz cloud-initF)�recursez'vendordata['cloud-init'] cannot be dictz$Unknown data type for vendordata: %s) rL r< r rG rH rO �convert_vendordatarZ r� r� )�datar1 r# r# r& r2 x s r2 c @ s e Zd ZdS )�BrokenMetadataNrA r# r# r# r& r4 � s r4 c C s4 g }t | �}|D ] \}}|t |�kr|�|� q|S r. )r� rK )r) r Zret_listZdepsetr! Zdepsr# r# r& �list_from_depends� s r5 )r] �fnamer- c C sp zt �| �}W n" ty0 t�td| � Y dS 0 ztj||ddd� W n" tyj t�td|� Y dS 0 dS )z[Use pickle to serialize Datasource to a file as a cache. :return: True on success z Failed pickling datasource %sF�wb� )Zomoder� z Failed pickling datasource to %sT)�pickle�dumpsr� r r� r� r� )r] r6 Z pk_contentsr# r# r& r� � s r� )r6 r- c C s� d}zt �| �}W n> tyP } z&tj�| �r<t�d| |� W Y d}~n d}~0 0 |sZdS z t� |�W S t yz Y dS ty� t � td| � Y dS 0 dS )zBUse pickle to deserialize a instance Datasource from a cache file.Nz failed loading pickle in %s: %sz#Failed loading pickled blob from %s) r Zload_binary_filer� r� r^ �isfiler� r� r9 r� r> r� )r6 Zpickle_contentsr� r# r# r& �pkl_load� s $ r< c C s t t�� �S )z�Check if command line argument for this datasource was passed Passing by command line overrides runtime datasource detection )�parse_cmdline_or_dmir Z get_cmdliner# r# r# r& r� � s r� )�inputr- c C s� t �d| �}t �d| �}t �d| �}|p.|p.|}|p6|}|rn|�d��� }tjd|� d|� �dd|� d �d � |r�|�d�r�|�d�S d S ) Nz(?:^|\s)ds=([^\s;]+)z(?:^|\s)ci\.ds=([^\s;]+)z (?:^|\s)ci\.datasource=([^\s;]+)rj z8Defining the datasource on the command line using ci.ds=z or ci.datasource=z23.2zUse ds=z instead)� deprecatedZdeprecated_versionZ extra_messagerC )�re�search�group�stripr Z deprecate)r> Z ds_parse_0Z ds_parse_1Z ds_parse_2r* r? r r# r# r& r= � s& �� � r= )rC r# )r, )T)Y�abcrG r� Zloggingr� r9 r@ � collectionsr �enumr r �typingr r r r r r Z cloudinitr r r r r r r r r� r Zcloudinit.atomic_helperr Zcloudinit.distrosr Zcloudinit.eventr r Zcloudinit.filtersr Zcloudinit.helpersr Zcloudinit.persistencer Zcloudinit.reportingr ZDSMODE_DISABLEDZ DSMODE_LOCALr Z DSMODE_PASSr ZDEP_FILESYSTEMr Z DS_PREFIXr� ZREDACT_SENSITIVE_VALUEr� r~ r� Z getLoggerr4 r� r/ r) r= r� r> r@ rB rP r_ r` rb �ABCMetar r� r< r$ r r r. r� r2 �IOErrorr4 r5 r� r< r� r= r# r# r# r& �<module> s� $ � � # � � 7 � !% ��