관리-도구
편집 파일: urls.cpython-39.pyc
a �)g M � @ s� d Z ddlmZmZmZ eZddlZddlZddl Z ddl Z ddl Z ddl Z ddlZ ddlZddlZddlZddlZddlZddlZddlZddlZddlZddlZddlZddlZddlm Z zddl Z dZ dZ W n" e y� dZ e�!� Z e"Z#Y n0 e j#Z#z ddl$Z W n e �y& ddl%Z Y n0 z ddl&Z&W n e �yT ddl'm(Z& Y n0 ddl)m* m+ m,Z- ddl.m* m/ m0 m1Z2 ddl3m* m/ m0 m4 m5Z6 ddl7m8Z8m9Z9 ddl:m;Z;m<Z<m=Z= dd l>m?Z? dd l@mAZAmBZB dd lCmDZDmEZEmFZF z ddlGmHZI dd lGmJZJmKZK W n, e �yP ddlLZIdd lLmJZJmKZK Y n0 eIjMjNeIjM_Oz dd lPmQZQmRZRmSZS dZTW n eU�y� dZTY n0 zddlVZVdZWW n eU�y� dZWY n0 zddlVmXZXmYZY dZZW n e �y� dZZY n0 dZ[dZ\eZ�s�z:zddl]m^Z^ W n eU�y0 ddl_m^Z^ Y n0 dZ[W nd eU�y� z:zddl]m`Z` W n eU�yz ddl_m`Z` Y n0 dZ\W n eU�y� Y n0 Y n0 eW�r�eVjaZbeZ�s4eW�r4zddlcZcddldZcW n e �y� Y nV0 ecje�fd�Zgec�heg�ZidD ]6Zjzeiej eVjkZbW �q2W n el�y, Y n0 �q�[iddd�Zmen� ZodZpzddlVmqZqmrZr W nB e �y� zddlsmqZqmrZr W n e �y� dZpY n0 Y n0 dZtz4ddlumvZv ddlwmxZx ddlymzZz ddl{m|Z| W n e �y� dZtY n0 zddl}Z}dZ~W n e �y dZ~Y n0 dZz ddl�Z�G dd � d eK�Z�W n e �y\ e�!� ZdZ�Y n0 ep�s�zdd l�m�Z� e�ZrW n$ e �y� G d d � d e��ZrY n0 d d!� Z�d"d#� Z�d$d%� Z�d&d'� ZqdZpd(Z�ej�d)ej�ej�B d*�Z�G d+d,� d,eU�Z�G d-d.� d.e��Z�G d/d0� d0e��Z�G d1d2� d2e��Z�G d3d4� d4eU�Z�dZ�dZ�dZ�dZ�e�e&d5��r�e�eId6��r�G d7d8� d8e&j��Z�G d9d:� d:eIj��Z�G d;d<� d<eIj��Z�e d=d>� �Z�G d?d@� d@e&j��Z�G dAdB� dBe&j��Z�G dCdD� dDeIj��Z�G dEdF� dFe��Z�dGdH� Z�dIdJ� Z�dKdL� Z�dMdN� Z�G dOdP� dPe#�Z�G dQdR� dReIj��Z�ddSdT�Z�d�dUdV�Z�dWdX� Z�d�dYdZ�Z�d�d[d\�Z�G d]d^� d^eIjK�Z�d�d_d`�Z�d�dadb�Z�dcdd� Z�d�dfdg�Z�G dhdi� di�Z�d�dldm�Z�dndo� Z�dpdq� Z�drds� Z�d�dtdu�Z�dvdw� Z�d�d{d|�Z�d�d}d~�Z�dS )�a� The **urls** utils module offers a replacement for the urllib2 python library. urllib2 is the python stdlib way to retrieve files from the Internet but it lacks some security features (around verifying SSL certificates) that users should care about in most situations. Using the functions in this module corrects deficiencies in the urllib2 module wherever possible. There are also third-party libraries (for instance, requests) which can be used to replace urllib2 with a more secure library. However, all third party libraries require that the library be installed on the managed machine. That is an extra step for users making use of a module. If possible, avoid third party libraries by using this code instead. � )�absolute_import�division�print_functionN)�contextmanagerTF)�Mapping� is_sequence)�PY2�PY3� string_types)� cStringIO)�get_distribution�missing_required_lib)�to_bytes� to_native�to_text)�AbstractHTTPHandler� BaseHandler)�urlparse� urlunparse�unquote)�create_default_context� SSLContext)�PyOpenSSLContext)�ssl_wrap_socket�ssl)ZTLSv1_1_methodZTLSv1_2_methodz backports.ssl_match_hostnamez3.7.0.1)Z pypi_name�version)�match_hostname�CertificateError)�x509)�default_backend)�hashes)�UnsupportedAlgorithmc @ s< e Zd ZdZe�dej�ZdZd dd�Z dd� Z d d � Z dS ) �HTTPGSSAPIAuthHandlerz@ Handles Negotiate/Kerberos support through the gssapi library. z)(?:.*)\s*(Negotiate|Kerberos)\s*([^,]*),?i� Nc C s || _ || _d | _d S �N)�username�password�_context)�selfr$ r% � r( �=/usr/lib/python3.9/site-packages/ansible/module_utils/urls.py�__init__� s z HTTPGSSAPIAuthHandler.__init__c C s6 | j �|�dd��}|r2|�d�t�|�d��fS d S )Nzwww-authenticate� � � )�AUTH_HEADER_PATTERN�search�get�group�base64Z b64decode)r' �headersZ auth_matchr( r( r) �get_auth_value� s z$HTTPGSSAPIAuthHandler.get_auth_valuec C s� | j r d S tt|�� ��}| �|�}|s,d S |\}} d } | jrRtj| jtjj d�} | r�| j r�t tj d�spt d��t| j dd�} tj j| | dd�j} ntj| dd�} d } t|d �}|r�t�� d kr�t|�}|r�tj jd | d �} t�d |d tjj�}tjd|| | d�| _ d }| j j�s~| j �| �}|�s.�q~d|tt � |��f }|� d|� | j � |�}| �|j!�}|�sr�q~|d } �q|S )N)Z name_type�acquire_cred_with_passwordz�Platform GSSAPI library does not support gss_acquire_cred_with_password, cannot acquire GSSAPI credential with explicit username and password.�surrogate_or_strict��errorsZinitiate)�usage)�namer9 T�Darwins tls-server-end-point:)Zapplication_datazHTTP@%s�hostname)r9 r: �credsZchannel_bindingsz%s %s� Authorizationr, )"r& �generic_urlparser � get_full_urlr4 r$ �gssapi�NameZNameType�userr% �hasattr�raw�NotImplementedErrorr r5 r= Z Credentials� getpeercert�platform�system� get_channel_binding_cert_hashZChannelBindingsZhostbased_serviceZSecurityContextZcomplete�stepr r2 � b64encode�add_unredirected_header�parent�openr3 )r' �req�fp�code�msgr3 �parsedZ auth_headerZ auth_protocolZin_tokenr$ Z b_passwordZcredZcbt�certZ cert_hash�targetZrespZ out_tokenr( r( r) �http_error_401� sJ z$HTTPGSSAPIAuthHandler.http_error_401)NN) �__name__� __module__� __qualname__�__doc__�re�compile�Ir. Z handler_orderr* r4 rW r( r( r( r) r" � s r" )�SSLCertVerificationErrorc @ s e Zd ZdS )r N)rX rY rZ r( r( r( r) r * s r c C s� | sdS | � d�}|s&| �� |�� kS |dkr>tdt| � ��| �d�\}}}d|v rftdt| � ��|sztdt| � ��|dkr�tdt| � ��|�d�\}}}|r�|s�dS |�� |�� kS ) a� Matching according to RFC 6125, section 6.4.3 - Hostnames are compared lower case. - For IDNA, both dn and hostname must be encoded as IDN A-label (ACE). - Partial wildcards like 'www*.example.org', multiple wildcards, sole wildcard or wildcards in labels other then the left-most label are not supported and a CertificateError is raised. - A wildcard must match at least one character. F�*r, z.too many wildcards in certificate DNS name: %s�.z7wildcard can only be present in the leftmost label: %s.z<sole wildcard without additional labels are not support: %s.z:partial wildcards in leftmost label are not supported: %s.)�count�lowerr �repr� partition)Zdnr< Z wildcardsZ dn_leftmost�sepZ dn_remainderZhostname_leftmostZhostname_remainderr( r( r) �_dnsname_match- s@ �������rg c C s� zt | dd�}W n" ty2 tdt| � ��Y n0 tjdk rD|}n| }|�d�dkr~z t�|�W S t tj t fy| Y n0 zt� tj |�W S t tj t fy� tdt| � ��Y n ty� Y n0 tdt| � ��d S ) z�Try to convert an IP address to packed binary form Supports IPv4 addresses on all platforms and IPv6 on platforms with IPv6 support. �strictr7 z %s must be an all-ascii string.)� ra ri z)%s is neither an IPv4 nor an IP6 address.z%s is not an IPv4 address.N)r � UnicodeError� ValueErrorrd �sys� version_inforb �socketZ inet_aton�OSError�error� TypeErrorZ inet_ptonZAF_INET6�AttributeError)�ipnameZb_ipnameZn_ipnamer( r( r) � _inet_patona s* � rt c C s t | �� �}||kS )z�Exact matching of IP addresses. RFC 6125 explicitly doesn't define an algorithm for this (section 1.7.2 - "Out of Scope"). )rt �rstrip)rs �host_ip�ipr( r( r) �_ipaddress_match� s rx c C sf | s t d��ztt|dd��}W n* ty6 d}Y n t yJ d}Y n0 g }| �dd�}|D ]^\}}|dkr�|du r�t||�r� dS |�|� q`|dkr`|dur�t||�r� dS |�|� q`|�s | �d d�D ]6}|D ],\}}|d kr�t||�r� dS |�|� q�q�t|�d k�r6t d |d � t t |��f ��n,t|�d k�rZt d||d f ��nt d��dS )a Verify that *cert* (in decoded format as returned by SSLSocket.getpeercert()) matches the *hostname*. RFC 2818 and RFC 6125 rules are followed. The function matches IP addresses rather than dNSNames if hostname is a valid ipaddress string. IPv4 addresses are supported on all platforms. IPv6 addresses are supported on platforms with IPv6 support (AF_INET6 and inet_pton). CertificateError is raised on failure. On success, the function returns nothing. ztempty or no certificate, match_hostname needs a SSL socket or SSL context with either CERT_OPTIONAL or CERT_REQUIREDrh r7 NZsubjectAltNamer( ZDNSz IP AddressZsubjectZ commonNamer, z&hostname %r doesn't match either of %s�, z hostname %r doesn't match %rr z=no appropriate commonName or subjectAltName fields were found) rk rt r rj r0 rg �appendrx �lenr �join�maprd )rU r< rv ZdnsnamesZsan�key�value�subr( r( r) r � s> r s� -----BEGIN CERTIFICATE----- MIICvDCCAiWgAwIBAgIJAO8E12S7/qEpMA0GCSqGSIb3DQEBBQUAMEkxCzAJBgNV BAYTAlVTMRcwFQYDVQQIEw5Ob3J0aCBDYXJvbGluYTEPMA0GA1UEBxMGRHVyaGFt MRAwDgYDVQQKEwdBbnNpYmxlMB4XDTE0MDMxODIyMDAyMloXDTI0MDMxNTIyMDAy MlowSTELMAkGA1UEBhMCVVMxFzAVBgNVBAgTDk5vcnRoIENhcm9saW5hMQ8wDQYD VQQHEwZEdXJoYW0xEDAOBgNVBAoTB0Fuc2libGUwgZ8wDQYJKoZIhvcNAQEBBQAD gY0AMIGJAoGBANtvpPq3IlNlRbCHhZAcP6WCzhc5RbsDqyh1zrkmLi0GwcQ3z/r9 gaWfQBYhHpobK2Tiq11TfraHeNB3/VfNImjZcGpN8Fl3MWwu7LfVkJy3gNNnxkA1 4Go0/LmIvRFHhbzgfuo9NFgjPmmab9eqXJceqZIlz2C8xA7EeG7ku0+vAgMBAAGj gaswgagwHQYDVR0OBBYEFPnN1nPRqNDXGlCqCvdZchRNi/FaMHkGA1UdIwRyMHCA FPnN1nPRqNDXGlCqCvdZchRNi/FaoU2kSzBJMQswCQYDVQQGEwJVUzEXMBUGA1UE CBMOTm9ydGggQ2Fyb2xpbmExDzANBgNVBAcTBkR1cmhhbTEQMA4GA1UEChMHQW5z aWJsZYIJAO8E12S7/qEpMAwGA1UdEwQFMAMBAf8wDQYJKoZIhvcNAQEFBQADgYEA MUB80IR6knq9K/tY+hvPsZer6eFMzO3JGkRFBh2kn6JdMDnhYGX7AXVHGflrwNQH qFy+aenWXsC0ZvrikFxbQnX8GVtDADtVznxOi7XzFw7JOxdsVrpXgSN0eh0aMzvV zKPZsZ2miVGclicJHzm5q080b1p/sZtuKIEZk6vZqEg= -----END CERTIFICATE----- s; ^-----BEGIN CERTIFICATE-----\n.+?-----END CERTIFICATE-----$)�flagsc @ s e Zd ZdZdS )�ConnectionErrorz Failed to connect to the serverN�rX rY rZ r[ r( r( r( r) r� � s r� c @ s e Zd ZdZdS )� ProxyErrorz%Failure to connect because of a proxyNr� r( r( r( r) r� � s r� c @ s e Zd ZdZdS )�SSLValidationErrorz0Failure to connect due to SSL validation failingNr� r( r( r( r) r� s r� c @ s e Zd ZdZdS )� NoSSLErrorzXNeeded to connect to an HTTPS url but no ssl library available to verify the certificateNr� r( r( r( r) r� s r� c s" e Zd ZdZd� fdd� Z� ZS )�MissingModuleErrorz8Failed to import 3rd party module required by the callerNc s t t| ��|� || _|| _d S r# )�superr� r* �import_traceback�module)r' �messager� r� �� __class__r( r) r* s zMissingModuleError.__init__)N)rX rY rZ r[ r* � __classcell__r( r( r� r) r� s r� �HTTPSConnection� HTTPSHandlerc @ s e Zd Zdd� Zdd� ZdS )�CustomHTTPSConnectionc O sd t jj| g|�R i |�� d | _tr.| j| _ntrBtt� | _| _| jr`| j r`| j� | j | j � d S r# ) �httplibr� r* �context�HAS_SSLCONTEXTr& � HAS_URLLIB3_PYOPENSSLCONTEXTr �PROTOCOL� cert_fileZload_cert_chain�key_file�r' �args�kwargsr( r( r) r* s z CustomHTTPSConnection.__init__c C s� t | d�r&t�| j| jf| j| j�}nt�| j| jf| j�}| j}| jr\|| _| � � | j}t sdt rx| j j ||d�| _n:tr�t|| jtj| jt|d�| _ntj || j| jtd�| _dS )z(Connect to a host on a given (SSL) port.�source_address��server_hostname)�keyfile� cert_reqs�certfile� ssl_versionr� )r� r� r� N)rD rn �create_connection�host�port�timeoutr� Z _tunnel_host�sockZ_tunnelr� r� r� � wrap_socket�HAS_URLLIB3_SSL_WRAP_SOCKETr r� r � CERT_NONEr� r� )r' r� r� r( r( r) �connect$ s � z CustomHTTPSConnection.connectN)rX rY rZ r* r� r( r( r( r) r� s r� c @ s e Zd Zdd� ZejZdS )�CustomHTTPSHandlerc C s, i }t r| j|d< | �tjtfi |��|�S )Nr� )r� r& �do_open� functools�partialr� )r' rP r� r( r( r) � https_open> s ���z CustomHTTPSHandler.https_openN)rX rY rZ r� r Z do_request_� https_requestr( r( r( r) r� < s r� c @ s* e Zd ZdZd dd�Zdd� Zdd� ZdS ) �HTTPSClientAuthHandlerz�Handles client authentication via cert/key This is a fairly lightweight extension on HTTPSHandler, and can be used in place of HTTPSHandler Nc K s* t jj| fi |�� || _|| _|| _d S r# )�urllib_requestr� r* � client_cert� client_key� _unix_socket)r' r� r� � unix_socketr� r( r( r) r* S s z HTTPSClientAuthHandler.__init__c C s | � | j|�S r# )r� �_build_https_connection�r' rP r( r( r) r� Y s z!HTTPSClientAuthHandler.https_openc K sx |� | j| jd�� z| j|d< W n ty4 Y n0 | jrRt| j�|fi |��S tsft|fi |��S t j |fi |��S )N)r� r� r� ) �updater� r� r& rr r� �UnixHTTPSConnectionr� r� r� r� )r' r� r� r( r( r) r� \ s � z.HTTPSClientAuthHandler._build_https_connection)NNN)rX rY rZ r[ r* r� r� r( r( r( r) r� L s r� c c s$ t jj} tjt j_dV | t j_dS )z�Monkey patch ``httplib.HTTPConnection.connect`` to be ``UnixHTTPConnection.connect`` so that when calling ``super(UnixHTTPSConnection, self).connect()`` we get the correct behavior of creating self.sock for the unix socket N)r� �HTTPConnectionr� �UnixHTTPConnection)Z_connectr( r( r) �(unix_socket_patch_httpconnection_connectk s r� c s, e Zd Zdd� Z� fdd�Zdd� Z� ZS )r� c C s || _ d S r# �r� �r' r� r( r( r) r* w s z UnixHTTPSConnection.__init__c s8 t � � tt| ��� W d � n1 s*0 Y d S r# )r� r� r� r� �r' r� r( r) r� z s zUnixHTTPSConnection.connectc O s t jj| g|�R i |�� | S r# )r� r� r* r� r( r( r) �__call__� s z UnixHTTPSConnection.__call__)rX rY rZ r* r� r� r� r( r( r� r) r� v s r� c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) r� z+Handles http requests to a unix socket filec C s || _ d S r# r� r� r( r( r) r* � s zUnixHTTPConnection.__init__c C sz t � t jt j�| _z| j�| j� W n6 tyZ } z td| j|f ��W Y d }~n d }~0 0 | jt jurv| j� | j� d S )Nz Invalid Socket File (%s): %s) rn ZAF_UNIXZ SOCK_STREAMr� r� r� ro r� Z_GLOBAL_DEFAULT_TIMEOUTZ settimeout)r' �er( r( r) r� � s ( zUnixHTTPConnection.connectc O s t jj| g|�R i |�� | S r# )r� r� r* r� r( r( r) r� � s zUnixHTTPConnection.__call__N)rX rY rZ r[ r* r� r� r( r( r( r) r� � s r� c @ s e Zd ZdZdd� Zdd� ZdS )�UnixHTTPHandlerzHandler for Unix urlsc K s t jj| fi |�� || _d S r# )r� � HTTPHandlerr* r� )r' r� r� r( r( r) r* � s zUnixHTTPHandler.__init__c C s | � t| j�|�S r# )r� r� r� r� r( r( r) � http_open� s zUnixHTTPHandler.http_openN)rX rY rZ r[ r* r� r( r( r( r) r� � s r� c s( e Zd ZdZ� fdd�Zdd� Z� ZS )�ParseResultDottedDictzO A dict that acts similarly to the ParseResult named tuple from urllib c s t t| �j|i |�� | | _d S r# )r� r� r* �__dict__r� r� r( r) r* � s z ParseResultDottedDict.__init__c s � fdd�dD �S )z] Generate a list from this dict, that looks like the ParseResult named tuple c s g | ]}� � |d ��qS r# )r0 )�.0�kr� r( r) � <listcomp>� � z1ParseResultDottedDict.as_list.<locals>.<listcomp>)�scheme�netloc�path�params�query�fragmentr( r� r( r� r) �as_list� s z ParseResultDottedDict.as_list)rX rY rZ r[ r* r� r� r( r( r� r) r� � s r� c C sD t � }t| d��r"| j|d< | j|d< | j|d< | j|d< | j|d< | j|d< | j|d< | j |d< | j }|r�|d d kr�d | jv r�d | jv r�| j� d �d d d � � � }||d< z | j }W nZ t�y | j� d�d � d �d }d|v �r |� d�d }|�rt|�}nd }Y n0 ||d< �n | d |d< | d |d< | d |d< | d |d< | d |d< | d |d< z�t�d�}|�| d �}|�d �}|�d�}|�d�}|�r�t|d d � �}|�r�|d d� }|� dd �\}} nd }} ||d< | |d< ||d< ||d< W n8 t�y> d |d< d |d< | d |d< d |d< Y n0 |S )z� Returns a dictionary of url parts as parsed by urlparse, but accounts for the fact that older versions of that library do not support named attributes (ie. .netloc) r� r� r� r� r� r� r$ r% r �[�]r, Nr< �@����:r� r- ri � � z1^((?:\w)+(?::(?:\w)+)?@)?([A-Za-z0-9.-]+)(:\d+)?$)r� rD r� r� r� r� r� r� r$ r% r< �splitrc r� rk �intr\ r] �matchr1 � Exception) �partsZ generic_partsr< r� r� Z netloc_rer� Zauthr$ r% r( r( r) r? � sh $ r? c c s t �| �D ]}|�d�V q d S )Nr )� b_PEM_CERT_RE�finditerr1 )�b_datar� r( r( r) �extract_pem_certs s r� c C sJ | � � }t|�d }tj�|�d��p(d }|r6t|�}| jjddd�pH|S )Nr- �/�filenamezcontent-disposition��header) �geturlr �osr� �basenameru r r3 � get_param)�response�urlr� r� r( r( r) �get_response_filename s r� c C sj t r| jj}| jj}n| jj}| jj}|� p.d�d�d }|�d�\}}|d�pRd�d�d }||||fS )N�application/octet-stream�,r r� �charsetzutf-8)r r3 ZgettypeZgetparamZget_content_typer� r� )r� Zget_typer� Z content_type� main_type�sub_typer� r( r( r) �parse_content_type s r� c @ s, e Zd ZdZdd� Zdd� Zedd� �ZdS ) �GzipDecodedReaderz�A file-like object to decode a response encoded with the gzip method, as described in RFC 1952. Largely copied from ``xmlrpclib``/``xmlrpc.client`` c C s| t st| �� td��tr || _nDt�� | _tt � |j d�d�D ]}| j� |� q>| j� d� |�� tjj| d| jd� d S )N�r� � r� r �rb)�modeZfileobj)�HAS_GZIPr� �missing_gzip_error� GZIP_IMP_ERRr �_io�io�BytesIO�iterr� r� �read�write�seek�close�gzip�GzipFiler* )r' rQ �blockr( r( r) r* % s zGzipDecodedReader.__init__c C s, zt j�| � W | j�� n | j�� 0 d S r# )r r r r� r� r( r( r) r 5 s zGzipDecodedReader.closec C s t ddd�S )Nr zito decompress gzip encoded responses. Set "decompress" to False, to prevent attempting auto decompression)�reason)r r( r( r( r) r� ; s �z$GzipDecodedReader.missing_gzip_errorN)rX rY rZ r[ r* r � staticmethodr� r( r( r( r) r� s r� c @ s" e Zd ZdZddd�Zdd� ZdS ) �RequestWithMethodz} Workaround for using DELETE/PUT/etc with urllib2 Originally contained in library/net_infrastructure/dnsmadeeasy NTc C s0 |d u r i }|� � | _tj�| |||||� d S r# )�upper�_methodr� �Requestr* )r' r� �method�datar3 �origin_req_host� unverifiabler( r( r) r* J s zRequestWithMethod.__init__c C s | j r | j S tj�| �S d S r# )r r� r � get_methodr� r( r( r) r P s z RequestWithMethod.get_method)NNNT)rX rY rZ r[ r* r r( r( r( r) r D s r c s G � ���fdd�dt j�}|S )a This is a class factory that closes over the value of ``follow_redirects`` so that the RedirectHandler class has access to that value without having to use globals, and potentially cause problems where ``open_url`` or ``fetch_url`` are used multiple times in a module. c s" e Zd ZdZ� ���fdd�ZdS )z/RedirectHandlerFactory.<locals>.RedirectHandlera This is an implementation of a RedirectHandler to match the functionality provided by httplib2. It will utilize the value of ``follow_redirects`` that is passed into ``RedirectHandlerFactory`` to determine how redirects should be handled in urllib2. c s� t ttf�s,t|�� �d�}|r,tj�|� �dkrLtj�| ||||||�S �dv rft � |||||��|� � }�dv r�|dk s�|dkr�t � |� � ||||��nN�dkr�|dk s�|dks�|dvr�t � |� � ||||��nt � |� � ||||��z|� � } |�� } W n t�y |j} |j} Y n0 |�d d �}|d v �r@|j} ndd } td d � |j�� D ��} |dk�rt|dk�rtd}|dk�r�|dk�r�d}|dk�r�|dk�r�d}t||| | | dd�S )N��ca_path�ciphers�urllib2)�noZnoneF)�allZyesTi, i� �safe)�GET�HEAD� z%20)i3 i4 c s s& | ] \}}|� � d vr||fV qdS ))zcontent-length� content-typeztransfer-encodingN�rc �r� r� �vr( r( r) � <genexpr>� s �zSRedirectHandlerFactory.<locals>.RedirectHandler.redirect_request.<locals>.<genexpr>i/ r r i. i- �POSTT)r r3 r r r )�anyr� r� �maybe_add_ssl_handlerr� �_openerZ add_handler�HTTPRedirectHandler�redirect_request� urllib_error� HTTPErrorr r@ �get_dataZget_origin_req_hostrr r r �replacer3 �dict�itemsr ) r' rP rQ rR rS ZhdrsZnewurlZhandlerr r r r3 �r r �follow_redirects�validate_certsr( r) r' e sP �z@RedirectHandlerFactory.<locals>.RedirectHandler.redirect_requestN)rX rY rZ r[ r' r( r. r( r) �RedirectHandler^ s r1 )r� r& )r/ r0 r r r1 r( r. r) �RedirectHandlerFactoryW s Lr2 c C s� dg}t sP|�d� |�dtjd�tj�� �f � tsFtsF|�d� |�d� |�d� |rp|�dt |� � t d �|�| |d �|�f ��d S ) z_Inteligently build out the SSLValidationError based on what support you have installed zwFailed to validate the SSL certificate for %s:%s. Make sure your managed systems have a valid CA certificate installed.zXIf the website serving the url uses SNI you need python >= 2.7.9 on your managed machinez1 (the python executable used (%s) is version: %s)r+ z]or you can install the `urllib3`, `pyOpenSSL`, `ndg-httpsclient`, and `pyasn1` python modulesz-to perform SNI verification in python >= 2.6.z�You can use validate_certs=False if you do not need to confirm the servers identity but this is unsafe and not recommended. Paths checked for this platform: %s.zThe exception msg was: %s.r ry N) r� rz rl � executabler| r � splitlinesr� r� r r� )r< r� �paths�excrS r( r( r) �build_ssl_validation_error� s � � r7 c C s2 t j�| �r.zt �| � W n ty, Y n0 d S r# )r� r� �exists�unlinkr� )r� r( r( r) �atexit_remove_file� s r: c C s� |d u r g }t |�s$td|jj ��tr4t| d�}ntrBtt�}nt d��|s�t j rd| j t j O _ | j t j O _ d|_t j|_|r�t| |f�r�|j| |d� |r�|�d�tt|��� |S )Nz Ciphers must be a list. Got %s.)�cafilez<Host libraries are too old to support creating an sslcontextF)r; �cadatar� )r rq r� rX r� r r� r r� rF r Z OP_NO_SSLv2�optionsZ OP_NO_SSLv3Zcheck_hostnamer� Z verify_moder# Zload_verify_locationsZ set_ciphersr| r} r )r; r< r r0 r� r( r( r) � make_context� s( r> c C s t � }g }| r~| g}tt| dd�d��>}trVt|�� �D ] }|�t�t |dd��� q8W d � n1 sj0 Y | ||fS ts�|� d� t t � � dd�}|dkr�|� d� |� d� |� d� nr|d kr�|� d � n^|d kr�|� d � nJ|d k�r|� d� n4|dk�r|� d� n |dk�r6|� d� |� d� |� d� d }t�sbt�� \}}t�t|� |dk�r�t�r�|�t�t tdd��� n t�|t� |� d� |D �]&}tj�|��s��q�t�|�} | D ]�}tj�||�} tj�| ��r�tj�|�d dv �r�z�| t v�r�t| d��} | �� } W d � n1 �s80 Y t�r�z,t| �D ] }|�t�t |dd��� �qRW n t �y� Y W �q�Y n0 nt�|| � t�|d� W n t t f�y� Y n0 �q̐q�t�r�t� � } | j!g|d d�< n t�"|� |||fS )Nr6 r7 r� z/etc/ssl/certsZLinuxz /etc/pki/ca-trust/extracted/pemz/etc/pki/tls/certsz%/usr/share/ca-certificates/cacert.orgZFreeBSDz/usr/local/share/certsZOpenBSDz/etc/sslZNetBSDz/etc/openssl/certsZSunOSz /opt/local/etc/openssl/certsZAIXz/var/ssl/certsz/opt/freeware/etc/ssl/certsz /etc/ansibler; z/usr/local/etc/opensslr, )z.crtz.pem� r )#� bytearrayrO r r� r� r �extendr ZPEM_cert_to_DER_certr rz r rH rI �tempfileZmkstemp�atexit�registerr: �b_DUMMY_CA_CERTr� r r� �isdir�listdirr| �isfile�splitext�LOADED_VERIFY_LOCATIONSr� ro �IOErrorZget_default_verify_pathsZcapathr )r; r< � paths_checked�fZb_pemrI Ztmp_pathZtmp_fdr� Z dir_contents� full_pathr� Zb_certZdefault_verify_pathsr( r( r) � get_ca_certs� s� ��$ �� $ ( �� rO c @ sN e Zd ZdZdZddd�Zdd� Zdd d �Zd d � Zdd d�Z dd� Z e Z dS )�SSLValidationHandlerz� A custom handler class for SSL validation. Based on: http://stackoverflow.com/questions/1087227/validate-ssl-certificates-with-python http://techknack.net/python-urllib2-handlers/ zCONNECT %s:%s HTTP/1.0 NTc C s" || _ || _|| _|| _|| _d S r# )r< r� r r r0 )r' r< r� r r r0 r( r( r) r* e s z SSLValidationHandler.__init__c C s t | j�S r# )rO r r� r( r( r) rO l s z!SSLValidationHandler.get_ca_certsc C s\ |du rdgn|}z*t �d|��� \}}}t|�|vr:t�W n tyV td��Y n0 dS )zC make sure we get back a valid code from the proxy N�� s (HTTP/\d\.\d) (\d\d\d) (.*)zConnection to proxy failed)r\ r� �groupsr� r� r� )r' r� Z valid_codesZ http_versionZ resp_coderS r( r( r) �validate_proxy_responseo s z,SSLValidationHandler.validate_proxy_responsec C sV t j�d�}|rR|�d�}t|�j}|D ](}|�|�sJ|�d�d �|�r( dS q(dS )za Detect if the 'no_proxy' environment variable is set and honor those locations. Zno_proxyr� r� r FT)r� �environr0 r� r r� �endswith)r' r� Z env_no_proxyr� r� r( r( r) �detect_no_proxy| s z$SSLValidationHandler.detect_no_proxyc C s. | j p|}| j rd }n|p d }t||||d�S )N�r; r< r r0 )r r> )r' r; r< r r0 r( r( r) r> � s z!SSLValidationHandler.make_contextc C s� | � � \}}}| �|�� �}tj�d�}d }z| j||| j| jd�}W n t yX Y n0 �z|�r�|�r�t t |��}|�d�p�d} |�dd �} | d u s�|�d�dkr�t d��t �| | f�} |�d�d k�r�| �t| j| j| jf d d �� |�d ��r4d |�d d�|�dd�f } | �dt�t| d d ���� � | �d� d} | �d�dk�rz| | �d�7 } t| �dk�rBt d���qB| �| � |�r�|j| | jd�}nBt �r�t | |t j t | jd�}n$t j| |t j t d�}t!|�"� | j� nt d|�d� ��nlt �| j| jf�} |�r |j| | jd�}nBt �r<t | |t j t | jd�}n$t j| |t j t d�}t!|�"� | j� | �#� W n~ t j$t%f�y� } z t&| j| j||� W Y d }~nJd }~0 t j'�y� } z&t(d| j| jt)|�f ��W Y d }~n d }~0 0 |S ) N� https_proxy)r r0 r� � r< r� r+ z�Failed to parse https_proxy environment variable. Please make sure you export https proxy as 'https_proxy=<SCHEME>://<IP_ADDRESS>:<PORT>'�httpr6 r7 r$ �%s:%sr% s Proxy-Authorization: Basic %s s r� � r i i z4Proxy sent too verbose headers. Only 128KiB allowed.r� )�ca_certsr� r� r� )r] r� r� zKUnsupported proxy scheme: %s. Currently ansible only supports HTTP proxies.z&Failed to connect to %s at port %s: %s)*rO rV r@ r� rT r0 r> r r0 rF r? r r� rn r� Zsendallr �CONNECT_COMMANDr< r� r2 rL �strip�findZrecvr{ rS r� r� r r Z CERT_REQUIREDr� r rG r ZSSLErrorr r7 rp r� r )r' rP Ztmp_ca_cert_pathr< rL � use_proxyrX r� Z proxy_partsr� Zproxy_hostname�s� credentialsZconnect_resultZssl_sr� r( r( r) � http_request� s` &0z!SSLValidationHandler.http_request)NNT)N)NT) rX rY rZ r[ r^ r* rO rS rV r> rd r� r( r( r( r) rP [ s ArP c C sD t t| ��}|jdkr@|r@ts&td��t|j|jp4d|||d�S d S )N�httpsz�SSL validation is not available in your version of python. You can use validate_certs=False, however this is unsafe and not recommendedrY )r r r0 )r? r r� �HAS_SSLr� rP r< r� )r� r0 r r rT r( r( r) r$ � s r$ c C s@ t r| jjj}n | jjjj}z |�|�W S ty: Y n0 dS )zC Attempt to get the peer certificate of the response from urlopen. N)r rQ rE Z_sockrG rr )r� Z binary_formrn r( r( r) rG � s rG c C sn t sdS t�| t� �}d}z |j}W n ty6 Y n0 |rF|jdv rNt�� }t� |t� �}|� | � |� � S )zM Gets the channel binding app data for a TLS connection using the peer cert. N)Zmd5Zsha1) �HAS_CRYPTOGRAPHYr Zload_der_x509_certificater Zsignature_hash_algorithmr! r: r ZSHA256ZHashr� �finalize)Zcertificate_derrU Zhash_algorithmZdigestr( r( r) rJ � s rJ �-0000c C sH dg d�| d | d g d�| d d | d | d | d | d |f S ) z�Accepts a timetuple and optional zone which defaults to ``-0000`` and returns a date string as specified by RFC 2822, e.g.: Fri, 09 Nov 2001 01:08:47 -0000 Copied from email.utils.formatdate and modified for separate use z"%s, %02d %s %04d %02d:%02d:%02d %s)ZMonZTueZWedZThuZFriZSatZSun� r- ) ZJanZFebZMarZAprZMayZJunZJulZAugZSepZOctZNovZDecr, r ri r� r� r( )� timetuple�zoner( r( r) �rfc2822_date_string s ��rm c @ sf e Zd Zddd�Zdd � Zdd d �Zd d � Zdd� Zdd� Zd dd�Z d dd�Z d dd�Z dd� Z dS ) r NTF� r c C s� |pi | _ t| j t�s$td| j ��|| _|| _|| _|| _|| _|| _ || _ | | _ | | _ | | _ | | _|| _|| _|| _|| _|| _|| _t| tj�r�| | _n t�� | _dS )a; This class works somewhat similarly to the ``Session`` class of from requests by defining a cookiejar that an be used across requests as well as cascaded defaults that can apply to repeated requests For documentation of params, see ``Request.open`` >>> from ansible.module_utils.urls import Request >>> r = Request() >>> r.open('GET', 'http://httpbin.org/cookies/set?k1=v1').read() '{ "cookies": { "k1": "v1" } } ' >>> r = Request(url_username='user', url_password='passwd') >>> r.open('GET', 'http://httpbin.org/basic-auth/user/passwd').read() '{ "authenticated": true, "user": "user" } ' >>> r = Request(headers=dict(foo='bar')) >>> r.open('GET', 'http://httpbin.org/get', headers=dict(baz='qux')).read() zheaders must be a dict: %rN)r3 � isinstancer, rk ra �forcer� r0 � url_username� url_password� http_agent�force_basic_authr/ r� r� r� r �unredirected_headers� decompressr � use_netrc� cookiejar� CookieJar�cookies)r' r3 ra rp r� r0 rq rr rs rt r/ r� r� rz r� r ru rv r rw r( r( r) r* s. zRequest.__init__c C s |d u r |S |S r# r( )r' r �fallbackr( r( r) � _fallbackJ s zRequest._fallbackc 4 C s� |� � }|du ri }nt|t�s(td��t| jfi |��}| �|| j�}| �|| j�}| �|| j�}| �| | j �} | �| | j �} | �| | j �} | �| | j �} | �| | j �} | �|| j�}| �|| j�}| �|| j�}| �|| j�}| �|| j�}| �|| j�}| �|| j�}| �|| j�}| �|| j�}| �|| j�}g }|�rN|�t|�� tt|��}|j dk�r�| }| } |�r||j } nZd|j v �r�|j � dd�\} } d| v �r�| � dd�\}} n| }d} |� � } | | d< t | �}|�rt!�r�|�t!|| �� nt"dd d d �} t#| t$d ��n�|�r^| �s^t%�&� }!|!�'d| || � t%�(|!�}"t%�)|!�}#|�|"� |�|#� n�|�rz| �rzt*|| �|d < nl|�r�z"t+�+t,j-�.d��}$|$�/|j0�}%W n t1�y� d}%Y n0 |%�r�|%\}}&} |�r�| �r�t*|| �|d < |�s t%�2i �}'|�|'� t3t4t5f��s0t6|| ||d�}(|(�rd|�|(� n4t7|�\})}*}+t8|)|*|| d�},|�t9||||,d�� |�t:|| ||d�� |du�r�|�t%�;|�� t%j<|� }-t%�=|-� t>|dd�}t?|||�}.| �r�|.�@d| � |�r�|.�@dd� n |�rtA|�B� d�}/|.�@d|/� dd� |�pg D �}|D ]6}0|0�C� |v �rB|.�D|0||0 � n|.�@|0||0 � �q t%�E|.d|�}1|�r�|1j�.dd��C� d k�r�tF|1jG�}2tH�r�|2|1_Gd|1_In(|1jJ}3t%�K|2|1�L� |1�M� |1�N� �}1|3|1_J|1S ) a Sends a request via HTTP(S) or FTP using urllib2 (Python2) or urllib (Python3) Does not require the module environment Returns :class:`HTTPResponse` object. :arg method: method for the request :arg url: URL to request :kwarg data: (optional) bytes, or file-like object to send in the body of the request :kwarg headers: (optional) Dictionary of HTTP Headers to send with the request :kwarg use_proxy: (optional) Boolean of whether or not to use proxy :kwarg force: (optional) Boolean of whether or not to set `cache-control: no-cache` header :kwarg last_mod_time: (optional) Datetime object to use when setting If-Modified-Since header :kwarg timeout: (optional) How long to wait for the server to send data before giving up, as a float :kwarg validate_certs: (optional) Booleani that controls whether we verify the server's TLS certificate :kwarg url_username: (optional) String of the user to use when authenticating :kwarg url_password: (optional) String of the password to use when authenticating :kwarg http_agent: (optional) String of the User-Agent to use in the request :kwarg force_basic_auth: (optional) Boolean determining if auth header should be sent in the initial request :kwarg follow_redirects: (optional) String of urllib2, all/yes, safe, none to determine how redirects are followed, see RedirectHandlerFactory for more information :kwarg client_cert: (optional) PEM formatted certificate chain file to be used for SSL client authentication. This file can also include the key as well, and if the key is included, client_key is not required :kwarg client_key: (optional) PEM formatted file that contains your private key to be used for SSL client authentication. If client_cert contains both the certificate and key, this option is not required :kwarg cookies: (optional) CookieJar object to send with the request :kwarg use_gssapi: (optional) Use GSSAPI handler of requests. :kwarg unix_socket: (optional) String of file system path to unix socket file to use when establishing connection to the provided url :kwarg ca_path: (optional) String of file system path to CA cert bundle to use :kwarg unredirected_headers: (optional) A list of headers to not attach on a redirected request :kwarg decompress: (optional) Whether to attempt to decompress gzip content-encoded responses :kwarg ciphers: (optional) List of ciphers to use :kwarg use_netrc: (optional) Boolean determining whether to use credentials from ~/.netrc file :returns: HTTPResponse. Added in Ansible 2.9 Nzheaders must be a dict�ftpr� r, r� r+ rA zfor use_gssapi=Truez https://pypi.org/project/gssapi/)r r� r� r> ZNETRCr rW )r� r� r� r� Zpassthru)Z nonstringz User-agentz cache-controlzno-cacheZGMTzIf-Modified-Sincec S s g | ] }|� � �qS r( r )r� �hr( r( r) r� r� z Request.open.<locals>.<listcomp>zcontent-encodingr )Or ro r, rk r3 r| ra rp r� r0 rq rr rs rt r/ r� r� rz r� r ru rv r rw rz r� r? r r� r� r� r� r r" r r� �GSSAPI_IMP_ERRr� Z HTTPPasswordMgrWithDefaultRealmZ add_passwordZHTTPBasicAuthHandlerZHTTPDigestAuthHandler�basic_auth_header�netrcr� rT r0 Zauthenticatorsr< rK Z ProxyHandlerr# r� r� r$ rO r> r� r2 ZHTTPCookieProcessorZ build_openerZinstall_openerr r � add_headerrm rk rc rM Zurlopenr� rQ r �lengthrS Z addinfourl�infor� Zgetcode)4r' r r� r r3 ra rp � last_mod_timer� r0 rq rr rs rt r/ r� r� rz � use_gssapir� r ru rv r rw �handlersrT r$ r% r� rc Z parsed_listZ imp_err_msgZpassmanZ authhandlerZdigest_authhandler�rcZlogin�_Z proxyhandlerZ ssl_handlerZ tmp_ca_pathr< rL r� �opener�requestZtstampr� �rrQ rS r( r( r) rO O s� 3 � �� �z Request.openc K s | j d|fi |��S )z�Sends a GET request. Returns :class:`HTTPResponse` object. :arg url: URL to request :kwarg \*\*kwargs: Optional arguments that ``open`` takes. :returns: HTTPResponse r �rO �r' r� r� r( r( r) r0 * s z Request.getc K s | j d|fi |��S )z�Sends a OPTIONS request. Returns :class:`HTTPResponse` object. :arg url: URL to request :kwarg \*\*kwargs: Optional arguments that ``open`` takes. :returns: HTTPResponse ZOPTIONSr� r� r( r( r) r= 4 s zRequest.optionsc K s | j d|fi |��S )z�Sends a HEAD request. Returns :class:`HTTPResponse` object. :arg url: URL to request :kwarg \*\*kwargs: Optional arguments that ``open`` takes. :returns: HTTPResponse r r� r� r( r( r) �head> s z Request.headc K s | j d|fd|i|��S )a( Sends a POST request. Returns :class:`HTTPResponse` object. :arg url: URL to request. :kwarg data: (optional) bytes, or file-like object to send in the body of the request. :kwarg \*\*kwargs: Optional arguments that ``open`` takes. :returns: HTTPResponse r" r r� �r' r� r r� r( r( r) �postH s z Request.postc K s | j d|fd|i|��S )a' Sends a PUT request. Returns :class:`HTTPResponse` object. :arg url: URL to request. :kwarg data: (optional) bytes, or file-like object to send in the body of the request. :kwarg \*\*kwargs: Optional arguments that ``open`` takes. :returns: HTTPResponse ZPUTr r� r� r( r( r) �putS s z Request.putc K s | j d|fd|i|��S )a) Sends a PATCH request. Returns :class:`HTTPResponse` object. :arg url: URL to request. :kwarg data: (optional) bytes, or file-like object to send in the body of the request. :kwarg \*\*kwargs: Optional arguments that ``open`` takes. :returns: HTTPResponse ZPATCHr r� r� r( r( r) �patch^ s z Request.patchc K s | j d|fi |��S )z�Sends a DELETE request. Returns :class:`HTTPResponse` object. :arg url: URL to request :kwargs \*\*kwargs: Optional arguments that ``open`` takes. :returns: HTTPResponse ZDELETEr� r� r( r( r) �deletei s zRequest.delete)NTFrn TNNNFr NNNNNNTNT)NNNNNNNNNNNNNNNFNNNNNN)N)N)N) rX rY rZ r* r| rO r0 r= r� r� r� r� r� r( r( r( r) r s, � / � \ r rn r c C sL |p|r dnd}t � j|| |||||||| | | | | ||||||||||d�S )z� Sends a request via HTTP(S) or FTP using urllib2 (Python2) or urllib (Python3) Does not require the module environment r" r )r r3 ra rp r� r� r0 rq rr rs rt r/ r� r� rz r� r� r ru rv r rw )r rO )r� r r3 r ra rp r� r� r0 rq rr rs rt r/ r� r� rz r� r� r ru rv r rw r( r( r) �open_urlt s �r� c C sZ t | t�std| jj ��tjj�d�}t | � � �D �]�\}}t |t �rZd}d}|}d}n�t |t�r�|� d�}|� d�}t ||f�s�td��|� d �}|s�z tj|p�d d d �d p�d}W n ty� d}Y n0 |�d�\}} }ntd|jj ��|�s`|�r`tt|dd�d��<} tjj�| �� �} | d= | �dd||f � W d � n1 �sT0 Y n tjj�||�} | �t|�� | �dd� | d= | j d|dd� |�r�| j dt t j � |��dd� |�!| � q4t"�r�|j#tj$j%d�} n0t&� } tj'j(| d d�}|�)|� tj*�+| �,� �} ~| �d �\}} }~ t"�r>tj-�.� j/}n tj-�0� j1}||�d |fS ) aA Takes a mapping, and prepares a multipart/form-data body :arg fields: Mapping :returns: tuple of (content_type, body) where ``content_type`` is the ``multipart/form-data`` ``Content-Type`` header including ``boundary`` and ``body`` is the prepared bytestring body Payload content from a file will be base64 encoded and will include the appropriate ``Content-Transfer-Encoding`` and ``Content-Type`` headers. Example: { "file1": { "filename": "/bin/true", "mime_type": "application/octet-stream" }, "file2": { "content": "text based file content", "filename": "fake.txt", "mime_type": "text/plain", }, "text_form_field": "value" } z&Mapping is required, cannot be type %sz form-data�textZplainNr� �contentz4at least one of filename or content must be providedZ mime_typer+ F)rh r r� r� z5value must be a string, or mapping, cannot be type %sr6 r7 r� z Content-Typez%s/%szContent-Dispositionz MIME-Versionr: r� )�policy)Z maxheaderlenr\ r )2ro r rq r� rX �email�mimeZ multipartZ MIMEMultipart�sortedr- r r0 r# rk � mimetypesZ guess_typer� re rO r Z applicationZMIMEApplicationr r� Z nonmultipartZMIMENonMultipartZ set_payloadZ set_paramr r� r� r� Zattachr Zas_bytesr� ZHTTPr � generator� GeneratorZflattenZutilsZfix_eols�getvalue�parserZBytesHeaderParserZ parsebytesZ HeaderParserZparsestr)�fields�mZfieldr r� r� r� r� r� rf rM �partr� rQ �gr3 Z b_contentr� r( r( r) �prepare_multipart� s| � � 6 �� �r� c C s* |du r d}dt �td| |f dd�� S )z�Takes a username and password and returns a byte string suitable for using as value of an Authorization header to do basic auth. Nr+ s Basic %sr[ r6 r7 )r2 rL r )r$ r% r( r( r) r� s r� c C sn t t dd�t ddd�t ddd�t ddd�t ddd�t dd�t ddd�t ddd�t d d�t d d�t ddd�d � S ) zz Creates an argument spec that can be used with any module that will be requesting content via urllib/urllib2 �str)�type�boolF)r� �default�ansible-httpgetT)r� Zno_logr� ) r� rp rs ra r0 rq rr rt r� r� r� )r, r( r( r( r) �url_argument_spec s �r� c & C s t s| jdd� ts6|du r6d}| jdt�� dd� tj}| jt_| j � dd�}|d u rh| j � d d�}| j � d d �}| j � d d �}| j � dd�}| j � dd �}| j � dd�}| j � d�}| j � d�}| j � d| �} t | t j �s�t �� } d }t|dd�}�z�z6t||||||||||||||||| | | | | |||d�}|�tdd� |�� �� D ��� t�r�i } |j�� D ]<\} } | �� } | | v �r�d�| | | f�| | < n| | | < �ql|�| � g } t� } | D ]$}!|!j| |!j< | �|!j|!jf� �q�d �d d� | D ��|d < | |d < |�td |j� d!d"� |�� |j d#�� W �n� t �y� }" zft � }#|#d u�r�|#�� d$k�r�| jf d%d&t |"� i|�� n | jf d%d't |"� i|�� W Y d }"~"�nZd }"~"0 t t!f�y� }" z&| jf d%t |"�i|�� W Y d }"~"�nd }"~"0 t"�y0 }" z"| jt#|"�|"j$d(� W Y d }"~"�n�d }"~"0 t%j&�y� }" z�|"}z |"j'd u �rXt(�|"�)� }$W n t(�yz d }$Y n 0 |"�*� z$|�td)d� |"�� �� D ��� W n t+�y� Y n0 |�t |"�|$|"j d*�� W Y d }"~"�n"d }"~"0 t%j,�y< }" z6t-t.|"d+d��}%|�td,t |"� |%d-�� W Y d }"~"n�d }"~"0 t/j0�y| }" z&|�td.t |"� dd-�� W Y d }"~"n�d }"~"0 t1j2�y� }" z(|�td/t |"j3� dd-�� W Y d }"~"nPd }"~"0 t+�y }" z.|jtd0t |"� dd-�t4�5� d1� W Y d }"~"n d }"~"0 0 W |t_n|t_0 ||fS )2a� Sends a request via HTTP(S) or FTP (needs the module as parameter) :arg module: The AnsibleModule (used to get username, password etc. (s.b.). :arg url: The url to use. :kwarg data: The data to be sent (in case of POST/PUT). :kwarg headers: A dict with the request headers. :kwarg method: "POST", "PUT", etc. :kwarg use_proxy: (optional) whether or not to use proxy (Default: True) :kwarg boolean force: If True: Do not get a cached copy (Default: False) :kwarg last_mod_time: Default: None :kwarg int timeout: Default: 10 :kwarg boolean use_gssapi: Default: False :kwarg unix_socket: (optional) String of file system path to unix socket file to use when establishing connection to the provided url :kwarg ca_path: (optional) String of file system path to CA cert bundle to use :kwarg cookies: (optional) CookieJar object to send with the request :kwarg unredirected_headers: (optional) A list of headers to not attach on a redirected request :kwarg decompress: (optional) Whether to attempt to decompress gzip content-encoded responses :kwarg cipher: (optional) List of ciphers to use :kwarg boolean use_netrc: (optional) If False: Ignores login and password in ~/.netrc file (Default: True) :returns: A tuple of (**response**, **info**). Use ``response.read()`` to read the data. The **info** contains the 'status' and other meta data. When a HttpError (status >= 400) occurred then ``info['body']`` contains the error response data:: Example:: data={...} resp, info = fetch_url(module, "http://example.com", data=module.jsonify(data), headers={'Content-type': 'application/json'}, method="POST") status_code = info["status"] body = resp.read() if status_code >= 400 : body = info['body'] zurlparse is not installed�rS TFzE%s. "decompress" has been automatically disabled to prevent a failurez2.16)r r0 Nra rq r+ rr rs r� rt r/ r r� r� r� r� )r� �status)r r3 r ra rp r� r� r0 rq rr rs rt r/ r� r� rz r� r� r ru rv r rw c s s | ]\}}|� � |fV qd S r# r r r( r( r) r! w r� z fetch_url.<locals>.<genexpr>ry z; c s s | ]}d | V qdS )z%s=%sNr( )r� �cr( r( r) r! � r� Zcookies_stringrz z OK (%s bytes)zContent-Length�unknown)rS r� r� ZredhatrS z-%s. You can also install python-ssl from EPELz%s)rS � exceptionc s s | ]\}}|� � |fV qd S r# r r r( r( r) r! � r� )rS �bodyr� rR zRequest failed: %s)rS r� zConnection failure: %szRConnection failure: connection was closed before a valid response was received: %sz An unknown error occurred: %s)r� )6� HAS_URLPARSE� fail_jsonr� Z deprecater� r� rB Ztempdir�tmpdirr� r0 ro rx ry Z LWPCookieJarr, r� r� r� r- r r3 rc r| r r: rz r� rR r� r r r� rk r� r r� r( r) rQ rr r r r� ZURLErrorr� �getattrrn rp r� Z BadStatusLine�line� traceback� format_exc)&r� r� r r3 r ra rp r� r� r� r� r rz ru rv r rw Z old_tempdirr0 r$ r% rs rt r/ r� r� r� r� Z temp_headersr: r Z cookie_listZ cookie_dictZcookier� Z distributionr� rR r( r( r) � fetch_url s� , � � . 2.* $...0� r� c C s4 | � d�rg S | �d�} dd� | �d�dd� D �S )z1A list of the final component's suffixes, if any.ra c S s g | ] }d | �qS )ra r( )r� rb r( r( r) r� � r� z _suffixes.<locals>.<listcomp>r, N)rU �lstripr� )r: r( r( r) � _suffixes� s r� ri r� r- c C sj d}t tt| ���D ]L\}}||kr( qb|t|� kr@|kr\n nd||f }| �|�} q qbq| |fS )a� Split a multi-part extension from a file name. Returns '([name minus extension], extension)'. Define the valid extension length (including the '.') with 'min' and 'max', 'count' sets the number of extensions, counting from the end, to evaluate. Evaluation stops on the first file extension that is outside the min and max range. If no valid extensions are found, the original ``name`` is returned and ``extension`` is empty. :arg name: File name or path. :kwarg min: Minimum length of a valid file extension. :kwarg max: Maximum length of a valid file extension. :kwarg count: Number of suffixes from the end to evaluate. r+ z%s%s)� enumerate�reversedr� r{ ru )r: �min�maxrb � extension�iZsfxr( r( r) �_split_multiext� s r� c C s� d} t |�} ttj�| j�dd�\}}tj| j||dd�}| �|j � zpt | ||||||||| | | d� \}}|s�| j d||d f d � |� | �}|r�|� |� |� | �}q�|�� W n< ty� } z$| j d|t|�f d � W Y d }~n d }~0 0 |j S ) a� Download and save a file via HTTP(S) or FTP (needs the module as parameter). This is basically a wrapper around fetch_url(). :arg module: The AnsibleModule (used to get username, password etc. (s.b.). :arg url: The url to use. :kwarg data: The data to be sent (in case of POST/PUT). :kwarg headers: A dict with the request headers. :kwarg method: "POST", "PUT", etc. :kwarg boolean use_proxy: Default: True :kwarg boolean force: If True: Do not get a cached copy (Default: False) :kwarg last_mod_time: Default: None :kwarg int timeout: Default: 10 :kwarg unredirected_headers: (optional) A list of headers to not attach on a redirected request :kwarg decompress: (optional) Whether to attempt to decompress gzip content-encoded responses :kwarg ciphers: (optional) List of ciphers to use :returns: A string, the path to the downloaded file. r� r- )rb F)�dir�prefix�suffixr� )ru rv r zFailure downloading %s, %srS r� N)r r� r� r� r� rB ZNamedTemporaryFiler� Zadd_cleanup_filer: r� r� r r r r� r )r� r� r r3 r ra rp r� r� ru rv r �bufsizer� Z file_prefixZfile_extZfetch_temp_fileZrspr� r� r( r( r) � fetch_file� s& � .r� )NTNN)N)NNNT)N)NN)F)ri )NNNTFNrn TNNNFr NNNFNNNTNT)NNNNFNrn FNNNNTNT)ri r� r- ) NNNTFNrn NTN)�r[ Z __future__r r r r� Z __metaclass__rC r2 Zemail.mime.multipartr� Zemail.mime.nonmultipartZemail.mime.applicationZ email.parserZ email.utilsr� r� r� r� r� rH r\ rn rl rB r� �types� contextlibr r r� r� � ImportErrorr� �objectr Z email.policyZemail.generatorr� Z http.clientZclientZ"ansible.module_utils.compat.typingZ module_utils�compat�typing�tZ-ansible.module_utils.six.moves.http_cookiejarZsixZmovesZhttp_cookiejarrx Z+ansible.module_utils.six.moves.urllib.errorZurllibrp r( Z'ansible.module_utils.common.collectionsr r Zansible.module_utils.sixr r r Z ansible.module_utils.six.movesr Zansible.module_utils.basicr r Zansible.module_utils._textr r r Zurllib.requestr� r� r r r r& Zhttp_error_307Zhttp_error_308Z+ansible.module_utils.six.moves.urllib.parser r r r� r� r rf r r r� r� r� Zurllib3.contrib.pyopensslr Z+requests.packages.urllib3.contrib.pyopensslr ZPROTOCOL_TLSv1r� ZctypesZ ctypes.util�utilZ find_libraryZ libssl_nameZCDLLZlibsslr ZPROTOCOL_SSLv23rr Z_BUNDLED_METADATA�setrJ ZHAS_MATCH_HOSTNAMEr r Z backports.ssl_match_hostnamerg Z cryptographyr Z cryptography.hazmat.backendsr Z cryptography.hazmat.primitivesr Zcryptography.exceptionsr! Z urllib_gssapiZ HAS_GSSAPIr rA r" Z_sslr_ rk rg rt rx rE r] �M�Sr� r� r� r� r� r� r� r� r� r� rD r� r� r� r� r� r� r� r, r� r? r� r� r� r� r r r2 r7 r: r> rO rP r$ rG rJ rm r� r� r� r� r� r� r� r� r( r( r( r) �<module> s� $ K 4, ; � # K % V g~ \ � v � ) ! �