a oe@sdZddlZddlZddlmZddlmZmZm Z m Z m Z ddl m Z ddlmZddlmZdd lmZmZdd lmZdd lmZmZmZmZmZmZmZdd lmZ dd lm!Z!m"Z"m#Z#ddl$m%Z%m&Z&m'Z'ddl(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.ddl(mZ/ddl(m0Z0ddl(m Z1ddl(m2Z2ddl3m4Z4ddl5m6Z6ddl7m8Z8ddl9m:Z:m;Z;mZ>m?Z?m@Z@mAZAmBZBmCZCe6jDe6jEe6jFe6jGe6jHfZIdZJdZKdZLGdddZMGdddZNGdd d eNZOGd!d"d"eMeNZPGd#d$d$ZQdS)%z` requests.models ~~~~~~~~~~~~~~~ This module contains the primary objects that power Requests. N)UnsupportedOperation) DecodeErrorLocationParseError ProtocolErrorReadTimeoutErrorSSLError) RequestField)encode_multipart_formdata) parse_url)to_native_stringunicode_is_ascii) HTTPBasicAuth)CallableJSONDecodeErrorMapping basestring builtin_strchardet cookielib)json) urlencodeurlsplit urlunparse)_copy_cookie_jarcookiejar_from_dictget_cookie_header)ChunkedEncodingErrorConnectionErrorContentDecodingError HTTPErrorInvalidJSONError InvalidURL)r) MissingSchema)r)StreamConsumedError) default_hooks)codes)CaseInsensitiveDict) check_header_validityget_auth_from_urlguess_filenameguess_json_utf iter_slicesparse_header_links requote_uristream_decode_response_unicode super_lento_key_val_listi(ic@s0eZdZeddZeddZeddZdS)RequestEncodingMixincCsNg}t|j}|j}|sd}|||j}|rD|d||d|S)zBuild the path URL to use./?)rurlpathappendqueryjoin)selfr7pr8r:r>0C:\Program Files\Certbot\pkgs\requests\models.pypath_urlUs    zRequestEncodingMixin.path_urlcCst|ttfr|St|dr |St|drg}t|D]j\}}t|tsRt|dsX|g}|D]B}|dur\|t|tr|dn|t|tr|dn|fq\q6t|ddS|SdS)zEncode parameters in a piece of data. Will successfully encode parameters when passed as a dict or a list of 2-tuples. Order is retained if data is a list of 2-tuples but arbitrary if parameters are supplied as a dict. read__iter__Nutf-8T)doseq) isinstancestrbyteshasattrr1rr9encoder)dataresultkZvsvr>r>r?_encode_paramsjs$    z#RequestEncodingMixin._encode_paramscCs|stdnt|tr tdg}t|p,i}t|p8i}|D]|\}}t|ts\t|dsb|g}|D]T}|durft|tst|}|t|tr|dn|t|tr| dn|fqfq@|D]\}}d}d} t|t t fr t |dkr|\} } n&t |dkr|\} } }n |\} } }} nt |p,|} |} t| tttfrJ| } n(t| dr`| } n| durnqn| } t|| | | d } | j|d || qt|\}}||fS) aBuild the body for a multipart/form-data request. Will successfully encode files when passed as a dict or a list of tuples. Order is retained if data is a list of tuples but arbitrary if parameters are supplied as a dict. The tuples may be 2-tuples (filename, fileobj), 3-tuples (filename, fileobj, contentype) or 4-tuples (filename, fileobj, contentype, custom_headers). zFiles must be provided.zData must not be a string.rBNrCrA)namerJfilenameheaders) content_type) ValueErrorrErr1rHrGrFr9decoderItuplelistlenr* bytearrayrArZmake_multipartr )filesrJZ new_fieldsfieldsZfieldvalrMrLZftZfhfnfpZfdataZrfbodyrTr>r>r? _encode_filessX                  z"RequestEncodingMixin._encode_filesN)__name__ __module__ __qualname__propertyr@ staticmethodrNrar>r>r>r?r3Ts   r3c@seZdZddZddZdS)RequestHooksMixincCs^||jvrtd|dt|tr6|j||n$t|drZ|j|dd|DdS)zProperly register a hook.z.Unsupported event specified, with event name ""rBcss|]}t|tr|VqdSN)rEr).0hr>r>r? z2RequestHooksMixin.register_hook..N)hooksrUrErr9rHextendr<eventhookr>r>r? register_hooks    zRequestHooksMixin.register_hookcCs0z|j||WdSty*YdS0dS)ziDeregister a previously registered hook. Returns True if the hook existed, False if not. TFN)rnremoverUrpr>r>r?deregister_hooks  z!RequestHooksMixin.deregister_hookN)rbrcrdrsrur>r>r>r?rgs rgc @s*eZdZdZd ddZddZddZdS) Requesta{A user-created :class:`Request ` object. Used to prepare a :class:`PreparedRequest `, which is sent to the server. :param method: HTTP method to use. :param url: URL to send. :param headers: dictionary of headers to send. :param files: dictionary of {filename: fileobject} files to multipart upload. :param data: the body to attach to the request. If a dictionary or list of tuples ``[(key, value)]`` is provided, form-encoding will take place. :param json: json for the body to attach to the request (if files or data is not specified). :param params: URL parameters to append to the URL. If a dictionary or list of tuples ``[(key, value)]`` is provided, form-encoding will take place. :param auth: Auth handler or (user, pass) tuple. :param cookies: dictionary or CookieJar of cookies to attach to this request. :param hooks: dictionary of callback hooks, for internal usage. Usage:: >>> import requests >>> req = requests.Request('GET', 'https://httpbin.org/get') >>> req.prepare() Nc Cs|dur gn|}|durgn|}|dur,in|}|durr>r?__init__s"zRequest.__init__cCsd|jdS)Nz rxr<r>r>r?__repr__%szRequest.__repr__c Cs<t}|j|j|j|j|j|j|j|j|j |j |j d |S)zXConstructs a :class:`PreparedRequest ` for transmission and returns it.) rxr7rSr[rJrryrzr{rn) PreparedRequestpreparerxr7rSr[rJrryrzr{rnr<r=r>r>r?r(s zRequest.prepare) NNNNNNNNNN)rbrcrd__doc__r|rrr>r>r>r?rvs #rvc @seZdZdZddZdddZddZd d Zd d Ze d dZ ddZ ddZ dddZ ddZd ddZddZddZdS)!ra)The fully mutable :class:`PreparedRequest ` object, containing the exact bytes that will be sent to the server. Instances are generated from a :class:`Request ` object, and should not be instantiated manually; doing so may produce undesirable effects. Usage:: >>> import requests >>> req = requests.Request('GET', 'https://httpbin.org/get') >>> r = req.prepare() >>> r >>> s = requests.Session() >>> s.send(r) cCs0d|_d|_d|_d|_d|_t|_d|_dSri)rxr7rS_cookiesr`r%rn_body_positionrr>r>r?r|OszPreparedRequest.__init__Nc CsR||||||||||||| ||||| dS)z6Prepares the entire request with the given parameters.N)prepare_method prepare_urlprepare_headersprepare_cookies prepare_body prepare_auth prepare_hooks) r<rxr7rSr[rJryrzr{rnrr>r>r?r`s     zPreparedRequest.preparecCsd|jdS)Nzr>r?r|szPreparedRequest.__repr__cCsXt}|j|_|j|_|jdur*|jnd|_t|j|_|j|_|j|_|j |_ |Sri) rrxr7rScopyrrr`rnrrr>r>r?rs zPreparedRequest.copycCs$||_|jdur t|j|_dS)zPrepares the given HTTP method.N)rxr upper)r<rxr>r>r?rs zPreparedRequest.prepare_methodcCs>ddl}z|j|ddd}Wn|jy8tYn0|S)NrT)Zuts46rC)idnarIrVZ IDNAError UnicodeError)hostrr>r>r?_get_idna_encoded_hosts  z&PreparedRequest._get_idna_encoded_hostc Cst|tr|d}nt|}|}d|vrF|dsF||_dSzt|\}}}}}}} Wn.t y} zt | j WYd} ~ n d} ~ 00|st d|d|d|st d|dt |sz||}Wntyt d Yn0n|d rt d |pd } | r| d 7} | |7} |r:| d|7} |sDd }t|ttfr\t|}||} | r|r|d| }n| }tt|| |d|| g}||_dS)zPrepares the given HTTP URL.utf8:httpNz Invalid URL z0: No scheme supplied. Perhaps you meant https://r5z: No host suppliedzURL has an invalid label.)*.r6@r4&)rErGrVrFlstriplower startswithr7r rr"argsr#r rrr rNr.r) r<r7ryschemerzrportr8r:fragmentenetlocZ enc_paramsr>r>r?rsV       zPreparedRequest.prepare_urlcCs<t|_|r8|D]"}t||\}}||jt|<qdS)z Prepares the given HTTP headers.N)r'rSrwr(r )r<rSheaderrQvaluer>r>r?rs  zPreparedRequest.prepare_headersc Csd}d}|sp|durpd}ztj|dd}Wn0tyZ}zt||dWYd}~n d}~00t|tsp|d}tt|dt|t t t t f g}|r4z t |}Wntttfyd}Yn0|}t|dddurz||_Wntyt|_Yn0|rtd |r(t||jd <n d |jd <np|rL|||\}}n2|r~||}t|t stt|d rzd}nd}|||rd|jvr||jd<||_dS)z"Prepares the given HTTP body data.Nzapplication/jsonF)Z allow_nan)requestrCrBtellz1Streamed bodies and files are mutually exclusive.Content-LengthZchunkedzTransfer-EncodingrAz!application/x-www-form-urlencodedz content-typez Content-Type) complexjsondumpsrUr!rErGrIallrHrrXrWrr0 TypeErrorAttributeErrorrgetattrrrOSErrorobjectNotImplementedErrorrrSrarNprepare_content_lengthr`) r<rJr[rr`rTveZ is_streamlengthr>r>r?rsX "        zPreparedRequest.prepare_bodycCsL|dur$t|}|rHt||jd<n$|jdvrH|jddurHd|jd<dS)z>Prepare Content-Length header based on request method and bodyNr)ZGETZHEAD0)r0rrSrxget)r<r`rr>r>r?r=sz&PreparedRequest.prepare_content_lengthr6cCsj|dur"t|j}t|r|nd}|rft|trDt|dkrDt|}||}|j|j| |j dS)z"Prepares the given HTTP auth data.NrO) r)r7anyrErWrYr__dict__updaterr`)r<rzr7Zurl_authrr>r>r?rMs zPreparedRequest.prepare_authcCs@t|tjr||_n t||_t|j|}|dur<||jd<dS)aPrepares the given HTTP cookie data. This function eventually generates a ``Cookie`` header from the given cookies using cookielib. Due to cookielib's design, the header will not be regenerated if it already exists, meaning this function can only be called once for the life of the :class:`PreparedRequest ` object. Any subsequent calls to ``prepare_cookies`` will have no actual effect, unless the "Cookie" header is removed beforehand. NZCookie)rErZ CookieJarrrrrS)r<r{Z cookie_headerr>r>r?rcs   zPreparedRequest.prepare_cookiescCs&|pg}|D]}||||q dS)zPrepares the given hooks.N)rs)r<rnrqr>r>r?rwszPreparedRequest.prepare_hooks) NNNNNNNNNN)N)r6)rbrcrdrr|rrrrrfrrrrrrrrr>r>r>r?r:s2   J N rc@seZdZdZgdZddZddZddZd d Zd d Z d dZ ddZ ddZ ddZ eddZeddZeddZeddZeddZd2d!d"Zed d#fd$d%Zed&d'Zed(d)Zd*d+Zed,d-Zd.d/Zd0d1Zd#S)3ResponsezhThe :class:`Response ` object, which contains a server's response to an HTTP request. ) _content status_coderSr7historyencodingreasonr{elapsedrcCs^d|_d|_d|_d|_t|_d|_d|_d|_g|_ d|_ t i|_ t d|_d|_dS)NFr)r_content_consumed_nextrr'rSrawr7rrrrr{datetimeZ timedeltarrrr>r>r?r|s  zResponse.__init__cCs|Srir>rr>r>r? __enter__szResponse.__enter__cGs |dSri)close)r<rr>r>r?__exit__szResponse.__exit__cs js jfddjDS)Ncsi|]}|t|dqSri)r)rjattrrr>r? rmz)Response.__getstate__..)rcontent __attrs__rr>rr? __getstate__szResponse.__getstate__cCs:|D]\}}t|||qt|ddt|dddS)NrTr)rwsetattr)r<staterQrr>r>r? __setstate__s zResponse.__setstate__cCsd|jdS)Nz r>r?rszResponse.__repr__cCs|jSakReturns True if :attr:`status_code` is less than 400. This attribute checks if the status code of the response is between 400 and 600 to see if there was a client error or a server error. If the status code, is between 200 and 400, this will return True. This is **not** a check to see if the response code is ``200 OK``. okrr>r>r?__bool__szResponse.__bool__cCs|jSrrrr>r>r? __nonzero__szResponse.__nonzero__cCs |dS)z,Allows you to use a response as an iterator.) iter_contentrr>r>r?rBszResponse.__iter__cCs&z |Wnty YdS0dS)axReturns True if :attr:`status_code` is less than 400, False if not. This attribute checks if the status code of the response is between 400 and 600 to see if there was a client error or a server error. If the status code is between 200 and 400, this will return True. This is **not** a check to see if the response code is ``200 OK``. FT)raise_for_statusr rr>r>r?rs   z Response.okcCsd|jvo|jtvS)zTrue if this Response is a well-formed HTTP redirect that could have been processed automatically (by :meth:`Session.resolve_redirects`). location)rSrREDIRECT_STATIrr>r>r? is_redirectszResponse.is_redirectcCsd|jvo|jtjtjfvS)z@True if this Response one of the permanent versions of redirect.r)rSrr&Zmoved_permanentlypermanent_redirectrr>r>r?is_permanent_redirect szResponse.is_permanent_redirectcCs|jS)zTReturns a PreparedRequest for the next request in a redirect chain, if there is one.)rrr>r>r?nextsz Response.nextcCst|jdS)zOThe apparent encoding, provided by the charset_normalizer or chardet libraries.r)rZdetectrrr>r>r?apparent_encodingszResponse.apparent_encodingr Fcsfdd}jr(tjtr(tn&durNttsNtdtdtj}|}jrj|n|}|r|t |}|S)aIterates over the response data. When stream=True is set on the request, this avoids reading the content at once into memory for large responses. The chunk size is the number of bytes it should read into memory. This is not necessarily the length of each item returned as decoding can take place. chunk_size must be of type int or None. A value of None will function differently depending on the value of `stream`. stream=True will read data as it arrives in whatever size the chunks are received. If stream=False, data is returned as a single chunk. If decode_unicode is True, content will be decoded using the best available encoding based on the response. c 3stjdrzjjddEdHWqtyR}zt|WYd}~qd}~0ty|}zt|WYd}~qd}~0ty}zt|WYd}~qd}~0t y}zt |WYd}~qd}~00nj }|sq|Vqd_ dS)NstreamT)Zdecode_content) rHrrrrrrrrrRequestsSSLErrorrAr)rchunk chunk_sizer<r>r?generate,s    z'Response.iter_content..generateNz+chunk_size must be an int, it is instead a r) rrErboolr$intrtyper,r/)r<rdecode_unicoderZ reused_chunksZ stream_chunkschunksr>rr?rs  zResponse.iter_contentNccsd}|j||dD]h}|dur&||}|r6||}n|}|rl|drl|rl|dd|dkrl|}nd}|EdHq|dur|VdS)zIterates over the response data, one line at a time. When stream=True is set on the request, this avoids reading the content at once into memory for large responses. .. note:: This method is not reentrant safe. N)rr)rsplit splitlinespop)r<rrZ delimiterpendingrlinesr>r>r? iter_linesUs   $  zResponse.iter_linescCsV|jdurJ|jrtd|jdks,|jdur4d|_nd|tpFd|_d|_|jS)z"Content of the response, in bytes.Fz2The content for this response was already consumedrNrmT)rr RuntimeErrorrrr;rCONTENT_CHUNK_SIZErr>r>r?rws zResponse.contentc Csbd}|j}|jsdS|jdur$|j}zt|j|dd}Wn$ttfy\t|jdd}Yn0|S)aContent of the response, in unicode. If Response.encoding is None, encoding will be guessed using ``charset_normalizer`` or ``chardet``. The encoding of the response content is determined based solely on HTTP headers, following RFC 2616 to the letter. If you can take advantage of non-HTTP knowledge to make a better guess at the encoding, you should set ``r.encoding`` appropriately before accessing this property. Nr6replace)errors)rrrrF LookupErrorr)r<rrr>r>r?texts z Response.textc Ks|js|jrt|jdkrt|j}|durztj|j|fi|WStyZYn6ty}zt |j |j |j WYd}~n d}~00ztj|j fi|WSty}zt |j |j |j WYd}~n d}~00dS)zReturns the json-encoded content of a response, if any. :param \*\*kwargs: Optional arguments that ``json.loads`` takes. :raises requests.exceptions.JSONDecodeError: If the response body does not contain valid json. rPN)rrrYr+rloadsrVUnicodeDecodeErrorrRequestsJSONDecodeErrormsgdocposr)r<kwargsrrr>r>r?rs  (z Response.jsoncCsF|jd}i}|rBt|}|D] }|dp6|d}|||<q |S)z8Returns the parsed header links of the response, if any.linkrelr7)rSrr-)r<rZresolved_linkslinksrkeyr>r>r?rs  zResponse.linkscCsd}t|jtrBz|jd}WqHty>|jd}YqH0n|j}d|jkr^dkr|nn|jd|d|j}n2d|jkrdkrnn|jd |d|j}|rt||d d S) z+Raises :class:`HTTPError`, if one occurred.r6rCz iso-8859-1iiz Client Error: z for url: iXz Server Error: )ZresponseN)rErrGrVrrr7r )r<Zhttp_error_msgrr>r>r?rs  zResponse.raise_for_statuscCs0|js|jt|jdd}|dur,|dS)zReleases the connection back to the pool. Once this method has been called the underlying ``raw`` object must not be accessed again. *Note: Should not normally need to be called explicitly.* release_connN)rrrr)r<rr>r>r?rs  zResponse.close)r F)rbrcrdrrr|rrrrrrrrBrerrrrrrITER_CHUNK_SIZErrrrrrrr>r>r>r?rsB /        ; "  %! r)RrrZencodings.idna encodingsiorZurllib3.exceptionsrrrrrZurllib3.fieldsrZurllib3.filepostr Z urllib3.utilr Z_internal_utilsr r rzrcompatrrrrrrrrrrrrr{rrr exceptionsrrrr r!r"rr#rr$rnr%Z status_codesr&Z structuresr'Zutilsr(r)r*r+r,r-r.r/r0r1ZmovedfoundotherZtemporary_redirectrrZDEFAULT_REDIRECT_LIMITrrr3rgrvrrr>r>r>r?sL     $         0zTI