3 igl@sdZddlZddlZddlZddlmZddlmZddl m Z ddl m Z m Z mZmZddlmZdd lmZdd lmZdd lmZdd lmZmZmZdd lmZmZmZm Z m!Z!m"Z"m#Z#m$Z$ddl%m&Z&m'Z'ddl(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2ddl3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;mZ>m?Z?ddl3m@ZAddlBmCZCeCjDeCjEeCjFeCjGeCjHfZIdZJd!ZKdZLGdddeMZNGdddeMZOGdddeOZPGdddeNeOZQGdd d eMZRdS)"z` requests.models ~~~~~~~~~~~~~~~ This module contains the primary objects that power Requests. N) RequestField)encode_multipart_formdata) parse_url) DecodeErrorReadTimeoutError ProtocolErrorLocationParseError)UnsupportedOperation) default_hooks)CaseInsensitiveDict) HTTPBasicAuth)cookiejar_from_dictget_cookie_header_copy_cookie_jar) HTTPError MissingSchema InvalidURLChunkedEncodingErrorContentDecodingErrorConnectionErrorStreamConsumedErrorInvalidJSONError)to_native_stringunicode_is_ascii) guess_filenameget_auth_from_url requote_uristream_decode_response_unicodeto_key_val_listparse_header_links iter_slicesguess_json_utf super_lencheck_header_validity) CallableMapping cookielib urlunparseurlsplit urlencodestrbytesis_py2chardet builtin_str basestring)json)codes iic@s0eZdZeddZeddZeddZdS)RequestEncodingMixincCsNg}t|j}|j}|sd}|j||j}|rD|jd|j|dj|S)zBuild the path URL to use./?)r)urlpathappendqueryjoin)selfr9pr:r<r@:/tmp/pip-build-88gy_88q/pip/pip/_vendor/requests/models.pypath_url=s    zRequestEncodingMixin.path_urlcCst|ttfr|St|dr |St|drg}x|t|D]p\}}t|tsVt|d r\|g}xJ|D]B}|dk rb|jt|tr|jdn|t|tr|jdn|fqbWq8Wt|ddS|SdS)zEncode parameters in a piece of data. Will successfully encode parameters when passed as a dict or a list of 2-tuples. Order is retained if data is a list of 2-tuples but arbitrary if parameters are supplied as a dict. read__iter__Nzutf-8T)doseq) isinstancer+r,hasattrrr0r;encoder*)dataresultkvsvr@r@rA_encode_paramsRs    $ z#RequestEncodingMixin._encode_paramscCs|stdnt|tr tdg}t|p,i}t|p8i}x|D]\}}t|ts`t|d rf|g}x\|D]T}|dk rlt|tst|}|jt|tr|jdn|t|tr|j dn|fqlWqBWx|D]\}}d}d} t|t t fr.t |dkr|\} } n&t |dkr |\} } }n |\} } }} nt |p:|} |} t| tttfrX| } n(t| drn| j} n| dkr|qn| } t|| | | d } | j|d |j| qWt|\}}||fS) aBuild the body for a multipart/form-data request. Will successfully encode files when passed as a dict or a list of tuples. Order is retained if data is a list of tuples but arbitrary if parameters are supplied as a dict. The tuples may be 2-tuples (filename, fileobj), 3-tuples (filename, fileobj, contentype) or 4-tuples (filename, fileobj, contentype, custom_headers). zFiles must be provided.zData must not be a string.rDNzutf-8rC)namerIfilenameheaders) content_type) ValueErrorrFr0rrGr,r+r;decoderHtuplelistlenr bytearrayrCrmake_multipartr)filesrI new_fieldsfieldsfieldvalrMrKftfhfnfpfdatarfbodyrTr@r@rA _encode_filesmsP       $       z"RequestEncodingMixin._encode_filesN)__name__ __module__ __qualname__propertyrB staticmethodrNrhr@r@r@rAr5<s  r5c@seZdZddZddZdS)RequestHooksMixincCsZ||jkrtd|t|tr2|j|j|n$t|drV|j|jdd|DdS)zProperly register a hook.z1Unsupported event specified, with event name "%s"rDcss|]}t|tr|VqdS)N)rFr%).0hr@r@rA sz2RequestHooksMixin.register_hook..N)hooksrUrFr%r;rGextend)r>eventhookr@r@rA register_hooks     zRequestHooksMixin.register_hookc Cs.y|j|j|dStk r(dSXdS)ziDeregister a previously registered hook. Returns True if the hook existed, False if not. TFN)rrremoverU)r>rtrur@r@rAderegister_hooks z!RequestHooksMixin.deregister_hookN)rirjrkrvrxr@r@r@rArns rnc @s*eZdZdZd ddZddZddZdS) Requesta{A user-created :class:`Request ` object. Used to prepare a :class:`PreparedRequest `, which is sent to the server. :param method: HTTP method to use. :param url: URL to send. :param headers: dictionary of headers to send. :param files: dictionary of {filename: fileobject} files to multipart upload. :param data: the body to attach to the request. If a dictionary or list of tuples ``[(key, value)]`` is provided, form-encoding will take place. :param json: json for the body to attach to the request (if files or data is not specified). :param params: URL parameters to append to the URL. If a dictionary or list of tuples ``[(key, value)]`` is provided, form-encoding will take place. :param auth: Auth handler or (user, pass) tuple. :param cookies: dictionary or CookieJar of cookies to attach to this request. :param hooks: dictionary of callback hooks, for internal usage. Usage:: >>> import requests >>> req = requests.Request('GET', 'https://httpbin.org/get') >>> req.prepare() Nc Cs|dkr gn|}|dkrgn|}|dkr,in|}|dkrr{r9rSr\rIr|r}r~rrr1rKrMr@r@rA__init__s"zRequest.__init__cCs d|jS)Nz)r{)r>r@r@rA__repr__szRequest.__repr__c Cs<t}|j|j|j|j|j|j|j|j|j |j |j d |S)zXConstructs a :class:`PreparedRequest ` for transmission and returns it.) r{r9rSr\rIr1r|r}r~rr) PreparedRequestpreparer{r9rSr\rIr1r|r}r~rr)r>r?r@r@rArs zRequest.prepare) NNNNNNNNNN)rirjrk__doc__rrrr@r@r@rArys  ryc @seZdZdZddZdddZddZd d Zd d Ze d dZ ddZ ddZ dddZ ddZd ddZddZddZdS)!ra)The fully mutable :class:`PreparedRequest ` object, containing the exact bytes that will be sent to the server. Instances are generated from a :class:`Request ` object, and should not be instantiated manually; doing so may produce undesirable effects. Usage:: >>> import requests >>> req = requests.Request('GET', 'https://httpbin.org/get') >>> r = req.prepare() >>> r >>> s = requests.Session() >>> s.send(r) cCs0d|_d|_d|_d|_d|_t|_d|_dS)N)r{r9rS_cookiesrgr rr_body_position)r>r@r@rAr%szPreparedRequest.__init__Nc CsR|j||j|||j||j||j||| |j|||j| dS)z6Prepares the entire request with the given parameters.N)prepare_method prepare_urlprepare_headersprepare_cookies prepare_body prepare_auth prepare_hooks) r>r{r9rSr\rIr|r}r~rrr1r@r@rAr6s     zPreparedRequest.preparecCs d|jS)Nz)r{)r>r@r@rArHszPreparedRequest.__repr__cCsXt}|j|_|j|_|jdk r*|jjnd|_t|j|_|j|_|j|_|j |_ |S)N) rr{r9rScopyrrrgrrr)r>r?r@r@rArKs zPreparedRequest.copycCs$||_|jdk r t|jj|_dS)zPrepares the given HTTP method.N)r{rupper)r>r{r@r@rArVs zPreparedRequest.prepare_methodc CsDddlm}y|j|ddjd}Wn|jk r>tYnX|S)Nr)idnaT)uts46zutf-8) pip._vendorrrHrV IDNAError UnicodeError)hostrr@r@rA_get_idna_encoded_host\s   z&PreparedRequest._get_idna_encoded_hostcCs0t|tr|jd}ntr"t|nt|}|j}d|krT|jjd rT||_ dSyt |\}}}}}}} Wn,t k r} zt | j WYdd} ~ XnX|sd} | jt|d} t| |st d|t|sy|j|}Wntk rt dYnXn|jdrt d|p"d } | r2| d 7} | |7} |rP| dt|7} |sZd }trt|trv|jd }t| tr| jd } t|tr|jd }t|tr|jd }t| tr| jd } t|ttfrt|}|j|} | r|r d || f}n| }tt|| |d|| g}||_ dS)zPrepares the given HTTP URL.utf8:httpNzDInvalid URL {0!r}: No schema supplied. Perhaps you meant http://{0}?z Invalid URL %r: No host suppliedzURL has an invalid label.*r8@r6zutf-8z%s&%s)rFr,rVr-unicoder+lstriplower startswithr9rrrargsformatrrrrrrHrNrr()r>r9r|schemer}rportr:r<fragmenteerrornetloc enc_paramsr@r@rArfsh                 zPreparedRequest.prepare_urlcCs@t|_|rrSheaderrQvaluer@r@rArs zPreparedRequest.prepare_headersc "Csd}d}| rp|dk rpd}ytj|dd}Wn.tk rZ}zt||dWYdd}~XnXt|tsp|jd}tt|dt|t t t t f g}|rrIr\r1rgrTve is_streamlengthr@r@rArsP        zPreparedRequest.prepare_bodycCsL|dk r$t|}|rHt||jd<n$|jdkrH|jjddkrHd|jd<dS)z>Prepare Content-Length header based on request method and bodyNzContent-LengthGETHEAD0)rr)r#r/rSr{get)r>rgrr@r@rArs z&PreparedRequest.prepare_content_lengthr8cCsj|dkr"t|j}t|r|nd}|rft|trDt|dkrDt|}||}|jj|j|j |j dS)z"Prepares the given HTTP auth data.NrO) rr9anyrFrWrYr __dict__updaterrg)r>r}r9url_authrr@r@rArs zPreparedRequest.prepare_authcCs@t|tjr||_n t||_t|j|}|dk r<||jd<dS)aPrepares the given HTTP cookie data. This function eventually generates a ``Cookie`` header from the given cookies using cookielib. Due to cookielib's design, the header will not be regenerated if it already exists, meaning this function can only be called once for the life of the :class:`PreparedRequest ` object. Any subsequent calls to ``prepare_cookies`` will have no actual effect, unless the "Cookie" header is removed beforehand. NCookie)rFr' CookieJarrrrrS)r>r~ cookie_headerr@r@rAr4s   zPreparedRequest.prepare_cookiescCs*|pg}x|D]}|j|||qWdS)zPrepares the given hooks.N)rv)r>rrrtr@r@rArHs zPreparedRequest.prepare_hooks) NNNNNNNNNN)N)r8)rirjrkrrrrrrrmrrrrrrrrr@r@r@rArs   V J rc @seZdZdZdddddddd d d g Zd d ZddZddZddZddZ ddZ ddZ ddZ ddZ eddZed d!Zed"d#Zed$d%Zed&d'Zd;d*d+Zed)d,fd-d.Zed/d0Zed1d2Zd3d4Zed5d6Zd7d8Zd9d:Zd,S)<ResponsezhThe :class:`Response ` object, which contains a server's response to an HTTP request. _content status_coderSr9historyencodingreasonr~elapsedrcCs^d|_d|_d|_d|_t|_d|_d|_d|_g|_ d|_ t i|_ t jd|_d|_dS)NFr)r_content_consumed_nextrr rSrawr9rrrrr~datetime timedeltarr)r>r@r@rAr\s  zResponse.__init__cCs|S)Nr@)r>r@r@rA __enter__szResponse.__enter__cGs |jdS)N)close)r>rr@r@rA__exit__szResponse.__exit__cs js jfddjDS)Ncsi|]}t|d|qS)N)r)roattr)r>r@rA sz)Response.__getstate__..)rcontent __attrs__)r>r@)r>rA __getstate__szResponse.__getstate__cCs>x |jD]\}}t|||q Wt|ddt|dddS)NrTr)rzsetattr)r>staterQrr@r@rA __setstate__s zResponse.__setstate__cCs d|jS)Nz)r)r>r@r@rArszResponse.__repr__cCs|jS)akReturns True if :attr:`status_code` is less than 400. This attribute checks if the status code of the response is between 400 and 600 to see if there was a client error or a server error. If the status code, is between 200 and 400, this will return True. This is **not** a check to see if the response code is ``200 OK``. )ok)r>r@r@rA__bool__szResponse.__bool__cCs|jS)akReturns True if :attr:`status_code` is less than 400. This attribute checks if the status code of the response is between 400 and 600 to see if there was a client error or a server error. If the status code, is between 200 and 400, this will return True. This is **not** a check to see if the response code is ``200 OK``. )r)r>r@r@rA __nonzero__szResponse.__nonzero__cCs |jdS)z,Allows you to use a response as an iterator.) iter_content)r>r@r@rArDszResponse.__iter__c Cs&y |jWntk r dSXdS)axReturns True if :attr:`status_code` is less than 400, False if not. This attribute checks if the status code of the response is between 400 and 600 to see if there was a client error or a server error. If the status code is between 200 and 400, this will return True. This is **not** a check to see if the response code is ``200 OK``. FT)raise_for_statusr)r>r@r@rArs  z Response.okcCsd|jko|jtkS)zTrue if this Response is a well-formed HTTP redirect that could have been processed automatically (by :meth:`Session.resolve_redirects`). location)rSrREDIRECT_STATI)r>r@r@rA is_redirectszResponse.is_redirectcCsd|jko|jtjtjfkS)z@True if this Response one of the permanent versions of redirect.r)rSrr2moved_permanentlypermanent_redirect)r>r@r@rAis_permanent_redirectszResponse.is_permanent_redirectcCs|jS)zTReturns a PreparedRequest for the next request in a redirect chain, if there is one.)r)r>r@r@rAnextsz Response.nextcCstj|jdS)zOThe apparent encoding, provided by the charset_normalizer or chardet libraries.r)r.detectr)r>r@r@rAapparent_encodingszResponse.apparent_encodingr Fcs~fdd}jr(tjtr(tn$dk rLtt rLtdttj}|}jrh|n|}|rzt |}|S)aIterates over the response data. When stream=True is set on the request, this avoids reading the content at once into memory for large responses. The chunk size is the number of bytes it should read into memory. This is not necessarily the length of each item returned as decoding can take place. chunk_size must be of type int or None. A value of None will function differently depending on the value of `stream`. stream=True will read data as it arrives in whatever size the chunks are received. If stream=False, data is returned as a single chunk. If decode_unicode is True, content will be decoded using the best available encoding based on the response. c3stjdry$xjjddD] }|Vq WWqtk rZ}zt|WYdd}~Xqtk r}zt|WYdd}~Xqtk r}zt|WYdd}~XqXnxjj }|sP|VqWd_ dS)NstreamT)decode_content) rGrrrrrrrrrCr)chunkr) chunk_sizer>r@rAgenerates    z'Response.iter_content..generateNz.chunk_size must be an int, it is instead a %s.) rrFrboolrintrtyper!r)r>rdecode_unicoder reused_chunks stream_chunkschunksr@)rr>rArs  zResponse.iter_contentNccsd}x|j||dD]r}|dk r(||}|r8|j|}n|j}|rn|drn|rn|dd|dkrn|j}nd}x|D] }|VqxWqW|dk r|VdS)zIterates over the response data, one line at a time. When stream=True is set on the request, this avoids reading the content at once into memory for large responses. .. note:: This method is not reentrant safe. N)rrr rrr)rsplit splitlinespop)r>rr delimiterpendingrlinesliner@r@rA iter_liness $  zResponse.iter_linescCsV|jdkrJ|jrtd|jdks,|jdkr4d|_ndj|jtpFd|_d|_|jS)z"Content of the response, in bytes.Fz2The content for this response was already consumedrNT)rr RuntimeErrorrrr=rCONTENT_CHUNK_SIZE)r>r@r@rAr7s zResponse.contentc Cshd}|j}|jstdS|jdkr(|j}yt|j|dd}Wn&ttfk rbt|jdd}YnX|S)aContent of the response, in unicode. If Response.encoding is None, encoding will be guessed using ``charset_normalizer`` or ``chardet``. The encoding of the response content is determined based solely on HTTP headers, following RFC 2616 to the letter. If you can take advantage of non-HTTP knowledge to make a better guess at the encoding, you should set ``r.encoding`` appropriately before accessing this property. Nr8replace)errors)rrr+r LookupErrorr)r>rrr@r@rAtextKs z Response.textc Ksj|j rZ|jrZt|jdkrZt|j}|dk rZytj|jj|f|Stk rXYnXtj|jf|S)a.Returns the json-encoded content of a response, if any. :param \*\*kwargs: Optional arguments that ``json.loads`` takes. :raises simplejson.JSONDecodeError: If the response body does not contain valid json and simplejson is installed. :raises json.JSONDecodeError: If the response body does not contain valid json and simplejson is not installed on Python 3. :raises ValueError: If the response body does not contain valid json and simplejson is not installed on Python 2. rPN) rrrYr"rloadsrVUnicodeDecodeErrorr )r>kwargsrr@r@rAr1qs  z Response.jsoncCsJ|jjd}i}|rFt|}x(|D] }|jdp8|jd}|||<q"W|S)z8Returns the parsed header links of the response, if any.linkrelr9)rSrr )r>rllinksr keyr@r@rArs   zResponse.linksc Csd}t|jtrDy|jjd}WqJtk r@|jjd}YqJXn|j}d|jko^dknrxd|j||jf}n,d|jkodknrd|j||jf}|rt||d d S) z+Raises :class:`HTTPError`, if one occurred.r8zutf-8z iso-8859-1iiz%s Client Error: %s for url: %siXz%s Server Error: %s for url: %s)responseN)rFrr,rVr rr9r)r>http_error_msgrr@r@rArs zResponse.raise_for_statuscCs0|js|jjt|jdd}|dk r,|dS)zReleases the connection back to the pool. Once this method has been called the underlying ``raw`` object must not be accessed again. *Note: Should not normally need to be called explicitly.* release_connN)rrrr)r>rr@r@rArs  zResponse.close)r F)rirjrkrrrrrrrrrrrDrlrrrrrrITER_CHUNK_SIZErrr r1rrrr@r@r@rArRs2 /        7  & ri()Srrsysencodings.idna encodingsZpip._vendor.urllib3.fieldsrZpip._vendor.urllib3.filepostrZpip._vendor.urllib3.utilrZpip._vendor.urllib3.exceptionsrrrrior rrr structuresr r}r r~rrr exceptionsrrrrrrrr_internal_utilsrrutilsrrrrrr r!r"r#r$compatr%r&r'r(r)r*r+r,r-r.r/r0r1r status_codesr2movedfoundothertemporary_redirectrrDEFAULT_REDIRECT_LIMITrrrr5rnryrrr@r@r@rAsB       (08  rJD