3 ig @sdZddlmZddlZddlZejddkZerDeefZ ddZ neZ e Z e ZddZ ejd+krpeZd d Znd d Zeed rddlmZyddlmZWn ek rddlmZYnXdZGdddeZndZddlmZddZddlmZm Z m!Z!m"Z"m#Z#ddl$m%Z%m&Z&dZ'dZ(dZ)dZ*dZ+dZ,dZ-dZ.dZ/d Z0dZ1e2e3fddZ4dd Z5d!d"Z6ejd,kr|d-d%d&Z7nej8Z7Gd'd(d(eZ9Gd)d*d*eZ:dS).z.Fallback pure Python implementation of msgpack)datetimeNcCs|jS)N) iteritems)dr;/tmp/pip-build-88gy_88q/pip/pip/_vendor/msgpack/fallback.pydict_iteritems srcCs|jS)N)items)rrrrrscCs.t|jdko,t|jdto,|jdjdS)Nrz maximum recursion depth exceeded)lenargs isinstancestr startswith)errr_is_recursionerrorsrcCsdS)NTr)rrrrr'spypy_version_info) newlist_hint) BytesBuilder) StringBuilderTc@s&eZdZd ddZddZddZdS) StringIOcCs,|r tt||_|jj|nt|_dS)N)rr builderappend)selfsrrr__init__7szStringIO.__init__cCs6t|tr|j}nt|tr&t|}|jj|dS)N)r memoryviewtobytes bytearraybytesrr)rrrrrwrite>s    zStringIO.writecCs |jjS)N)rbuild)rrrrgetvalueEszStringIO.getvalueN)r)__name__ __module__ __qualname__rr#r%rrrrr6s rF)BytesIOcCsgS)Nr)sizerrrMsr+r ) BufferFull OutOfData ExtraData FormatError StackError)ExtType TimestampicCs(|||kr|||kS|||kSdS)Nr)objttypetuplerrr_check_type_strictds  r8cCst|}|jdkrtd|S)Nr z$cannot unpack from multi-byte object)ritemsize ValueError)r4viewrrr_get_data_from_bufferks r<cKstddt|i|}|j|y |j}WnJtk rHtdYn0tk rv}zt|rdtWYdd}~XnX|j rt ||j |S)aw Unpack an object from `packed`. Raises ``ExtraData`` when *packed* contains extra bytes. Raises ``ValueError`` when *packed* is incomplete. Raises ``FormatError`` when *packed* is not valid msgpack. Raises ``StackError`` when *packed* contains too nested. Other exceptions can be raised during unpacking. See :class:`Unpacker` for options. Nmax_buffer_sizezUnpack failed: incomplete input)N) Unpackerr feed_unpackr-r:RecursionErrorrr0_got_extradatar._get_extradata)packedkwargsZunpackerretrrrrunpackbrs    rGcCstj|t||S)z0Explicit type cast for legacy struct.unpack_from)struct unpack_fromr")fborrr _unpack_fromsrOc@seZdZdZddddddddddd,ed-d.d/d0d1fd d Zd d Zd dZddZddZ ddZ d2ddZ d3ddZ e fddZe fddZddZdd ZeZd!d"Zd#d$Zd%d&Zd'd(Zd)d*ZdS)4r>a Streaming unpacker. Arguments: :param file_like: File-like object having `.read(n)` method. If specified, unpacker reads serialized data from it and :meth:`feed()` is not usable. :param int read_size: Used as `file_like.read(read_size)`. (default: `min(16*1024, max_buffer_size)`) :param bool use_list: If true, unpack msgpack array to Python list. Otherwise, unpack to Python tuple. (default: True) :param bool raw: If true, unpack msgpack raw to Python bytes. Otherwise, unpack to Python str by decoding with UTF-8 encoding (default). :param int timestamp: Control how timestamp type is unpacked: 0 - Timestamp 1 - float (Seconds from the EPOCH) 2 - int (Nanoseconds from the EPOCH) 3 - datetime.datetime (UTC). Python 2 is not supported. :param bool strict_map_key: If true (default), only str or bytes are accepted for map (dict) keys. :param callable object_hook: When specified, it should be callable. Unpacker calls it with a dict argument after unpacking msgpack map. (See also simplejson) :param callable object_pairs_hook: When specified, it should be callable. Unpacker calls it with a list of key-value pairs after unpacking msgpack map. (See also simplejson) :param str unicode_errors: The error handler for decoding unicode. (default: 'strict') This option should be used only when you have msgpack data which contains invalid UTF-8 string. :param int max_buffer_size: Limits size of data waiting unpacked. 0 means 2**32-1. The default value is 100*1024*1024 (100MiB). Raises `BufferFull` exception when it is insufficient. You should set this parameter when unpacking data from untrusted source. :param int max_str_len: Deprecated, use *max_buffer_size* instead. Limits max length of str. (default: max_buffer_size) :param int max_bin_len: Deprecated, use *max_buffer_size* instead. Limits max length of bin. (default: max_buffer_size) :param int max_array_len: Limits max length of array. (default: max_buffer_size) :param int max_map_len: Limits max length of map. (default: max_buffer_size//2) :param int max_ext_len: Deprecated, use *max_buffer_size* instead. Limits max size of ext type. (default: max_buffer_size) Example of streaming deserialize from file-like object:: unpacker = Unpacker(file_like) for o in unpacker: process(o) Example of streaming deserialize from socket:: unpacker = Unpacker(max_buffer_size) while True: buf = sock.recv(1024**2) if not buf: break unpacker.feed(buf) for o in unpacker: process(o) Raises ``ExtraData`` when *packed* contains extra bytes. Raises ``OutOfData`` when *packed* is incomplete. Raises ``FormatError`` when *packed* is not valid msgpack. Raises ``StackError`` when *packed* contains too nested. Other exceptions can be raised during unpacking. NrTFdir cCs| dkr d} |dkrd|_nt|js.td||_d|_t|_d|_d|_| sVd} | dkrb| } |dkrn| }|dkrz| }|dkr| d}|dkr| }| |_ ||j krt d |pt |j d|_ t ||_t ||_| |_||_d|kod knst d ||_| |_||_||_| |_| |_||_||_||_||_d|_| dk rdt|  rdtd|dk rt| rtd|dk rt| rtd|dk r|dk rtdt| stddS)NstrictTz!`file_like.read` must be callableFrrr z.read_size must be smaller than max_buffer_sizeir ztimestamp must be 0..3z`list_hook` is not callablez`object_hook` is not callablez#`object_pairs_hook` is not callablez8object_pairs_hook and object_hook are mutually exclusivez`ext_hook` is not callablelirTrTrTrTi@)_feedingcallableread TypeError file_liker!_buffer_buff_i_buf_checkpoint_max_buffer_sizer:min _read_sizebool_raw_strict_map_key_unicode_errors _use_list _timestamp _list_hook _object_hook_object_pairs_hook _ext_hook _max_str_len _max_bin_len_max_array_len _max_map_len _max_ext_len_stream_offset)rrYZ read_sizeZuse_listraw timestampZstrict_map_key object_hookobject_pairs_hookZ list_hookunicode_errorsr=Zext_hookZ max_str_lenZ max_bin_lenZ max_array_lenZ max_map_lenZ max_ext_lenrrrrsn      zUnpacker.__init__cCsr|js tt|}t|j|jt||jkr4t|jdkrb|jd|j=|j|j8_d|_|jj |dS)Nr) rUAssertionErrorr<r rZr[r]r,r\extend)rZ next_bytesr;rrrr?Us  z Unpacker.feedcCs"|j|j|j7_|j|_dS)z+ Gets rid of the used parts of the buffer. N)ror[r\)rrrr_consumedszUnpacker._consumecCs|jt|jkS)N)r[r rZ)rrrrrBiszUnpacker._got_extradatacCs|j|jdS)N)rZr[)rrrrrClszUnpacker._get_extradatacCs|j|dd}|j|S)NF)raise_outofdata)_readrw)rnrFrrr read_bytesoszUnpacker.read_bytescCs8|j||d|j}|j|||}|t||_|S)N)rx)_reserver[rZr )rrzrxirFrrrryts zUnpacker._readcCst|j|j|}|dkr dS|jr2|j|_t|jdkr`|jd|j=|j|j8_d|_| }xR|dkrt|j|}|jj |}|sPt |t st |j|7_|t|8}qhWt|j||jkr|rd|_tdS)Nr) r rZr[rUr\r-maxr_rYrWrr"ru)rrzrxZ remain_bytesZ to_read_bytesZ read_datarrrr||s,    zUnpacker._reservecCs& t}d}d}|jd|j|j}|jd7_|d@dkrD|} n|d@dkr`dK|dA} n|d@dkr|d@}t}||jkrtd||j|j|} n~|d @d kr|d @}t}||j krtd ||j  nJ|d @dkr |d @}t }||j k rtd ||j  n|dkrd} n|dkr.d}n|dkr@d}n|dkrt }|jd|j|j}|jd7_||j krtd||j f|j|}n~|dkrt }|jdtd|j|jd}|jd7_||j krtd||j f|j|}n|dkrjt }|jdtd|j|jd}|jd7_||j kr\td||j f|j|}n|dkrt}|jdtd|j|j\}}|jd7_||jkrtd||jf|j|}nL|dkr6t}|jdtd |j|j\}}|jd7_||jkr(td||jf|j|}n|d!krt}|jd"td#|j|j\}}|jd"7_||jkrtd||jf|j|}n|d$kr|jdtd%|j|jd}|jd7_nF|d&kr|jd'td(|j|jd}|jd'7_n |d)krB|jd|j|j}|jd7_n|d*kr||jdtd|j|jd}|jd7_n|d+kr|jdtd|j|jd}|jd7_nf|d,kr|jd'td-|j|jd}|jd'7_n,|d.kr*|jdtd/|j|jd}|jd7_n|d0krd|jdtd1|j|jd}|jd7_n|d2kr|jdtd3|j|jd}|jd7_n~|d4kr|jd'td5|j|jd}|jd'7_nD|d6kr4t}|jdkrtdd|jf|jdtd7|j|j\}}|jd7_n|d8krt}|jdkr`tdd|jf|jdtd9|j|j\}}|jd7_n|d:krt}|jdkrtdd|jf|jd"td;|j|j\}}|jd"7_n0|d|j|j\}}|jd=7_n|d?krt}|jd@krttdd@|jf|jdAtdB|j|j\}}|jdA7_nx|dCkrt}|jd|j|j}|jd7_||jkrtd||j|j|}n|dDkr^t}|jdtd|j|j\}|jd7_||jkrPtd||j|j|}n|dEkrt}|jdtd|j|j\}|jd7_||jkrtd||j|j|}n^|dFk rt}|jdtd|j|j\}|jd7_||j k rtd ||j n|dGk rht}|jdtd|j|j\}|jd7_||j k rtd ||j n|dHk r|jdtd|j|j\}|jd7_||j k rtd ||j t }n`|dIk r|jdtd|j|j\}|jd7_||j k r td ||j t }n tdJ||||fS)LNrr rRz%s exceeds max_str_len(%s)z%s exceeds max_array_len(%s)z%s exceeds max_map_len(%s)FTz%s exceeds max_bin_len(%s)rz>Hr3z>IZBbz%s exceeds max_ext_len(%s)r z>Hbr z>Ibz>fz>dz>QrMz>hz>iz>qZb1sZb2sZb4s Zb8srSZb16szUnknown header: 0x%xrT)TYPE_IMMEDIATEr|rZr[TYPE_RAWrjr:ry TYPE_ARRAYrlTYPE_MAPrmTYPE_BINrkrOTYPE_EXTrnr/)rexecutetyprzr4rMLrrr _read_headers                                                                                          zUnpacker._read_headerc sj|\}}}|tkr,|tkr(td|S|tkrH|tkrDtd|S|tkr|tkrxxt|D]}jtqbWdSt |}x t|D]}|j jt qWj dk rj |}j r|St|S|tkr|tkrx$t|D]}jtjtqWdSjdk r0jfddt|D}ni}xxt|D]l}jt }jrzt|ttfkrztdtt|t rt|tkrtj|}jt ||<q>Wjdk rĈj|}|S|tkrdS|tkrjrt|}n|jdj}|S|tkrt|S|tkr|d krztj t|} j!dkrL| j"Sj!dkr`| j#Sj!d krt| j$S| Snj%|t|S|t&kst'|S) NzExpected arrayz Expected mapc3s"|]}jtjtfVqdS)N)r@ EX_CONSTRUCT).0_)rrr sz#Unpacker._unpack..z%s is not allowed for map keyutf_8r rr rT)(rEX_READ_ARRAY_HEADERrr:EX_READ_MAP_HEADERrEX_SKIPxranger@rrrrfrdr7rhrbr6unicoder"rPY2sysinternrgrradecodercrrr2 from_bytesreZto_unixZ to_unix_nanoZ to_datetimerirru) rrrrzr4r}rFrkeytsr)rrr@ps                    zUnpacker._unpackcCs|S)Nr)rrrr__iter__szUnpacker.__iter__c CsRy|jt}|j|Stk r6|jtYntk rLtYnXdS)N)r@rrwr- StopIterationrAr0)rrFrrr__next__s zUnpacker.__next__cCs|jt|jdS)N)r@rrw)rrrrskips z Unpacker.skipc Cs4y|jt}Wntk r&tYnX|j|S)N)r@rrAr0rw)rrFrrrunpacks  zUnpacker.unpackcCs|jt}|j|S)N)r@rrw)rrFrrrread_array_headers zUnpacker.read_array_headercCs|jt}|j|S)N)r@rrw)rrFrrrread_map_headers zUnpacker.read_map_headercCs|jS)N)ro)rrrrtellsz Unpacker.tellii@rTrTrTrTrT)T)T)r&r'r(__doc__r1rr?rwrBrCr{ryr|rrr@rrnextrrrrrrrrrr>sH^ K  U M r>c@seZdZdZd#ddZeeefddZd d Z d d Z d dZ ddZ ddZ ddZddZefddZddZddZddZdd Zd!d"ZdS)$Packera8 MessagePack Packer Usage:: packer = Packer() astream.write(packer.pack(a)) astream.write(packer.pack(b)) Packer's constructor has some keyword arguments: :param callable default: Convert user type to builtin type that Packer supports. See also simplejson's document. :param bool use_single_float: Use single precision float type for float. (default: False) :param bool autoreset: Reset buffer after each pack and return its content as `bytes`. (default: True). If set this to false, use `bytes()` to get content and `.reset()` to clear buffer. :param bool use_bin_type: Use bin type introduced in msgpack spec 2.0 for bytes. It also enables str8 type for unicode. (default: True) :param bool strict_types: If set to true, types will be checked to be exact. Derived classes from serializable types will not be serialized and will be treated as unsupported type and forwarded to default. Additionally tuples will not be serialized as lists. This is useful when trying to implement accurate serialization for python types. :param bool datetime: If set to true, datetime with tzinfo is packed into Timestamp type. Note that the tzinfo is stripped in the timestamp. You can get UTC datetime with `timestamp=3` option of the Unpacker. (Python 2 is not supported). :param str unicode_errors: The error handler for encoding unicode. (default: 'strict') DO NOT USE THIS!! This option is kept for very specific usage. Example of streaming deserialize from file-like object:: unpacker = Unpacker(file_like) for o in unpacker: process(o) Example of streaming deserialize from socket:: unpacker = Unpacker() while True: buf = sock.recv(1024**2) if not buf: break unpacker.feed(buf) for o in unpacker: process(o) Raises ``ExtraData`` when *packed* contains extra bytes. Raises ``OutOfData`` when *packed* is incomplete. Raises ``FormatError`` when *packed* is not valid msgpack. Raises ``StackError`` when *packed* contains too nested. Other exceptions can be raised during unpacking. NFTcCsf||_||_||_||_t|_tr0|r0tdt||_ |p@d|_ |dk r\t |s\t d||_ dS)Nz%datetime is not supported in Python 2rQzdefault must be callable) _strict_types _use_float _autoreset _use_bin_typerrZrr:r` _datetimercrVrX_default)rdefaultZuse_single_float autoresetZ use_bin_typeZ strict_typesrrtrrrr,s   zPacker.__init__c Csd}|jr|}t}nttf}x|dkr0td|dkrD|jjdS||trj|r^|jjdS|jjdS||trd|kodknr|jjtj d|Sd;|kodknr|jjtj d |Sd|kod knr|jjtj d d |Sd<|kodknr.|jjtj dd|Sd |koBdknr`|jjtj dd|Sd=|kotd>knr|jjtj dd|Sd|kodknr|jjtj dd|Sd?|kod@knr|jjtj dd|Sd|ko dknr(|jjtj dd|SdA|koBbriz>BHriz>Bhrlz>BIrlz>Birlz>BQrlz>BqrTzInteger value out of rangerz%s is too largezutf-8zString is too largezMemoryview is too largez>Bfrz>Bdrr r3rrSz>BBrrrzCannot serialize %riiiiiililllrT)-rlistr7r:rZr#r` int_typesrJpackr OverflowErrorr"r!r r6r&_pack_bin_headerrencoderc_pack_raw_headerrr9floatrr1r2to_bytescodedatarintru_pack_array_headerr_packdict_pack_map_pairsrr _DateTimetzinfoZ from_datetimerX) rr4 nest_limitcheckZcheck_type_strictZ default_usedZ list_typesrzrrrr}rrrrDs                                  z Packer._packc CsFy|j|Wnt|_YnX|jrB|jj}t|_|SdS)N)rrrZrr%)rr4rFrrrrs z Packer.packcCs0|jt|||jr,|jj}t|_|SdS)N)rr rrZr%r)rpairsrFrrrpack_map_pairss  zPacker.pack_map_pairscCs6|dkr t|j||jr2|jj}t|_|SdS)Nrrl)r:rrrZr%r)rrzrFrrrpack_array_headers  zPacker.pack_array_headercCs6|dkr t|j||jr2|jj}t|_|SdS)Nrrl)r:_pack_map_headerrrZr%r)rrzrFrrrpack_map_headers  zPacker.pack_map_headercCsLt|tstdd|ko$dkns2tdt|tsDtdt|}|dkr\td|dkrr|jjd n|d kr|jjd n|d kr|jjd n|dkr|jjdnt|dkr|jjdn^|dkr|jjdtj d|n<|dkr|jjdtj d|n|jjdtj d||jjtj d||jj|dS)Nztypecode must have int type.rztypecode should be 0-127zdata must have bytes typelzToo large datar rrrr3rrrrSrrriz>Hz>I) rrrXr:r"r rZr#rJr)rtypecoderrrrr pack_ext_types4   zPacker.pack_ext_typecCsh|dkr |jjtjdd|S|dkr>|jjtjdd|S|dkr\|jjtjdd |Std dS) Nrrriz>BHrlz>BIrzArray is too large)rZr#rJrr:)rrzrrrrszPacker._pack_array_headercCsh|dkr |jjtjdd|S|dkr>|jjtjdd|S|dkr\|jjtjdd |Std dS) Nrrriz>BHrlz>BIrzDict is too large)rZr#rJrr:)rrzrrrrszPacker._pack_map_headercCs@|j|x0|D](\}}|j||d|j||dqWdS)Nr )rr)rrzrrkvrrrrs zPacker._pack_map_pairscCs|dkr"|jjtjdd|nn|jrH|dkrH|jjtjdd|nH|dkrh|jjtjdd |n(|d kr|jjtjd d |ntd dS)NrRrrrz>BBriz>BHrlz>BIrzRaw is too large)rZr#rJrrr:)rrzrrrrszPacker._pack_raw_headercCsv|js|j|S|dkr.|jjtjdd|S|dkrL|jjtjdd|S|dkrj|jjtjdd |Std dS) Nrz>BBriz>BHrlz>BIrzBin is too large)rrrZr#rJrr:)rrzrrrr#s zPacker._pack_bin_headercCs |jjS)z/Return internal buffer contents as bytes object)rZr%)rrrrr"/sz Packer.bytescCs t|_dS)zYReset internal buffer. This method is useful only when autoreset=False. N)rrZ)rrrrreset3sz Packer.resetcCs"tstrt|jS|jjSdS)zReturn view of internal buffer.N)USING_STRINGBUILDERrrr"rZ getbuffer)rrrrr:s zPacker.getbuffer)NFTTFFN)r&r'r(rrDEFAULT_RECURSE_LIMITrr8rrrrrrrrrrrr"rrrrrrrs0C  u       r)r r )rrHrI)r);rrrrrJ version_inforrlongrrrrranger RuntimeErrorrArhasattrZ__pypy__rZ__pypy__.buildersrr ImportErrorrobjectrior) exceptionsr,r-r.r/r0extr1r2rrrrrrrrrrrr6r7r8r<rGrOrKr>rrrrrsf         S