a q egRÇã@s,ddlZddlmZddlZddlZddlZddlZddlZz ddlZWne ybddl ZYn0ddl Z ddl m Z ddlmZmZmZmZmZmZmZmZmZmZmZmZmZmZddlmZm Z m!Z!ddl"m#Z#m$Z$ddl%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-dd l.m/Z/m0Z0dd l1m2Z2m3Z3e 4e5¡Z6e 7d ¡Z8e 7d ej9¡Z:e 7d ¡Z;dZGdd„de?ƒZ@Gdd„de@ƒZAGdd„de@ƒZBGdd„de?ƒZCGdd„de@ƒZDGdd„de@ƒZEGdd „d e@ƒZFGd!d"„d"e@ƒZGGd#d$„d$e@ƒZHeHeDd%d&d'd(d)ZIeIjJZJGd*d+„d+e?ƒZKdS)-éN)ÚBytesIOé)ÚDistlibException)ÚurljoinÚurlparseÚ urlunparseÚ url2pathnameÚ pathname2urlÚqueueÚquoteÚunescapeÚ build_openerÚHTTPRedirectHandlerÚ text_typeÚRequestÚ HTTPErrorÚURLError)Ú DistributionÚDistributionPathÚ make_dist)ÚMetadataÚMetadataInvalidError)Úcached_propertyÚ ensure_slashÚsplit_filenameÚget_project_dataÚparse_requirementÚparse_name_and_versionÚ ServerProxyÚnormalize_name)Ú get_schemeÚUnsupportedVersionError)ÚWheelÚ is_compatiblez^(\w+)=([a-f0-9]+)z;\s*charset\s*=\s*(.*)\s*$ztext/html|application/x(ht)?mlzhttps://pypi.org/pypicCs>|dur t}t|dd}z| ¡W|dƒƒS|dƒƒ0dS)z• Return all distribution names known by an index. :param url: The URL of the index. :return: A list of all known distribution names. Nç@©ÚtimeoutÚclose)Ú DEFAULT_INDEXrÚ list_packages)ÚurlÚclient©r,ú:/usr/local/lib/python3.9/site-packages/distlib/locators.pyÚget_all_distribution_names's  þr.c@s$eZdZdZdd„ZeZZZdS)ÚRedirectHandlerzE A class to work around a bug in some Python 3.2.x releases. c Cs‚d}dD]}||vr||}q"q|dur.dSt|ƒ}|jdkrnt| ¡|ƒ}t|dƒrf| ||¡n|||<t ||||||¡S)N)ÚlocationÚuriÚÚreplace_header)rÚschemerÚ get_full_urlÚhasattrr3ÚBaseRedirectHandlerÚhttp_error_302) ÚselfÚreqÚfpÚcodeÚmsgÚheadersÚnewurlÚkeyÚurlpartsr,r,r-r8@s  zRedirectHandler.http_error_302N)Ú__name__Ú __module__Ú __qualname__Ú__doc__r8Úhttp_error_301Úhttp_error_303Úhttp_error_307r,r,r,r-r/6s r/c@s¶eZdZdZdZdZdZdZedZd)dd „Z d d „Z d d „Z dd„Z dd„Z dd„Zee eƒZdd„Zdd„Zdd„Zdd„Zdd„Zdd„Zd d!„Zd"d#„Zd$d%„Zd*d'd(„ZdS)+ÚLocatorzG A base class for locators - things that locate distributions. )z.tar.gzz.tar.bz2z.tarz.zipz.tgzz.tbz)z.eggz.exeú.whl)z.pdfN)rJÚdefaultcCs,i|_||_ttƒƒ|_d|_t ¡|_dS)a^ Initialise an instance. :param scheme: Because locators look for most recent versions, they need to know the version scheme to use. This specifies the current PEP-recommended scheme - use ``'legacy'`` if you need to support existing distributions on PyPI. N) Ú_cacher4r r/ÚopenerÚmatcherr ÚQueueÚerrors)r9r4r,r,r-Ú__init__fs  zLocator.__init__cCsTg}|j ¡sPz|j d¡}| |¡Wn|jjyBYqYn0|j ¡q|S)z8 Return any errors which have occurred. F)rPÚemptyÚgetÚappendÚEmptyÚ task_done)r9ÚresultÚer,r,r-Ú get_errorsys    zLocator.get_errorscCs | ¡dS)z> Clear any errors which may have been logged. N)rY©r9r,r,r-Ú clear_errors‡szLocator.clear_errorscCs|j ¡dS©N)rLÚclearrZr,r,r-Ú clear_cacheŽszLocator.clear_cachecCs|jSr\©Ú_schemerZr,r,r-Ú _get_scheme‘szLocator._get_schemecCs ||_dSr\r_)r9Úvaluer,r,r-Ú _set_scheme”szLocator._set_schemecCs tdƒ‚dS)a= For a given project, get a dictionary mapping available versions to Distribution instances. This should be implemented in subclasses. If called from a locate() request, self.matcher will be set to a matcher for the requirement to satisfy, otherwise it will be None. ú Please implement in the subclassN©ÚNotImplementedError)r9Únamer,r,r-Ú _get_project™s zLocator._get_projectcCs tdƒ‚dS)úJ Return all the distribution names known to this locator. rdNrerZr,r,r-Úget_distribution_names¥szLocator.get_distribution_namescCsL|jdur| |¡}n2||jvr,|j|}n| ¡| |¡}||j|<|S)zÖ For a given project, get a dictionary mapping available versions to Distribution instances. This calls _get_project to do all the work, and just implements a caching layer on top. N)rLrhr[)r9rgrWr,r,r-Ú get_project«s      zLocator.get_projectcCs^t|ƒ}t |j¡}d}| d¡}| |j¡}|rBtt|ƒ|jƒ}|j dkd|j v||||fS)zu Give an url a score which can be used to choose preferred URLs for a given project release. TrJÚhttpszpypi.org) rÚ posixpathÚbasenameÚpathÚendswithÚdownloadable_extensionsr#r"Ú wheel_tagsr4Únetloc)r9r*ÚtrnÚ compatibleÚis_wheelZis_downloadabler,r,r-Ú score_url¼s   zLocator.score_urlcCsR|}|rN| |¡}| |¡}||kr(|}||kr@t d||¡nt d||¡|S)a{ Choose one of two URLs where both are candidates for distribution archives for the same version of a distribution (for example, .tar.gz vs. zip). The current implementation favours https:// URLs over http://, archives from PyPI over those from other locations, wheel compatibility (if a wheel) and then the archive name. zNot replacing %r with %rzReplacing %r with %r)rwÚloggerÚdebug)r9Úurl1Úurl2rWÚs1Ús2r,r,r-Ú prefer_urlÊs   zLocator.prefer_urlcCs t||ƒS)zZ Attempt to split a filename in project name, version and Python version. )r)r9ÚfilenameÚ project_namer,r,r-ràszLocator.split_filenamec Csdd„}d}t|ƒ\}}}}} } |  ¡ d¡r.same_projectNzegg=z %s: version hint in fragment: %r)NNéÿÿÿÿú/rJzWheel not compatible: %sTr2z, cSs"g|]}d t|dd…ƒ¡‘qS)Ú.éN)ÚjoinÚlist)Ú.0Úvr,r,r-Ú óz8Locator.convert_url_to_download_info..)rgÚversionrr*úpython-versionzinvalid path for wheel: %szNot downloadable: %sz No match for project/version: %s)rgrŒrr*rú %s_digest)rÚlowerÚ startswithrxryÚ HASHER_HASHÚmatchÚgroupsrpr"r#rrrgrŒrrr†ÚpyverÚ ExceptionÚwarningrqrmrnÚlenr)r9r*r€rrWr4rsroÚparamsÚqueryÚfragÚmÚalgoÚdigestZorigpathÚwheelÚincluderÚextrtrgrŒr”r,r,r-Úconvert_url_to_download_infoæsf      û     ü   z$Locator.convert_url_to_download_infocCshd}d|vr6|d}dD]}||vr|||f}q6q|sddD]$}d|}||vr>|||f}qdq>|S)zò Get a digest from a dictionary by looking at a "digests" dictionary or keys of the form 'algo_digest'. Returns a 2-tuple (algo, digest) if found, else None. Currently looks only for SHA256, then MD5. NÚdigests)Úsha256Úmd5rŽr,)r9ÚinforWr¢rœr@r,r,r-Ú _get_digest,s  zLocator._get_digestc Cs®| d¡}| d¡}||vr,||}|j}nt|||jd}|j}| |¡|_}|d}||d|<|j|dkrœ| |j|¡|_|d |t ƒ¡  |¡||_ |||<dS)zñ Update a result dictionary (the final result from _get_project) with a dictionary for a specific version, which typically holds information gleaned from a filename or URL for an archive for the distribution. rgrŒ©r4r*r¢ÚurlsN) ÚpopÚmetadatarr4r¦rÚ source_urlr~Ú setdefaultÚsetÚaddÚlocator) r9rWr¥rgrŒÚdistÚmdrr*r,r,r-Ú_update_version_dataCs   zLocator._update_version_dataFc Cs€d}t|ƒ}|dur td|ƒ‚t|jƒ}| |j¡|_}t d|t|ƒj ¡|  |j ¡}t |ƒdkrg}|j } |D]X} | dvr†qxz(| | ¡s”n|s¢| | ƒjs¬| | ¡WqxtyÎt d|| ¡Yqx0qxt |ƒdkrìt||jd}|rt d |¡|d } || }|rv|jr$|j|_| d i¡ | tƒ¡|_i} | d i¡} |jD]}|| vrR| || |<qR| |_d|_|S) a Find the most recent distribution which matches the given requirement. :param requirement: A requirement of the form 'foo (1.0)' or perhaps 'foo (>= 1.0, < 2.0, != 1.3)' :param prereleases: If ``True``, allow pre-release versions to be located. Otherwise, pre-release versions are not returned. :return: A :class:`Distribution` instance, or ``None`` if no such distribution could be located. NzNot a valid requirement: %rzmatcher: %s (%s)r…©r¨r¢zerror matching %s with %rr)r@zsorted list: %sr‚r¨r¢)rrr r4rNÚ requirementrxryÚtyperBrkrgr—Z version_classr’Ú is_prereleaserTr•r–Úsortedr@ÚextrasrSr­Ú download_urlsr¢)r9r´Ú prereleasesrWÚrr4rNÚversionsÚslistZvclsÚkrŒÚdÚsdr*r,r,r-ÚlocateZsP           zLocator.locate)rK)F)rBrCrDrEÚsource_extensionsÚbinary_extensionsÚexcluded_extensionsrrrqrQrYr[r^rarcÚpropertyr4rhrjrkrwr~rr¡r¦r²rÁr,r,r,r-rIVs.   FrIcs0eZdZdZ‡fdd„Zdd„Zdd„Z‡ZS)ÚPyPIRPCLocatorz‘ This locator uses XML-RPC to locate distributions. It therefore cannot be used with simple mirrors (that only mirror file content). c s.tt|ƒjfi|¤Ž||_t|dd|_dS)z— Initialise an instance. :param url: The URL to use for XML-RPC. :param kwargs: Passed to the superclass constructor. r$r%N)ÚsuperrÆrQÚbase_urlrr+©r9r*Úkwargs©Ú __class__r,r-rQ™szPyPIRPCLocator.__init__cCst|j ¡ƒS©ri)r­r+r)rZr,r,r-rj¤sz%PyPIRPCLocator.get_distribution_namesc Csiidœ}|j |d¡}|D]Þ}|j ||¡}|j ||¡}t|jd}|d|_|d|_| d¡|_ | dg¡|_ | d¡|_ t |ƒ}|r|d } | d |_ | | ¡|_||_|||<|D]:} | d } | | ¡} |d  |tƒ¡ | ¡| |d | <q¾q|S) Nr³Tr§rgrŒÚlicenseÚkeywordsÚsummaryrr*r¨r¢)r+Zpackage_releasesZ release_urlsZ release_datarr4rgrŒrSrÎrÏrÐrr«r¦rr¯r¬r­r®) r9rgrWr¼r‰r¨Údatarªr°r¥r*rr,r,r-rhªs0         zPyPIRPCLocator._get_project©rBrCrDrErQrjrhÚ __classcell__r,r,rËr-rÆ“s rÆcs0eZdZdZ‡fdd„Zdd„Zdd„Z‡ZS)ÚPyPIJSONLocatorzw This locator uses PyPI's JSON interface. It's very limited in functionality and probably not worth using. c s$tt|ƒjfi|¤Žt|ƒ|_dSr\)rÇrÔrQrrÈrÉrËr,r-rQËszPyPIJSONLocator.__init__cCs tdƒ‚dS©rizNot available from this locatorNrerZr,r,r-rjÏsz&PyPIJSONLocator.get_distribution_namesc Csiidœ}t|jdt|ƒƒ}zœ|j |¡}| ¡ ¡}t |¡}t |j d}|d}|d|_ |d|_ |  d¡|_|  dg¡|_|  d ¡|_t|ƒ}||_|||j <|d D]T} | d }|j |¡| | ¡|j|<|d  |j tƒ¡ |¡| | ¡|d |<q²|d  ¡D]¤\} } | |j kr,qt |j d} |j | _ | | _ t| ƒ} || _| || <| D]T} | d }| j |¡| | ¡| j|<|d  | tƒ¡ |¡| | ¡|d |<q`qWnBtyþ}z(|j t|ƒ¡t d|¡WYd}~n d}~00|S)Nr³z%s/jsonr§r¥rgrŒrÎrÏrÐr¨r*r¢ZreleaseszJSON fetch failed: %s) rrÈr rMÚopenÚreadÚdecodeÚjsonÚloadsrr4rgrŒrSrÎrÏrÐrr¯r¹r®r¦r¢r¬r­Úitemsr•rPÚputrrxÚ exception)r9rgrWr*ÚresprÑr¿r±r°r¥rŒÚinfosZomdÚodistrXr,r,r-rhÕsR                "zPyPIJSONLocator._get_projectrÒr,r,rËr-rÔÅs rÔc@s`eZdZdZe dejejBejB¡Z e dejejB¡Z dd„Z e dej¡Z e dd„ƒZd S) ÚPagez4 This class represents a scraped HTML page. zÝ (rel\s*=\s*(?:"(?P[^"]*)"|'(?P[^']*)'|(?P[^>\s ]*))\s+)? href\s*=\s*(?:"(?P[^"]*)"|'(?P[^']*)'|(?P[^>\s ]*)) (\s+rel\s*=\s*(?:"(?P[^"]*)"|'(?P[^']*)'|(?P[^>\s ]*)))? z!]+)cCs4||_||_|_|j |j¡}|r0| d¡|_dS)zk Initialise an instance with the Unicode page contents and the URL they came from. rN)rÑrÈr*Ú_baseÚsearchÚgroup)r9rÑr*r›r,r,r-rQs  z Page.__init__z[^a-z0-9$&+,/:;=?@.#%_\\|-]cCs¾dd„}tƒ}|j |j¡D]Š}| d¡}|dpX|dpX|dpX|dpX|dpX|d }|d pp|d pp|d }t|j|ƒ}t|ƒ}|j  d d„|¡}|  ||f¡qt |dd„dd}|S)zâ Return the URLs of all the links on a page together with information about their "rel" attribute, for determining which ones to treat as downloads and which ones to queue for further scraping. cSs,t|ƒ\}}}}}}t||t|ƒ|||fƒS)zTidy up an URL.)rrr )r*r4rsror˜r™ršr,r,r-Úclean3szPage.links..cleanr2Zrel1Zrel2Zrel3Zrel4Zrel5Zrel6rzr{Zurl3cSsdt| d¡ƒS)Nz%%%2xr)Úordrä)r›r,r,r-Ú?r‹zPage.links..cSs|dS)Nrr,)rtr,r,r-rçCr‹T)r@Úreverse) r­Ú_hrefÚfinditerrÑÚ groupdictrrÈr Ú _clean_reÚsubr®r·)r9rårWr’r¿Úrelr*r,r,r-Úlinks+s 0 z Page.linksN)rBrCrDrEÚreÚcompileÚIÚSÚXrérârQrìrrïr,r,r,r-rá sû rács˜eZdZdZejdd„dd„dœZd‡fdd „ Zd d „Zd d „Z dd„Z e   de j ¡Zdd„Zdd„Zdd„Zdd„Zdd„Ze   d¡Zdd„Z‡ZS)ÚSimpleScrapingLocatorzã A locator which scrapes HTML pages to locate downloads for a distribution. This runs multiple threads to do the I/O; performance is at least as good as pip's PackageFinder, which works in an analogous fashion. cCstjt|ƒd ¡S)N)Úfileobj)ÚgzipÚGzipFilerrשÚbr,r,r-rçQr‹zSimpleScrapingLocator.cCs|Sr\r,rùr,r,r-rçRr‹)Údeflater÷ÚnoneNé c sptt|ƒjfi|¤Žt|ƒ|_||_i|_tƒ|_t   ¡|_ tƒ|_ d|_ ||_t ¡|_t ¡|_d|_dS)a¤ Initialise an instance. :param url: The root URL to use for scraping. :param timeout: The timeout, in seconds, to be applied to requests. This defaults to ``None`` (no timeout specified). :param num_workers: The number of worker threads you want to do I/O, This defaults to 10. :param kwargs: Passed to the superclass. FN)rÇrõrQrrÈr&Ú _page_cacher­Ú_seenr rOÚ _to_fetchÚ _bad_hostsÚskip_externalsÚ num_workersÚ threadingÚRLockÚ_lockÚ_gplockÚplatform_check)r9r*r&rrÊrËr,r-rQUs     zSimpleScrapingLocator.__init__cCsBg|_t|jƒD],}tj|jd}d|_| ¡|j |¡qdS)z¾ Threads are created only when get_project is called, and terminate before it returns. They are there primarily to parallelise I/O (i.e. fetching web pages). )ÚtargetTN) Ú_threadsÚrangerrÚThreadÚ_fetchÚdaemonÚstartrT)r9Úirtr,r,r-Ú_prepare_threadsps z&SimpleScrapingLocator._prepare_threadscCs6|jD]}|j d¡q|jD] }| ¡qg|_dS)zu Tell all the threads to terminate (by sending a sentinel value) and wait for them to do so. N)r rrÜr†)r9rtr,r,r-Ú _wait_threads}s    z#SimpleScrapingLocator._wait_threadsc Cs®iidœ}|jŠ||_||_t|jdt|ƒƒ}|j ¡|j ¡|  ¡z.t   d|¡|j   |¡|j  ¡W| ¡n | ¡0|`Wdƒn1s 0Y|S)Nr³z%s/z Queueing %s)rrWr€rrÈr rÿr]rþrrxryrrÜr†r)r9rgrWr*r,r,r-rhŠs      "z"SimpleScrapingLocator._get_projectz<\b(linux_(i\d86|x86_64|arm\w+)|win(32|_amd64)|macosx_?\d+)\bcCs |j |¡S)zD Does an URL refer to a platform-specific download? )Úplatform_dependentrã)r9r*r,r,r-Ú_is_platform_dependentŸsz,SimpleScrapingLocator._is_platform_dependentcCsn|jr| |¡rd}n| ||j¡}t d||¡|rj|j| |j|¡Wdƒn1s`0Y|S)a% See if an URL is a suitable download for a project. If it is, register information in the result dictionary (for _get_project) about the specific version it's for. Note that the return value isn't actually used other than as a boolean value. Nzprocess_download: %s -> %s) rrr¡r€rxryrr²rW)r9r*r¥r,r,r-Ú_process_download¥s ,z'SimpleScrapingLocator._process_downloadc CsÄt|ƒ\}}}}}}| |j|j|j¡r2d}n||jrJ| |j¡sJd}nd| |j¡s\d}nR|dvrjd}nD|dvrxd}n6| |¡rˆd}n&|  dd¡d} |   ¡dkrªd}nd}t   d ||||¡|S) z‘ Determine whether a link URL from a referring page and with a particular "rel" attribute should be queued for scraping. F)ZhomepageÚdownload)ÚhttprlÚftpú:rrÚ localhostTz#should_queue: %s (%s) from %s -> %s) rrprÂrÃrÄrrrÈrÚsplitrrxry) r9ÚlinkZreferrerrîr4rsroÚ_rWÚhostr,r,r-Ú _should_queue¹s&   z#SimpleScrapingLocator._should_queuec Cs|j ¡}zÞzš|r¤| |¡}|dur4WW|j ¡q|jD]h\}}||jvr:zB|j |¡| |¡sŒ| |||¡rŒt   d||¡|j  |¡Wq:t y Yq:0q:Wn4t yÚ}z|j  t|ƒ¡WYd}~n d}~00W|j ¡n |j ¡0|sqþqdS)z× Get a URL to fetch from the work queue, get the HTML page, examine its links for download candidates and candidates for further scraping. This is a handy method to run in a thread. NzQueueing %s from %s)rrSÚget_pagerVrïrÿr®rrrxryrÜrr•rPr)r9r*ÚpagerrîrXr,r,r-r Ôs,   ò    (zSimpleScrapingLocator._fetchc Cs|t|ƒ\}}}}}}|dkr:tj t|ƒ¡r:tt|ƒdƒ}||jvr`|j|}t  d||¡n|  dd¡d}d}||j vrt  d||¡nèt |d d id }zÈzàt  d |¡|j j||jd } t  d|¡|  ¡} |  dd¡} t | ¡r‚|  ¡} |  ¡} |  d¡}|r"|j|}|| ƒ} d}t | ¡}|r@| d¡}z|  |¡} Wntyl|  d¡} Yn0t| | ƒ}||j| <WnØtyÄ}z&|jdkr°t d||¡WYd}~n¢d}~0t y*}zNt d||¡|j!|j  "|¡Wdƒn1s 0YWYd}~nz Fetching %sr%z Fetched %sz Content-Typer2zContent-Encodingzutf-8zlatin-1i”zFetch failed: %s: %s)$rÚosroÚisdirrrrrþrxryrrrrMrÖr&r¥rSÚHTML_CONTENT_TYPEr’Úgeturlr×ÚdecodersÚCHARSETrãrärØÚ UnicodeErrorrárr<rÝrrr®r•)r9r*r4rsrorrWrr:rÞr>Ú content_typeZ final_urlrÑÚencodingÚdecoderr›rXr,r,r-r ôsZ              "@&zSimpleScrapingLocator.get_pagez]*>([^<]+)s  r1c@s eZdZdZdd„Zdd„ZdS)Ú JSONLocatora This locator uses special extended metadata (not available on PyPI) and is the basis of performant dependency resolution in distlib. Other locators require archive downloads before dependencies can be determined! As you might imagine, that can be slow. cCs tdƒ‚dSrÕrerZr,r,r-rj„sz"JSONLocator.get_distribution_namescCsÚiidœ}t|ƒ}|rÖ| dg¡D]²}|ddks"|ddkr@q"t|d|d| d d ¡|jd }|j}|d |_d |vr|d rd|d f|_| di¡|_| di¡|_|||j <|d  |j t ƒ¡  |d ¡q"|S)Nr³r:ÚptypeÚsdistZ pyversionÚsourcergrŒrÐzPlaceholder for summary)rÐr4r*rr¤Ú requirementsÚexportsr¨) rrSrr4rªr«rÚ dependenciesrArŒr¬r­r®)r9rgrWrÑr¥r°r±r,r,r-rhŠs(  ý   zJSONLocator._get_projectN)rBrCrDrErjrhr,r,r,r-r<|sr<cs(eZdZdZ‡fdd„Zdd„Z‡ZS)ÚDistPathLocatorz‚ This locator finds installed distributions in a path. It can be useful for adding to an :class:`AggregatingLocator`. c s.tt|ƒjfi|¤Žt|tƒs$J‚||_dS)zs Initialise an instance. :param distpath: A :class:`DistributionPath` instance to search. N)rÇrCrQÚ isinstancerÚdistpath)r9rErÊrËr,r-rQªszDistPathLocator.__init__cCsP|j |¡}|dur iidœ}n,|j|d|jt|jgƒid|jtdgƒii}|S)Nr³r¨r¢)rEÚget_distributionrŒr­r«)r9rgr°rWr,r,r-rh´s  ÿ ÿû zDistPathLocator._get_project)rBrCrDrErQrhrÓr,r,rËr-rC¤s rCcsReZdZdZ‡fdd„Z‡fdd„Zdd„Zeej j eƒZ dd „Z d d „Z ‡Z S) ÚAggregatingLocatorzI This class allows you to chain and/or merge a list of locators. cs.| dd¡|_||_tt|ƒjfi|¤ŽdS)aÏ Initialise an instance. :param locators: The list of locators to search. :param kwargs: Passed to the superclass constructor, except for: * merge - if False (the default), the first successful search from any of the locators is returned. If True, the results from all locators are merged (this can be slow). ÚmergeFN)r©rHÚlocatorsrÇrGrQ)r9rIrÊrËr,r-rQÊs zAggregatingLocator.__init__cs&tt|ƒ ¡|jD] }| ¡qdSr\)rÇrGr^rI©r9r¯rËr,r-r^Ús zAggregatingLocator.clear_cachecCs||_|jD] }||_q dSr\)r`rIr4)r9rbr¯r,r,r-rcßs zAggregatingLocator._set_schemec Csìi}|jD]Ü}| |¡}|r |jr¨| di¡}| di¡}| |¡| d¡}|rŠ|rŠ| ¡D]*\}} ||vr€||| O<q^| ||<q^| d¡} |ræ| ræ|  |¡q |jdur¸d} n"d} |D]}|j |¡rÀd} qÚqÀ| r |}qèq |S)Nr¨r¢TF)rIrkrHrSÚupdaterÛrNr’) r9rgrWr¯r¿r:r¢Zdfr¾r‰ÚddÚfoundr,r,r-rhæs8          zAggregatingLocator._get_projectc Cs:tƒ}|jD](}z|| ¡O}Wq ty2Yq 0q |SrÍ)r­rIrjrf)r9rWr¯r,r,r-rjs  z)AggregatingLocator.get_distribution_names)rBrCrDrErQr^rcrÅrIr4ÚfgetrhrjrÓr,r,rËr-rGÅs  ,rGzhttps://pypi.org/simple/r$r%Úlegacyr§c@sLeZdZdZddd„Zdd„Zdd„Zd d „Zd d „Zd d„Z ddd„Z dS)ÚDependencyFinderz0 Locate dependencies for distributions. NcCs|pt|_t|jjƒ|_dS)zf Initialise an instance, using the specified locator to locate distributions. N)Údefault_locatorr¯r r4rJr,r,r-rQ.s zDependencyFinder.__init__cCsrt d|¡|j}||j|<||j||jf<|jD]:}t|ƒ\}}t d|||¡|j  |t ƒ¡  ||f¡q2dS)z¨ Add a distribution to the finder. This will update internal information about who provides what. :param dist: The distribution to add. zadding distribution %szAdd to provided: %s, %s, %sN) rxryr@Ú dists_by_nameÚdistsrŒÚprovidesrÚprovidedr¬r­r®)r9r°rgÚprŒr,r,r-Úadd_distribution6s    z!DependencyFinder.add_distributioncCsxt d|¡|j}|j|=|j||jf=|jD]D}t|ƒ\}}t d|||¡|j|}|  ||f¡|s.|j|=q.dS)z° Remove a distribution from the finder. This will update internal information about who provides what. :param dist: The distribution to remove. zremoving distribution %sz Remove from provided: %s, %s, %sN) rxryr@rRrSrŒrTrrUÚremove)r9r°rgrVrŒÚsr,r,r-Úremove_distributionEs    z$DependencyFinder.remove_distributioncCs@z|j |¡}Wn*ty:| ¡d}|j |¡}Yn0|S)zÞ Get a version matcher for a requirement. :param reqt: The requirement :type reqt: str :return: A version matcher (an instance of :class:`distlib.version.Matcher`). r)r4rNr!r)r9ÚreqtrNrgr,r,r-Ú get_matcherWs   zDependencyFinder.get_matcherc Csr| |¡}|j}tƒ}|j}||vrn||D]@\}}z| |¡}WntyXd}Yn0|r,| |¡qnq,|S)zÓ Find the distributions which can fulfill a requirement. :param reqt: The requirement. :type reqt: str :return: A set of distribution which can fulfill the requirement. F)r\r@r­rUr’r!r®) r9r[rNrgrWrUrŒÚproviderr’r,r,r-Úfind_providersgs    zDependencyFinder.find_providersc Csž|j|}tƒ}|D]$}| |¡}| |j¡s| |¡q|rZ| d||t|ƒf¡d}n@| |¡|j|=|D]}|j |tƒ¡ |¡qp|  |¡d}|S)aŠ Attempt to replace one provider with another. This is typically used when resolving dependencies from multiple sources, e.g. A requires (B >= 1.0) while C requires (B >= 1.1). For successful replacement, ``provider`` must meet all the requirements which ``other`` fulfills. :param provider: The provider we are trying to replace with. :param other: The provider we're trying to replace. :param problems: If False is returned, this will contain what problems prevented replacement. This is currently a tuple of the literal string 'cantreplace', ``provider``, ``other`` and the set of requirements that ``provider`` couldn't fulfill. :return: True if we can replace ``other`` with ``provider``, else False. Z cantreplaceFT) Úreqtsr­r\r’rŒr®Ú frozensetrZr¬rW) r9r]ÚotherÚproblemsZrlistÚ unmatchedrYrNrWr,r,r-Útry_to_replaces       zDependencyFinder.try_to_replaceFcCsði|_i|_i|_i|_t|p gƒ}d|vrF| d¡|tgd¢ƒO}t|tƒrf|}}t  d|¡n4|j j ||d}}|durŽt d|ƒ‚t  d|¡d|_ tƒ}t|gƒ}t|gƒ}|r¢| ¡}|j} | |jvrä| |¡n"|j| } | |kr| || |¡|j|jB} |j} tƒ} |r^||vr^d D]*}d |}||vr2| t|d |ƒO} q2| | B| B}|D].}| |¡}|sDt  d |¡|j j ||d}|durÀ|sÀ|j j |dd}|duræt  d |¡| d|f¡n^|j|j}}||f|jvr| |¡| |¡|| vrD||vrD| |¡t  d|j¡|D]R}|j} | |jvrv|j |tƒ¡ |¡n"|j| } | |krH| || |¡qHqnqºt|j ¡ƒ}|D]&}||v|_|jr´t  d|j¡q´t  d|¡||fS)aŽ Find a distribution and all distributions it depends on. :param requirement: The requirement specifying the distribution to find, or a Distribution instance. :param meta_extras: A list of meta extras such as :test:, :build: and so on. :param prereleases: If ``True``, allow pre-release versions to be returned - otherwise, don't return prereleases unless they're all that's available. Return a set of :class:`Distribution` instances and a set of problems. The distributions returned should be such that they have the :attr:`required` attribute set to ``True`` if they were from the ``requirement`` passed to ``find()``, and they have the :attr:`build_time_dependency` attribute set to ``True`` unless they are post-installation dependencies of the ``requirement``. The problems should be a tuple consisting of the string ``'unsatisfied'`` and the requirement which couldn't be satisfied by any distribution known to the locator. z:*:)z:test:z:build:z:dev:zpassed %s as requirement)rºNzUnable to locate %rz located %sT)ÚtestÚbuildÚdevz:%s:z %s_requireszNo providers found for %rzCannot satisfy %rZ unsatisfiedzAdding %s to install_distsz#%s is a build-time dependency only.zfind done for %s)rUrSrRr_r­rXrDrrxryr¯rÁrÚ requestedr©r@rWrdZ run_requiresZ meta_requiresZbuild_requiresÚgetattrr^r®rŒZname_and_versionr¬ÚvaluesZbuild_time_dependency)r9r´Z meta_extrasrºr°ràrbÚtodoZ install_distsrgraZireqtsZsreqtsZereqtsr@rXZ all_reqtsr»Ú providersr]Únr‰rVrSr,r,r-Úfind¦s†                           zDependencyFinder.find)N)NF) rBrCrDrErQrWrZr\r^rdrnr,r,r,r-rP)s 'rP)N)Lr÷ÚiorrÙÚloggingr$rmrðrÚ ImportErrorZdummy_threadingr/r2rÚcompatrrrrr r r r r rr7rrrrZdatabaserrrrªrrÚutilrrrrrrrrrŒr r!ržr"r#Ú getLoggerrBrxrñr‘ròr)r&r(r.r/ÚobjectrIrÆrÔrárõr1r<rCrGrQrÁrPr,r,r,r-ÚsV    @(     ?2H:x>(!\ ý