[c@`sdZddlmZmZmZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddlZddlZddlmZmZmZddlmZddlmZmZmZer,ddljZddlmZddlm Z m!Z!m"Z"m#Z#nHddlZddl$mZdd l%m Z dd l!m!Z!m"Z"m#Z#eydd l&m'Z'Wn-e(k rd e)fd YZ*e*Z'nXyddl+Z+Wne(k rnXe j,dZ-de.fdYZ/e/dZ0dej1fdYZ2de3fdYZ4de)fdYZ5de)fdYZ6de3fdYZ7de3fdYZ8de3fdYZ9d Z:d!efd"YZ;d#Z<d$Z=d%Z>dd&Z@d'ZAd(ZBejCd)d*d+d,gZDd-ZEejCd.d,d/d0gZFd1ZGd2ZHd3ZId4ZJd5ZKd6ZLd7ZMd8ZNe j,d9ZOe j,d:ZPd;jQZRd<ZSd=ZTdS(>sHTTP utility code shared by clients and servers. This module also defines the `HTTPServerRequest` class which is exposed via `tornado.web.RequestHandler.request`. i(tabsolute_importtdivisiontprint_functionN(t native_strtparse_qs_bytestutf8(tgen_log(t ObjectDicttPY3t unicode_type(t responses(t urlencodeturlparset urlunparset parse_qsl(R (R R R(tSSLErrort _SSLErrorcB`seZRS((t__name__t __module__(((s/lib/python2.7/site-packages/tornado/httputil.pyR:ss\r?\nt_NormalizedHeaderCachecB`s eZdZdZdZRS(sKDynamic cached mapping of header names to Http-Header-Case. Implemented as a dict subclass so that cache hits are as fast as a normal dict lookup, without the overhead of a python function call. >>> normalized_headers = _NormalizedHeaderCache(10) >>> normalized_headers["coNtent-TYPE"] 'Content-Type' cC`s/tt|j||_tj|_dS(N(tsuperRt__init__tsizet collectionstdequetqueue(tselfR((s/lib/python2.7/site-packages/tornado/httputil.pyRVs cC`sdjg|jdD]}|j^q}|||<|jj|t|j|jkr||jj}||=n|S(Nt-(tjointsplitt capitalizeRtappendtlenRtpopleft(Rtkeytwt normalizedtold_key((s/lib/python2.7/site-packages/tornado/httputil.pyt __missing__[s1  (RRt__doc__RR&(((s/lib/python2.7/site-packages/tornado/httputil.pyRKs  it HTTPHeaderscB`seZdZdZdZdZdZdZedZ dZ dZ d Z d Z d Zd ZeZd ZeZRS(sA dictionary that maintains ``Http-Header-Case`` for all keys. Supports multiple values per key via a pair of new methods, `add()` and `get_list()`. The regular dictionary interface returns a single value per key, with multiple values joined by a comma. >>> h = HTTPHeaders({"content-type": "text/html"}) >>> list(h.keys()) ['Content-Type'] >>> h["Content-Type"] 'text/html' >>> h.add("Set-Cookie", "A=B") >>> h.add("Set-Cookie", "C=D") >>> h["set-cookie"] 'A=B,C=D' >>> h.get_list("set-cookie") ['A=B', 'C=D'] >>> for (k,v) in sorted(h.get_all()): ... print('%s: %s' % (k,v)) ... Content-Type: text/html Set-Cookie: A=B Set-Cookie: C=D cO`si|_i|_d|_t|dkrt|dkrt|dtrxA|djD]\}}|j||qcWn|j ||dS(Nii( t_dictt_as_listtNonet _last_keyR t isinstanceR(tget_alltaddtupdate(Rtargstkwargstktv((s/lib/python2.7/site-packages/tornado/httputil.pyRs   $cC`sit|}||_||kr[t||dt||j|<|j|j|n |||>> h = HTTPHeaders() >>> h.parse_line("Content-Type: text/html") >>> h.get('content-type') 'text/html' is.first header line cannot start with whitespacet it:isno colon in header lineN( tisspaceR,R+tHTTPInputErrortlstripR*R)Rt ValueErrorR/tstrip(Rtlinetnew_partR7R8((s/lib/python2.7/site-packages/tornado/httputil.pyt parse_lines cC`s=|}x-tj|D]}|r|j|qqW|S(sReturns a dictionary from HTTP header text. >>> h = HTTPHeaders.parse("Content-Type: text/html\r\nContent-Length: 42\r\n") >>> sorted(h.items()) [('Content-Length', '42'), ('Content-Type', 'text/html')] .. versionchanged:: 5.1 Raises `HTTPInputError` on malformed headers instead of a mix of `KeyError`, and `ValueError`. (t_CRLF_RERRG(tclstheadersthRE((s/lib/python2.7/site-packages/tornado/httputil.pytparses  cC`s+t|}||j|<|g|j|supports_http_1_1() is deprecated, use request.version insteadsHTTP/1.1(twarningstwarntDeprecationWarningRd(R((s/lib/python2.7/site-packages/tornado/httputil.pytsupports_http_1_1}s cC`st|dstj|_d|jkryt|jd}Wntk rWqXxB|jD]1\}}y||j|Returns the client's SSL certificate, if any. To use client certificates, the HTTPServer's `ssl.SSLContext.verify_mode` field must be set, e.g.:: ssl_ctx = ssl.create_default_context(ssl.Purpose.CLIENT_AUTH) ssl_ctx.load_cert_chain("foo.crt", "foo.key") ssl_ctx.load_verify_locations("cacerts.pem") ssl_ctx.verify_mode = ssl.CERT_REQUIRED server = HTTPServer(app, ssl_options=ssl_ctx) By default, the return value is a dictionary (or None, if no client certificate is present). If ``binary_form`` is true, a DER-encoded form of the certificate is returned instead. See SSLSocket.getpeercert() in the standard library for more details. http://docs.python.org/library/ssl.html#sslsocket-objects t binary_formN(Rltstreamtsockett getpeercertRR+(RR((s/lib/python2.7/site-packages/tornado/httputil.pytget_ssl_certificates   cC`sqt|jjdd|j|j|j|jx9|jjD](\}}|jj|gj |qAWdS(Ns Content-TypeRT( tparse_body_argumentsRJR:ReRxRkR<Rut setdefaulttextend(RR3R4((s/lib/python2.7/site-packages/tornado/httputil.pyt _parse_bodys   cC`sOd }djg|D]}d|t||f^q}d |jj|fS( NR]RgRbRcRdR\s, s%s=%rs%s(%s)(R]RgRbRcRdR\(RRft __class__R(RtattrstnR1((s/lib/python2.7/site-packages/tornado/httputil.pyt__repr__s5N(RRR'R+RR~tpropertyRRRRRtFalseRRR(((s/lib/python2.7/site-packages/tornado/httputil.pyRZs[        RAcB`seZdZRS(sqException class for malformed HTTP requests or responses from remote sources. .. versionadded:: 4.0 (RRR'(((s/lib/python2.7/site-packages/tornado/httputil.pyRAstHTTPOutputErrorcB`seZdZRS(sJException class for errors in HTTP output. .. versionadded:: 4.0 (RRR'(((s/lib/python2.7/site-packages/tornado/httputil.pyRstHTTPServerConnectionDelegatecB`s eZdZdZdZRS(s_Implement this interface to handle requests from `.HTTPServer`. .. versionadded:: 4.0 cC`s tdS(sjThis method is called by the server when a new request has started. :arg server_conn: is an opaque object representing the long-lived (e.g. tcp-level) connection. :arg request_conn: is a `.HTTPConnection` object for a single request/response exchange. This method should return a `.HTTPMessageDelegate`. N(tNotImplementedError(Rt server_connt request_conn((s/lib/python2.7/site-packages/tornado/httputil.pyt start_requests cC`sdS(sThis method is called when a connection has been closed. :arg server_conn: is a server connection that has previously been passed to ``start_request``. N((RR((s/lib/python2.7/site-packages/tornado/httputil.pyton_closes(RRR'RR(((s/lib/python2.7/site-packages/tornado/httputil.pyRs tHTTPMessageDelegatecB`s2eZdZdZdZdZdZRS(s_Implement this interface to handle an HTTP request or response. .. versionadded:: 4.0 cC`sdS(sCalled when the HTTP headers have been received and parsed. :arg start_line: a `.RequestStartLine` or `.ResponseStartLine` depending on whether this is a client or server message. :arg headers: a `.HTTPHeaders` instance. Some `.HTTPConnection` methods can only be called during ``headers_received``. May return a `.Future`; if it does the body will not be read until it is done. N((RRyRJ((s/lib/python2.7/site-packages/tornado/httputil.pytheaders_receiveds cC`sdS(siCalled when a chunk of data has been received. May return a `.Future` for flow control. N((RR((s/lib/python2.7/site-packages/tornado/httputil.pyt data_received-scC`sdS(s6Called after the last chunk of data has been received.N((R((s/lib/python2.7/site-packages/tornado/httputil.pyR4scC`sdS(sCalled if the connection is closed without finishing the request. If ``headers_received`` is called, either ``finish`` or ``on_connection_close`` will be called, but not both. N((R((s/lib/python2.7/site-packages/tornado/httputil.pyton_connection_close8s(RRR'RRRR(((s/lib/python2.7/site-packages/tornado/httputil.pyRs    tHTTPConnectioncB`s2eZdZdddZddZdZRS(sYApplications use this interface to write their responses. .. versionadded:: 4.0 cC`s tdS(sWrite an HTTP header block. :arg start_line: a `.RequestStartLine` or `.ResponseStartLine`. :arg headers: a `.HTTPHeaders` instance. :arg chunk: the first (optional) chunk of data. This is an optimization so that small responses can be written in the same call as their headers. :arg callback: a callback to be run when the write is complete. The ``version`` field of ``start_line`` is ignored. Returns a `.Future` if no callback is given. .. deprecated:: 5.1 The ``callback`` argument is deprecated and will be removed in Tornado 6.0. N(R(RRyRJRR((s/lib/python2.7/site-packages/tornado/httputil.pyt write_headersFscC`s tdS(sWrites a chunk of body data. The callback will be run when the write is complete. If no callback is given, returns a Future. .. deprecated:: 5.1 The ``callback`` argument is deprecated and will be removed in Tornado 6.0. N(R(RRR((s/lib/python2.7/site-packages/tornado/httputil.pyR[s cC`s tdS(s<Indicates that the last body data has been written. N(R(R((s/lib/python2.7/site-packages/tornado/httputil.pyRhsN(RRR'R+RRR(((s/lib/python2.7/site-packages/tornado/httputil.pyRAs cC`s|dkr|St|}t|trVt|jdt}|j|jndt|t stt|t rt|jdt}|j|n!dj t |}t |t|}t|d|d|d|d||df}|S( sConcatenate url and arguments regardless of whether url has existing query parameters. ``args`` may be either a dictionary or a list of key-value pairs (the latter allows for multiple values with the same key. >>> url_concat("http://example.com/foo", dict(c="d")) 'http://example.com/foo?c=d' >>> url_concat("http://example.com/foo?a=b", dict(c="d")) 'http://example.com/foo?a=b&c=d' >>> url_concat("http://example.com/foo?a=b", [("c", "d"), ("c", "d2")]) 'http://example.com/foo?a=b&c=d&c=d2' Ras7'args' parameter should be dict, list or tuple. Not {0}iiiiiN(R+R R-tdictRRsRtRR<tlistttupletformatttypet TypeErrorR R (turlR1t parsed_urlt parsed_queryterrt final_query((s/lib/python2.7/site-packages/tornado/httputil.pyt url_concatns*    tHTTPFilecB`seZdZRS(sRepresents a file uploaded via a form. For backwards compatibility, its instance attributes are also accessible as dictionary keys. * ``filename`` * ``body`` * ``content_type`` (RRR'(((s/lib/python2.7/site-packages/tornado/httputil.pyRs cC`s|jd\}}}|j|j}}|dkrAdS|jd\}}}yt|}t|}Wntk rdSX|dk r|dkr|dkr| }d}qq|d7}n||fS(sgParses a Range header. Returns either ``None`` or tuple ``(start, end)``. Note that while the HTTP headers use inclusive byte positions, this method returns indexes suitable for use in slices. >>> start, end = _parse_request_range("bytes=1-2") >>> start, end (1, 3) >>> [0, 1, 2, 3, 4][start:end] [1, 2] >>> _parse_request_range("bytes=6-") (6, None) >>> _parse_request_range("bytes=-6") (-6, None) >>> _parse_request_range("bytes=-0") (None, 0) >>> _parse_request_range("bytes=") (None, None) >>> _parse_request_range("foo=42") >>> _parse_request_range("bytes=1-2,6-10") Note: only supports one range (ex, ``bytes=1-2,6-10`` is not allowed). See [0] for the details of the range header. [0]: http://greenbytes.de/tech/webdav/draft-ietf-httpbis-p5-range-latest.html#byte.ranges t=RRiiN(RqRDR+t _int_or_noneRC(t range_headertunitt_R8tstart_btend_btstarttend((s/lib/python2.7/site-packages/tornado/httputil.pyt_parse_request_ranges"        cC`s-|p d}|p|d}d|||fS(sReturns a suitable Content-Range header: >>> print(_get_content_range(None, 1, 4)) bytes 0-0/4 >>> print(_get_content_range(1, 3, 4)) bytes 1-2/4 >>> print(_get_content_range(None, None, 4)) bytes 0-3/4 iisbytes %s-%s/%s((RRttotal((s/lib/python2.7/site-packages/tornado/httputil.pyt_get_content_ranges cC`s&|j}|dkrdSt|S(NRT(RDR+tint(tval((s/lib/python2.7/site-packages/tornado/httputil.pyRs  cC`s||r*d|kr*tjd|ddS|jdrytt|dt}Wn)tk r}tjd|i}nXx|jD].\}}|r|j|gj |qqWn|jdrxy}|j d} xg| D]S} | j j d \} } } | d kr| rt t| |||PqqWtd Wqxtk rt}tjd |qxXndS( sFParses a form request body. Supports ``application/x-www-form-urlencoded`` and ``multipart/form-data``. The ``content_type`` parameter should be a string and ``body`` should be a byte string. The ``arguments`` and ``files`` parameters are dictionaries that will be updated with the parsed contents. sContent-Encodings Unsupported Content-Encoding: %sNs!application/x-www-form-urlencodedRas&Invalid x-www-form-urlencoded body: %ssmultipart/form-datat;Rtboundarysmultipart boundary not foundsInvalid multipart/form-data: %s(RtwarningRRRRtRR<RRRRDRqtparse_multipart_form_dataRRC(t content_typeReRuRkRJt uri_argumentsteR7R=tfieldstfieldR3RzR4((s/lib/python2.7/site-packages/tornado/httputil.pyRs0    # c C`s|jdr.|jdr.|dd!}n|jd|d}|dkrbtjddS|| jd|d}xc|D][}|sqn|jd}|dkrtjd qntj|| j d }|j d d } t | \} } | d ks |jd r3tjdqn||dd!} | j dsftjdqn| d} | j dr|j dd}|j | gj td| dd| d|q|j | gj | qWdS(s]Parses a ``multipart/form-data`` body. The ``boundary`` and ``data`` parameters are both byte strings. The dictionaries given in the arguments and files parameters will be updated with the contents of the body. .. versionchanged:: 5.1 Now recognizes non-ASCII filenames in RFC 2231/5987 (``filename*=``) format. t"iis--s.Invalid multipart/form-data: no final boundaryNs s s#multipart/form-data missing headerssutf-8sContent-DispositionRTs form-datasInvalid multipart/form-dataiiR7s&multipart/form-data value missing nametfilenames Content-Typesapplication/unknownReR(RtendswithtrfindRRRtfindR(RLtdecodeR:t _parse_headerRRR(RtdataRuRktfinal_boundary_indextpartstpartteohRJt disp_headert dispositiont disp_paramsR8R7tctype((s/lib/python2.7/site-packages/tornado/httputil.pyR s>         cC`st|tjrndt|ttjfr?tj|}n:t|tjritj|j }nt d|t j j |dtS(sFormats a timestamp in the format used by HTTP. The argument may be a numeric timestamp as returned by `time.time`, a time tuple as returned by `time.gmtime`, or a `datetime.datetime` object. >>> format_timestamp(1359312200) 'Sun, 27 Jan 2013 18:43:20 GMT' sunknown timestamp type: %rtusegmt(R-tnumberstRealRRnt struct_timetcalendarttimegmtdatetimet utctimetupleRtemailtutilst formatdateRt(tts((s/lib/python2.7/site-packages/tornado/httputil.pytformat_timestamp?s tRequestStartLineRbRrRdcC`sqy|jd\}}}Wntk r;tdnXtjd|satd|nt|||S(sReturns a (method, path, version) tuple for an HTTP 1.x request line. The response is a `collections.namedtuple`. >>> parse_request_start_line("GET /foo HTTP/1.1") RequestStartLine(method='GET', path='/foo', version='HTTP/1.1') R>sMalformed HTTP request lines^HTTP/1\.[0-9]$s/Malformed HTTP version in HTTP Request-Line: %r(RRCRAtretmatchR(RERbRrRd((s/lib/python2.7/site-packages/tornado/httputil.pytparse_request_start_lineXs tResponseStartLinetcodetreasoncC`sdt|}tjd|}|s3tdnt|jdt|jd|jdS(sReturns a (version, code, reason) tuple for an HTTP 1.x response line. The response is a `collections.namedtuple`. >>> parse_response_start_line("HTTP/1.1 200 OK") ResponseStartLine(version='HTTP/1.1', code=200, reason='OK') s(HTTP/1.[0-9]) ([0-9]+) ([^ ]*)s!Error parsing response start lineiii(RRRRARtgroupR(RER((s/lib/python2.7/site-packages/tornado/httputil.pytparse_response_start_lineps  !cc`sx|d dkr|d}|jd}xR|dkr|jdd||jdd|dr|jd|d}q/W|dkrt|}n|| }|jV||}qWdS(NiRiRs\"i(RtcountR RD(tsRtf((s/lib/python2.7/site-packages/tornado/httputil.pyt _parseparams ;   c C`s;td|}t|}d g}xo|D]g}|jd}|dkr,|| jj}||dj}|j|t|fq,q,Wtjj |}|j di}xr|D]j\}}tjj |}t |dkr#|ddkr#|d dkr#|dd !}n|||>> d = "form-data; foo=\"b\\\\a\\\"r\"; file*=utf-8''T%C3%A4st" >>> ct, d = _parse_header(d) >>> ct 'form-data' >>> d['file'] == r'T\u00e4st'.encode('ascii').decode('unicode_escape') True >>> d['foo'] 'b\\a"r' RtDummyR8RiiiRi(RR8( RtnextRRDRiRRRRt decode_paramstpoptcollapse_rfc2231_valueR ( RERR"tparamstptiR7R8tpdict((s/lib/python2.7/site-packages/tornado/httputil.pyRs$      2cC`sv|s |S|g}xSt|jD]?\}}|dkrN|j|q&|jd||fq&Wdj|S(sInverse of _parse_header. >>> _encode_header('permessage-deflate', ... {'client_max_window_bits': 15, 'client_no_context_takeover': None}) 'permessage-deflate; client_max_window_bits=15; client_no_context_takeover' s%s=%ss; N(tsortedR<R+RR(R"RtoutR3R4((s/lib/python2.7/site-packages/tornado/httputil.pyt_encode_headers  cC`s`t|tr$tjd|}nt|trHtjd|}nt|dt|S(sEncodes a username/password pair in the format used by HTTP auth. The return value is a byte string in the form ``username:password``. .. versionadded:: 5.1 tNFCR?(R-R t unicodedatat normalizeR(tusernametpassword((s/lib/python2.7/site-packages/tornado/httputil.pytencode_username_passwords cC`sddl}|jS(Ni(tdoctestt DocTestSuite(R ((s/lib/python2.7/site-packages/tornado/httputil.pytdoctestss cC`sUtjd|}|r?|jd}t|jd}n |}d}||fS(sReturns ``(host, port)`` tuple from ``netloc``. Returned ``port`` will be ``None`` if not present. .. versionadded:: 4.1 s ^(.+):(\d+)$iiN(RRRRR+(tnetlocRRgtport((s/lib/python2.7/site-packages/tornado/httputil.pyRhscc`s=x6|jD](\}}x|D]}||fVq Wq WdS(sgGenerator converting a result of ``parse_qs`` back to name-value pairs. .. versionadded:: 5.0 N(R<(tqsR3tvsR4((s/lib/python2.7/site-packages/tornado/httputil.pyt qs_to_qsls s\\[0-3][0-7][0-7]s[\\].RTcC`s|dkst|dkr"|S|ddksB|ddkrF|S|dd!}d}t|}g}x9d|ko|knrtj||}tj||}| r| r|j||Pnd}}|r|jd}n|r |jd}n|rZ| s$||krZ|j|||!|j||d|d}qn|j|||!|jtt||d|d!d|d}qnWt |S( sHandle double quotes and escaping in cookie values. This method is copied verbatim from the Python 3.5 standard library (http.cookies._unquote) so we don't have to depend on non-public interfaces. iiRiiiiN( R+R t _OctalPatttsearcht _QuotePattRRtchrRt _nulljoin(tstrRRtresto_matchtq_matchtjR3((s/lib/python2.7/site-packages/tornado/httputil.pyt_unquote_cookies6      +cC`si}x|jtdD]}td|krU|jtdd\}}ntd|}}|j|j}}|s|rt|||s          %      (- & 1   $ 3    #       2