σ ¨œž[c@`sdZddlmZmZmZddlZddlZddlmZm Z ddl m Z m Z ddl mZddd d d gZd efd „ƒYZd efd „ƒYZd„Zdefd„ƒYZdefd„ƒYZdefd„ƒYZd efd„ƒYZdS(sΖAsynchronous queues for coroutines. These classes are very similar to those provided in the standard library's `asyncio package `_. .. warning:: Unlike the standard library's `queue` module, the classes defined here are *not* thread-safe. To use these queues from another thread, use `.IOLoop.add_callback` to transfer control to the `.IOLoop` thread before calling any queue methods. i(tabsolute_importtdivisiontprint_functionN(tgentioloop(tFuturet"future_set_result_unless_cancelled(tEventtQueuet PriorityQueuet LifoQueuet QueueFullt QueueEmptycB`seZdZRS(s:Raised by `.Queue.get_nowait` when the queue has no items.(t__name__t __module__t__doc__(((s-lib/python2.7/site-packages/tornado/queues.pyR (scB`seZdZRS(sBRaised by `.Queue.put_nowait` when a queue is at its maximum size.(R RR(((s-lib/python2.7/site-packages/tornado/queues.pyR -sc`sV|rR‡fd†}tjjƒ‰ˆj||ƒ‰ˆj‡‡fd†ƒndS(Nc`s&ˆjƒs"ˆjtjƒƒndS(N(tdonet set_exceptionRt TimeoutError((tfuture(s-lib/python2.7/site-packages/tornado/queues.pyt on_timeout4s c`s ˆjˆƒS(N(tremove_timeout(t_(tio_loopttimeout_handle(s-lib/python2.7/site-packages/tornado/queues.pyt:s(RtIOLooptcurrentt add_timeouttadd_done_callback(RttimeoutR((RRRs-lib/python2.7/site-packages/tornado/queues.pyt _set_timeout2s t_QueueIteratorcB`seZd„Zd„ZRS(cC`s ||_dS(N(tq(tselfR!((s-lib/python2.7/site-packages/tornado/queues.pyt__init__>scC`s |jjƒS(N(R!tget(R"((s-lib/python2.7/site-packages/tornado/queues.pyt __anext__As(R RR#R%(((s-lib/python2.7/site-packages/tornado/queues.pyR =s cB`sΤeZdZdd„Zed„ƒZd„Zd„Zd„Zdd„Z d„Z dd „Z d „Z d „Zdd „Zd „Zd„Zd„Zd„Zd„Zd„Zd„Zd„Zd„ZRS(sΆCoordinate producer and consumer coroutines. If maxsize is 0 (the default) the queue size is unbounded. .. testcode:: from tornado import gen from tornado.ioloop import IOLoop from tornado.queues import Queue q = Queue(maxsize=2) async def consumer(): async for item in q: try: print('Doing work on %s' % item) await gen.sleep(0.01) finally: q.task_done() async def producer(): for item in range(5): await q.put(item) print('Put %s' % item) async def main(): # Start consumer without waiting (since it never finishes). IOLoop.current().spawn_callback(consumer) await producer() # Wait for producer to put all tasks. await q.join() # Wait for consumer to finish all tasks. print('Done') IOLoop.current().run_sync(main) .. testoutput:: Put 0 Put 1 Doing work on 0 Put 2 Doing work on 1 Put 3 Doing work on 2 Put 4 Doing work on 3 Doing work on 4 Done In versions of Python without native coroutines (before 3.5), ``consumer()`` could be written as:: @gen.coroutine def consumer(): while True: item = yield q.get() try: print('Doing work on %s' % item) yield gen.sleep(0.01) finally: q.task_done() .. versionchanged:: 4.3 Added ``async for`` support in Python 3.5. icC`s“|dkrtdƒ‚n|dkr6tdƒ‚n||_|jƒtjgƒ|_tjgƒ|_d|_ t ƒ|_ |j j ƒdS(Nsmaxsize can't be Noneismaxsize can't be negative( tNonet TypeErrort ValueErrort_maxsizet_initt collectionstdequet_getterst_putterst_unfinished_tasksRt _finishedtset(R"tmaxsize((s-lib/python2.7/site-packages/tornado/queues.pyR#ˆs      cC`s|jS(s%Number of items allowed in the queue.(R)(R"((s-lib/python2.7/site-packages/tornado/queues.pyR2—scC`s t|jƒS(sNumber of items in the queue.(tlent_queue(R"((s-lib/python2.7/site-packages/tornado/queues.pytqsizeœscC`s|j S(N(R4(R"((s-lib/python2.7/site-packages/tornado/queues.pytempty scC`s*|jdkrtS|jƒ|jkSdS(Ni(R2tFalseR5(R"((s-lib/python2.7/site-packages/tornado/queues.pytfull£scC`sbtƒ}y|j|ƒWn4tk rP|jj||fƒt||ƒnX|jdƒ|S(sŒPut an item into the queue, perhaps waiting until there is room. Returns a Future, which raises `tornado.util.TimeoutError` after a timeout. ``timeout`` may be a number denoting a time (on the same scale as `tornado.ioloop.IOLoop.time`, normally `time.time`), or a `datetime.timedelta` object for a deadline relative to the current time. N(Rt put_nowaitR R.tappendRt set_resultR&(R"titemRR((s-lib/python2.7/site-packages/tornado/queues.pytput©s   cC`sƒ|jƒ|jr]|jƒs+tdƒ‚|jjƒ}|j|ƒt||jƒƒn"|jƒrrt ‚n |j|ƒdS(s{Put an item into the queue without blocking. If no free slot is immediately available, raise `QueueFull`. s)queue non-empty, why are getters waiting?N( t_consume_expiredR-R6tAssertionErrortpopleftt_Queue__put_internalRt_getR8R (R"R<tgetter((s-lib/python2.7/site-packages/tornado/queues.pyR9Ύs     cC`sUtƒ}y|j|jƒƒWn.tk rP|jj|ƒt||ƒnX|S(s›Remove and return an item from the queue. Returns a Future which resolves once an item is available, or raises `tornado.util.TimeoutError` after a timeout. ``timeout`` may be a number denoting a time (on the same scale as `tornado.ioloop.IOLoop.time`, normally `time.time`), or a `datetime.timedelta` object for a deadline relative to the current time. (RR;t get_nowaitR R-R:R(R"RR((s-lib/python2.7/site-packages/tornado/queues.pyR$Ξs  cC`s„|jƒ|jrd|jƒs+tdƒ‚|jjƒ\}}|j|ƒt|dƒ|jƒS|j ƒrz|jƒSt ‚dS(sRemove and return an item from the queue without blocking. Return an item if one is immediately available, else raise `QueueEmpty`. s(queue not full, why are putters waiting?N( R>R.R8R?R@RARR&RBR5R (R"R<tputter((s-lib/python2.7/site-packages/tornado/queues.pyRDαs       cC`sP|jdkrtdƒ‚n|jd8_|jdkrL|jjƒndS(sΕIndicate that a formerly enqueued task is complete. Used by queue consumers. For each `.get` used to fetch a task, a subsequent call to `.task_done` tells the queue that the processing on the task is complete. If a `.join` is blocking, it resumes when all items have been processed; that is, when every `.put` is matched by a `.task_done`. Raises `ValueError` if called more times than `.put`. is!task_done() called too many timesiN(R/R(R0R1(R"((s-lib/python2.7/site-packages/tornado/queues.pyt task_doneσs cC`s|jj|ƒS(s—Block until all items in the queue are processed. Returns a Future, which raises `tornado.util.TimeoutError` after a timeout. (R0twait(R"R((s-lib/python2.7/site-packages/tornado/queues.pytjoinscC`s t|ƒS(N(R (R"((s-lib/python2.7/site-packages/tornado/queues.pyt __aiter__ scC`stjƒ|_dS(N(R+R,R4(R"((s-lib/python2.7/site-packages/tornado/queues.pyR*scC`s |jjƒS(N(R4R@(R"((s-lib/python2.7/site-packages/tornado/queues.pyRBscC`s|jj|ƒdS(N(R4R:(R"R<((s-lib/python2.7/site-packages/tornado/queues.pyt_putscC`s-|jd7_|jjƒ|j|ƒdS(Ni(R/R0tclearRJ(R"R<((s-lib/python2.7/site-packages/tornado/queues.pyt__put_internals cC`shx1|jr3|jddjƒr3|jjƒqWx-|jrc|jdjƒrc|jjƒq7WdS(Nii(R.RR@R-(R"((s-lib/python2.7/site-packages/tornado/queues.pyR> s#cC`s,dt|ƒjtt|ƒƒ|jƒfS(Ns <%s at %s %s>(ttypeR thextidt_format(R"((s-lib/python2.7/site-packages/tornado/queues.pyt__repr__(scC`sdt|ƒj|jƒfS(Ns<%s %s>(RMR RP(R"((s-lib/python2.7/site-packages/tornado/queues.pyt__str__,scC`sd|jf}t|ddƒr6|d|j7}n|jrY|dt|jƒ7}n|jr||dt|jƒ7}n|jr™|d|j7}n|S(Ns maxsize=%rR4s queue=%rs getters[%s]s putters[%s]s tasks=%s(R2tgetattrR&R4R-R3R.R/(R"tresult((s-lib/python2.7/site-packages/tornado/queues.pyRP/s   N(R RRR#tpropertyR2R5R6R8R&R=R9R$RDRFRHRIR*RBRJRAR>RQRRRP(((s-lib/python2.7/site-packages/tornado/queues.pyREs*B                  cB`s)eZdZd„Zd„Zd„ZRS(sCA `.Queue` that retrieves entries in priority order, lowest first. Entries are typically tuples like ``(priority number, data)``. .. testcode:: from tornado.queues import PriorityQueue q = PriorityQueue() q.put((1, 'medium-priority item')) q.put((0, 'high-priority item')) q.put((10, 'low-priority item')) print(q.get_nowait()) print(q.get_nowait()) print(q.get_nowait()) .. testoutput:: (0, 'high-priority item') (1, 'medium-priority item') (10, 'low-priority item') cC`s g|_dS(N(R4(R"((s-lib/python2.7/site-packages/tornado/queues.pyR*TscC`stj|j|ƒdS(N(theapqtheappushR4(R"R<((s-lib/python2.7/site-packages/tornado/queues.pyRJWscC`stj|jƒS(N(RVtheappopR4(R"((s-lib/python2.7/site-packages/tornado/queues.pyRBZs(R RRR*RJRB(((s-lib/python2.7/site-packages/tornado/queues.pyR <s  cB`s)eZdZd„Zd„Zd„ZRS(s]A `.Queue` that retrieves the most recently put items first. .. testcode:: from tornado.queues import LifoQueue q = LifoQueue() q.put(3) q.put(2) q.put(1) print(q.get_nowait()) print(q.get_nowait()) print(q.get_nowait()) .. testoutput:: 1 2 3 cC`s g|_dS(N(R4(R"((s-lib/python2.7/site-packages/tornado/queues.pyR*tscC`s|jj|ƒdS(N(R4R:(R"R<((s-lib/python2.7/site-packages/tornado/queues.pyRJwscC`s |jjƒS(N(R4tpop(R"((s-lib/python2.7/site-packages/tornado/queues.pyRBzs(R RRR*RJRB(((s-lib/python2.7/site-packages/tornado/queues.pyR ^s  (Rt __future__RRRR+RVttornadoRRttornado.concurrentRRt tornado.locksRt__all__t ExceptionR R RtobjectR RR R (((s-lib/python2.7/site-packages/tornado/queues.pyts   χ"