暾j+ dZddlmZddlZddlmZddlmZddl m Z m Z e r ddl m Z mZmZej eZGdd eZy) zCommon functionality for concurrent processing. The main entry point is :class:`ThreadPoolExecutor`, which extends the standard library executor with a lazy ``imap`` method. ) annotationsN)deque)ThreadPoolExecutor) TYPE_CHECKINGAny)CallableIterableIteratorc2eZdZdZddd ddZy)rz+Subclass with a lazy consuming imap method.N)timeoutqueued_tasks_per_workerc', Kt|j|dzz}}|j|j|jc }}d fd } t |ddiD])} |||g| t ||k(s!| +|r | |r yyw)adOrdered imap that consumes iterables just-in-time. References: https://gist.github.com/ddelange/c98b05437f80e4b16bf4fc20fde9c999 Args: fn: Function to apply. *iterables: One (or more) iterable(s) to pass to fn (using zip) as positional argument(s). timeout: Per-future result retrieval timeout in seconds. queued_tasks_per_worker: Amount of additional items per worker to fetch from iterables to fill the queue: this determines the total queue size. Setting 0 will result in a true just-in-time behaviour: when a worker finishes a task, it waits until a result is consumed from the imap generator, at which point next() is called on the input iterable(s) and a new task is submitted. Default 2 ensures there is always some work to pick up. Note that at imap startup, the queue will fill up before the first yield occurs. Yields: Results of ``fn`` applied to items from ``iterables``, in input order. Example: long_generator = itertools.count() with ThreadPoolExecutor(42) as pool: result_generator = pool.imap(fn, long_generator) for result in result_generator: print(result) c0jS)z8Block until the next task is done and return the result.)result)popleftr s`/home/spazio/kingdom_calls/work5/transenv/lib/python3.12/site-packages/smart_open/concurrency.pygetz$ThreadPoolExecutor.imap..getCs9##G, ,strictFN)returnr)r _max_workersrappendsubmitziplen) selffnr r iterablesfuturesmaxlenrrrargsrs ` @rimapzThreadPoolExecutor.imapsD '4#4#48ORS8S#T")//7>>4;; -151 D 6"$t$ %7|v%e   %KsA4B9BB) rzCallable[..., Any]r z Iterable[Any]r z float | Nonerintrz Iterator[Any])__name__ __module__ __qualname____doc__r$rrrrsB5 !%'( / /"/ / "% /  /rr)r) __future__rlogging collectionsrconcurrent.futuresr_ThreadPoolExecutortypingrrcollections.abcrr r getLoggerr&loggerr*rrr4sC #H%<<   8 $2,2r