← Back
Editing: threadpool.cpython-38.pyc
U ��W[p& � @ sl d Z ddlmZmZ ddlZddlmZ ddlm Z m Z ddl m Z ddl mZ e� ZeG dd � d ��ZdS ) z� twisted.python.threadpool: a pool of threads to which we dispatch tasks. In most cases you can just use C{reactor.callInThread} and friends instead of creating a thread pool directly. � )�division�absolute_importN)�pool)�log�context)�Failure)� _oldStylec @ s� e Zd ZdZdZdZdZdZdZdZ e j Z e e j�Ze e�Zd'dd�Zed d � �Zed d � �Zed d� �Zedd� �ZeZdd� Zdd� Zdd� Zdd� Zdd� Zdd � Zd d � Z d d � Z d!d"� Z d(d#d$�Z d%d&� Z dS ))� ThreadPoola� This class (hopefully) generalizes the functionality of a pool of threads to which work can be dispatched. L{callInThread} and L{stop} should only be called from a single thread. @ivar started: Whether or not the thread pool is currently running. @type started: L{bool} @ivar threads: List of workers currently running in this thread pool. @type threads: L{list} @ivar _pool: A hook for testing. @type _pool: callable compatible with L{_pool} � � Fr Nc sb |dkst d��||ks t d��|� _|� _|� _g � _� fdd�}� fdd�}� �||�� _dS ) ac Create a new threadpool. @param minthreads: minimum number of threads in the pool @type minthreads: L{int} @param maxthreads: maximum number of threads in the pool @type maxthreads: L{int} @param name: The name to give this threadpool; visible in log messages. @type name: native L{str} r �minimum is negative� minimum is greater than maximumc s( � j | d� �� i|��}� j�|� |S )N�name)� threadFactory� _generateName�threads�append)�a�kw�thread��self� �;/usr/lib/python3/dist-packages/twisted/python/threadpool.py�trackingThreadFactoryJ s z2ThreadPool.__init__.<locals>.trackingThreadFactoryc s � j s dS � jS )Nr )�started�maxr r r r � currentLimitO s z)ThreadPool.__init__.<locals>.currentLimitN)�AssertionError�minr r r �_pool�_team)r � minthreads� maxthreadsr r r r r r �__init__6 s zThreadPool.__init__c C s | j �� }|j|j S )a For legacy compatibility purposes, return a total number of workers. @return: the current number of workers, both idle and busy (but not those that have been quit by L{ThreadPool.adjustPoolsize}) @rtype: L{int} )r! � statistics�idleWorkerCount�busyWorkerCount)r Zstatsr r r �workersW s zThreadPool.workersc C s dg| j �� j S )z� For legacy compatibility purposes, return the number of busy workers as expressed by a list the length of that number. @return: the number of workers currently processing a work item. @rtype: L{list} of L{None} N)r! r% r' r r r r �workingd s zThreadPool.workingc C s dg| j �� j S )a, For legacy compatibility purposes, return the number of idle workers as expressed by a list the length of that number. @return: the number of workers currently alive (with an allocated thread) but waiting for new work. @rtype: L{list} of L{None} N)r! r% r& r r r r �waitersp s zThreadPool.waitersc s G � fdd�dt �}|� S )z� For legacy compatibility purposes, return an object with a C{qsize} method that indicates the amount of work not yet allocated to a worker. @return: an object with a C{qsize} method. c s e Zd Z� fdd�ZdS )z$ThreadPool._queue.<locals>.NotAQueuec s � j �� jS )a Pretend to be a Python threading Queue and return the number of as-yet-unconsumed tasks. @return: the amount of backlogged work not yet dispatched to a worker. @rtype: L{int} )r! r% �backloggedWorkCount)�qr r r �qsize� s z*ThreadPool._queue.<locals>.NotAQueue.qsizeN)�__name__� __module__� __qualname__r- r r r r � NotAQueue� s r1 )�object)r r1 r r r �_queue} s zThreadPool._queuec C s4 d| _ d| _| �� | j�� j}|r0| j�|� dS )z' Start the threadpool. FTN)�joinedr �adjustPoolsizer! r% r+ �grow)r Zbacklogr r r �start� s zThreadPool.startc C s | j �d� dS )z� Increase the number of available workers for the thread pool by 1, up to the maximum allowed by L{ThreadPool.max}. � N)r! r6 r r r r � startAWorker� s zThreadPool.startAWorkerc C s d| j pt| �| jf S )z� Generate a name for a new pool thread. @return: A distinctive name for the thread. @rtype: native L{str} zPoolThread-%s-%s)r �idr( r r r r r � s zThreadPool._generateNamec C s | j �d� dS )zn Decrease the number of available workers by 1, by quitting one as soon as it's idle. r8 N)r! �shrinkr r r r � stopAWorker� s zThreadPool.stopAWorkerc C s" t | d|� t�| | j| j� d S )N�__dict__)�setattrr r$ r r �r �stater r r � __setstate__� s zThreadPool.__setstate__c C s i }| j |d< | j|d< |S )Nr r )r r r? r r r � __getstate__� s zThreadPool.__getstate__c O s | j d|f|�|� dS )a Call a callable object in a separate thread. @param func: callable object to be called in separate thread @param args: positional arguments to be passed to C{func} @param kw: keyword args to be passed to C{func} N)�callInThreadWithCallback)r �func�argsr r r r � callInThread� s zThreadPool.callInThreadc sP | j r dS tj�� jd ��fdd��� ���fdd��_|�_| j��� dS )a$ Call a callable object in a separate thread and call C{onResult} with the return value, or a L{twisted.python.failure.Failure} if the callable raises an exception. The callable is allowed to block, but the C{onResult} function must not block and should perform as little work as possible. A typical action for C{onResult} for a threadpool used with a Twisted reactor would be to schedule a L{twisted.internet.defer.Deferred} to fire in the main reactor thread using C{.callFromThread}. Note that C{onResult} is called inside the separate thread, not inside the reactor thread. @param onResult: a callable with the signature C{(success, result)}. If the callable returns normally, C{onResult} is called with C{(True, result)} where C{result} is the return value of the callable. If the callable throws an exception, C{onResult} is called with C{(False, failure)}. Optionally, C{onResult} may be L{None}, in which case it is not called at all. @param func: callable object to be called in separate thread @param args: positional arguments to be passed to C{func} @param kw: keyword arguments to be passed to C{func} N���c s^ z� � � } d}W n t� } d}Y nX d � _ � jd k rL� �|| � d � _n|sZt�| � d S )NTF)�theWorkr �onResultr �err)�result�ok)� inContextr r rM � s z6ThreadPool.callInThreadWithCallback.<locals>.inContextc s t j��f� ���S )N)r �callr )rE �ctxrD r r r �<lambda> � z5ThreadPool.callInThreadWithCallback.<locals>.<lambda>) r4 r ZtheContextTrackerZcurrentContextZcontextsrH rI r! Zdo)r rI rD rE r r )rE rO rD rM r r rC � s z#ThreadPool.callInThreadWithCallbackc C s. d| _ d| _| j�� | jD ] }|�� q dS )z9 Shutdown the threads in the threadpool. TFN)r4 r r! �quitr �join)r r r r r �stop s zThreadPool.stopc C s� |dkr| j }|dkr | j}|dks,td��||ks<td��|| _ || _| jsRdS | j| jkrr| j�| j| j � | j| j k r�| j�| j | j � dS )z� Adjust the number of available threads by setting C{min} and C{max} to new values. @param minthreads: The new value for L{ThreadPool.min}. @param maxthreads: The new value for L{ThreadPool.max}. Nr r r )r r r r r( r! r; r6 )r r" r# r r r r5 s zThreadPool.adjustPoolsizec C s: t �d| jf � t �d| jf � t �d| jf � dS )zw Dump some plain-text informational messages to the log about the state of this L{ThreadPool}. z waiters: %sz workers: %sz total: %sN)r �msgr* r) r r r r r � dumpStats9 s zThreadPool.dumpStats)r r N)NN)!r. r/ r0 �__doc__r r r4 r r( r � threadingZThreadr � staticmethodZ currentThreadr r$ �propertyr) r* r3 r, r7 r9 r r< rA rB rF rC rT r5 rV r r r r r s> ! : r )rW Z __future__r r rX Ztwisted._threadsr r Ztwisted.pythonr r Ztwisted.python.failurer Ztwisted.python._oldstyler r2 Z WorkerStopr r r r r �<module> s
Save File
Cancel