← Back
Editing: test_cooperator.cpython-38.pyc
U W[�S � @ s� d Z ddlmZmZ ddlmZmZmZ ddlm Z G dd� de �Z G dd� de �Z G d d � d e j �ZG d d � d e�ZG d d� de j �ZG dd� de j �ZdS )z_ This module contains tests for L{twisted.internet.task.Cooperator} and related functionality. � )�division�absolute_import)�reactor�defer�task)�unittestc @ s e Zd ZdZdd� Zdd� ZdS )�FakeDelayedCallzA Fake delayed call which lets us simulate the scheduler. c C s || _ d| _dS )z+ A function to run, later. FN)�func� cancelled��selfr � r �>/usr/lib/python3/dist-packages/twisted/test/test_cooperator.py�__init__ s zFakeDelayedCall.__init__c C s d| _ dS )z. Don't run my function later. TN)r �r r r r �cancel s zFakeDelayedCall.cancelN)�__name__� __module__� __qualname__�__doc__r r r r r r r s r c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) � FakeSchedulerz/ A fake scheduler for testing against. c C s g | _ dS )zD Create a fake scheduler with a list of work to do. N)�workr r r r r ( s zFakeScheduler.__init__c C s t |�}| j�|� |S )z; Schedule a unit of work to be done later. )r r �append)r Zthunk�unitr r r �__call__/ s zFakeScheduler.__call__c C s* | j g }| _ |D ]}|js|�� qdS )zL Do all of the work that is currently available to be done. N)r r r )r r r r r r �pump8 s zFakeScheduler.pumpN)r r r r r r r r r r r r $ s r c @ s� e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Zd d � Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"S )#�CooperatorTests�donec C s |� tj� | jS �N)�trapr ZSchedulerStopped�RESULT)r �errr r r �ebIterF s zCooperatorTests.ebIterc C s | � � d S r )�fail)r �ignr r r �cbIterK s zCooperatorTests.cbIterc s" � fdd���d�� �fdd��S )zU Test that Cooperators refuse new tasks when they have been stopped. c sJ t �� }|�� |�td�| �}|�� j� |�� j� |�� fdd��S )Nr c s � � | � j�S r �� assertEqualr ��resultr r r �<lambda>Y s zNCooperatorTests.testStoppedRejectsNewTasks.<locals>.testwith.<locals>.<lambda>) r � Cooperator�stop� coiterate�iter� addCallbackr% � addErrbackr" )�stuff�c�dr r r �testwithS s z<CooperatorTests.testStoppedRejectsNewTasks.<locals>.testwithNc s � t �� �S r )r �Deferred�r$ )r4 r r r* [ � z<CooperatorTests.testStoppedRejectsNewTasks.<locals>.<lambda>)r/ r r )r r4 r �testStoppedRejectsNewTasksO s z*CooperatorTests.testStoppedRejectsNewTasksc sb t �� }� fdd�� d� _|�� � �}|��j� |��j� |�� � �fdd�}|�|� |S )zq Test that a running iterator will not run to completion when the cooperator is stopped. c 3 s t d�D ]� _� jV qd S )N� )�range�valuer )�myiterr r r< d s z/CooperatorTests.testStopRunning.<locals>.myiter���c s �� | �j� �� � jd� d S �Nr= )r' r r; r( �r< r r r � doassertsl s z2CooperatorTests.testStopRunning.<locals>.doasserts) r r+ r; r- r/ r% r0 r" r, )r r2 r3 r@ r r? r �testStopRunning^ s z CooperatorTests.testStopRunningc sv t �� �t �� ����fdd�}t�� � � �|� �}� �fdd�}��|� |��j� |��j� |��fdd��S )z� An iterator run with L{Cooperator.coiterate} paused on a L{Deferred} yielded by that iterator will fire its own L{Deferred} (the one returned by C{coiterate}) when L{Cooperator.stop} is called. c 3 s" t �d�jd � � V ��� d S �Nr )r � callLater�callbackr# r )� outstandingDr � testControlDr r r< { s z3CooperatorTests.testStopOutstanding.<locals>.myiterc s � � � ��d� d S )NZ arglebargle)r, rD r6 )r2 rE r r � stopAndGo� s z6CooperatorTests.testStopOutstanding.<locals>.stopAndGoc s � � | � j�S r r& r( r r r r* � r7 z5CooperatorTests.testStopOutstanding.<locals>.<lambda>) r r5 r r+ r- r/ r% r0 r" )r r< r3 rG r )r2 rE r rF r �testStopOutstandings s �z#CooperatorTests.testStopOutstandingc C s( t �� }dd� }|�|� �}| �|t�S )Nc s s t � �d S r )� RuntimeErrorr r r r r< � s z3CooperatorTests.testUnexpectedError.<locals>.myiter�r r+ r- Z assertFailurerI )r r2 r< r3 r r r �testUnexpectedError� s z#CooperatorTests.testUnexpectedErrorc C s( dd� }t �� }|�|� �}| �|t�S )Nc s s$ t �� } t�d| jt� � | V d S rB )r r5 r rC ZerrbackrI )�Dr r r r< � s z@CooperatorTests.testUnexpectedErrorActuallyLater.<locals>.myiterrJ �r r< r2 r3 r r r � testUnexpectedErrorActuallyLater� s z0CooperatorTests.testUnexpectedErrorActuallyLaterc C s( dd� }t �� }|�|� �}| �|t�S )Nc s s t �t� �V d S r )r r# rI r r r r r< � s zCCooperatorTests.testUnexpectedErrorNotActuallyLater.<locals>.myiterrJ rM r r r �#testUnexpectedErrorNotActuallyLater� s z3CooperatorTests.testUnexpectedErrorNotActuallyLaterc sb g � � fdd�}ddddg�t �� }g }�D ]}|�|�||��� q,t�|��� ��fdd��S ) Nc 3 s | D ]}� � |� d V qd S r �r )ZthingsZth)�Lr r r< � s z/CooperatorTests.testCooperation.<locals>.myiter�abc)� � r9 �def)� � � c s �� t� �tt�� d��S �Nr )r' �tuple�sum�zipr6 �rQ ZgroupsOfThingsr r r r* � r7 z1CooperatorTests.testCooperation.<locals>.<lambda>)r r+ r r- r Z DeferredListr/ )r r< r2 Ztasksr1 r r] r �testCooperation� s �z CooperatorTests.testCooperationc s~ g �� �fdd�}G dd� d�� t j� d�}|�|� ��| j� |j�� |�� |�� | � � j � | � �t t d��� d S )Nc 3 s0 t d�D ]"} ��| � | dkr$d� _| V qd S )N�d � T)r: r �stopped)�i��_TPF�outputr r r< � s z6CooperatorTests.testResourceExhaustion.<locals>.myiterc @ s e Zd ZdZdd� ZdS )z4CooperatorTests.testResourceExhaustion.<locals>._TPFFc S s | j S r )ra r r r r r � s z=CooperatorTests.testResourceExhaustion.<locals>._TPF.__call__N)r r r ra r r r r r rd � s rd )�terminationPredicateFactory� )r r+ r- r0 r" � _delayedCallr �_tickr, � assertTruera r' �listr: )r r< r2 r rc r �testResourceExhaustion� s z&CooperatorTests.testResourceExhaustionc s� g �G dd� d�� � ��fdd�}t j|dd� d����td��}g ���fd d �}|�|� d }�s�|d 7 }�r���d ��� |d 7 }qn|d krb��d� qbdS )a* If a callback to a deferred returned by coiterate calls coiterate on the same Cooperator, we should make sure to only do the minimal amount of scheduling work. (This test was added to demonstrate a specific bug that was found while writing the scheduler.) c @ s e Zd Zdd� Zdd� ZdS )z9CooperatorTests.testCallbackReCoiterate.<locals>.FakeCallc S s || _ d S r �r r r r r r � s zBCooperatorTests.testCallbackReCoiterate.<locals>.FakeCall.__init__c S s d| j f S )Nz <FakeCall %r>rm r r r r �__repr__� s zBCooperatorTests.testCallbackReCoiterate.<locals>.FakeCall.__repr__N)r r r r rn r r r r �FakeCall� s ro c s& �� �t��� ��� | �� �d S r> )� assertFalse�reprr ��f)ro �callsr r r �sched� s z6CooperatorTests.testCallbackReCoiterate.<locals>.schedc S s dd� S )Nc S s dS �NTr r r r r r* � r7 zKCooperatorTests.testCallbackReCoiterate.<locals>.<lambda>.<locals>.<lambda>r r r r r r* � r7 z9CooperatorTests.testCallbackReCoiterate.<locals>.<lambda>�� schedulerrf r c s � � td����j� d S rY )r- r. �addBothr r6 )r2 r r r � anotherTask� s z<CooperatorTests.testCallbackReCoiterate.<locals>.anotherTaskr rS �2 zCooperator took too longN)r r+ r- r. r/ �popr r# )r ru r3 rz r r )ro r2 rt r r r �testCallbackReCoiterate� s z'CooperatorTests.testCallbackReCoiteratec s� dg� � fdd�}t j|d�}|�tddg��}|�tddg��}| �� d j|j� |�� | �� d j � | �|j � d � |�� | � � d j � | � |j � |�tddg�� | �� d j � | �|j � d � dS )a If the last task in a Cooperator is removed, the scheduled call for the next tick is cancelled, since it is no longer necessary. This behavior is useful for tests that want to assert they have left no reactor state behind when they're done. Nc s t | �� d< � d S rB )r rr �rt r r ru s zFCooperatorTests.test_removingLastTaskStopsScheduledCall.<locals>.sched)rx rS rT r ) r r+ � cooperater. r' r ri r, rp r rh rj Z assertIsNone)r ru ZcoopZtask1Ztask2r r~ r �'test_removingLastTaskStopsScheduledCall� s z7CooperatorTests.test_removingLastTaskStopsScheduledCallc C s t �� }| �|j� dS )zm L{Cooperator.running} reports C{True} if the L{Cooperator} was started on creation. N)r r+ rj �running�r r2 r r r �test_runningWhenStarted" s z'CooperatorTests.test_runningWhenStartedc C s t jdd�}| �|j� dS )zk L{Cooperator.running} reports C{False} if the L{Cooperator} has not been started. F�ZstartedN)r r+ rp r� r� r r r �test_runningWhenNotStarted+ s z*CooperatorTests.test_runningWhenNotStartedc C s0 t jdd�}|�� | �|j� | �|j� dS )zb L{Cooperator.running} reports C{True} when the L{Cooperator} is running. Fr� N)r r+ �startZ addCleanupr, rj r� r� r r r �test_runningWhenRunning4 s z'CooperatorTests.test_runningWhenRunningc C s, t jdd�}|�� |�� | �|j� dS )zj L{Cooperator.running} reports C{False} after the L{Cooperator} has been stopped. Fr� N)r r+ r� r, rp r� r� r r r �test_runningWhenStopped? s z'CooperatorTests.test_runningWhenStoppedN)r r r r r" r% r8 rA rH rK rN rO r^ rl r} r� r� r� r� r� r r r r r C s" (# r c @ s e Zd ZdZdS )�UnhandledExceptionz0 An exception that should go unhandled. N)r r r r r r r r r� K s r� c @ s e Zd ZdZdd� ZdS )� AliasTestszg Integration test to verify that the global singleton aliases do what they're supposed to. c s8 t �� � � fdd�}|� }t�|�}| �|tjj� � S )zZ L{twisted.internet.task.cooperate} ought to run the generator that it is c 3 s dV dV dV � � d� d S )NrS rT r9 Zyay)rD r �r3 r r �doit] s z'AliasTests.test_cooperate.<locals>.doit)r r5 r r ZassertInZ_theCooperatorZ_tasks)r r� �itZtheTaskr r� r �test_cooperateX s zAliasTests.test_cooperateN)r r r r r� r r r r r� R s r� c @ s� e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Zd d � Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd&d'� Zd(d)� Zd*S )+� RunStateTestsz� Tests to verify the behavior of L{CooperativeTask.pause}, L{CooperativeTask.resume}, L{CooperativeTask.stop}, exhausting the underlying iterator, and their interactions with each other. c C sV d| _ d| _d| _g | _t� | _tj| jdd� d�| _| j� | � � �| _| j� � dS )z� Create a cooperator with a fake scheduler and a termination predicate that ensures only one unit of work will take place per tick. Fc S s dd� S )Nc S s dS rv r r r r r r* ~ r7 z7RunStateTests.setUp.<locals>.<lambda>.<locals>.<lambda>r r r r r r* ~ r7 z%RunStateTests.setUp.<locals>.<lambda>rw N) � _doDeferNext� _doStopNext� _doDieNextr r rx r r+ � cooperatorr �workerr� r r r r �setUpp s �zRunStateTests.setUpc c sd d}|d7 }| j r4d| _ t�� }| j�|� |V q| jr>dS | jrLt� �q| j�|� |V qdS )z� This is a sample generator which yields Deferreds when we are testing deferral and an ascending integer count otherwise. r rS FN)r� r r5 r r r� r� r� )r rb r3 r r r r� � s zRunStateTests.workerc C s | ` | `dS )z� Drop references to interesting parts of the fixture to allow Deferred errors to be noticed when things start failing. N)r rx r r r r �tearDown� s zRunStateTests.tearDownc C s d| _ dS )z@ Defer the next result from my worker iterator. TN)r� r r r r � deferNext� s zRunStateTests.deferNextc C s d| _ dS )zm Make the next result from my worker iterator be completion (raising StopIteration). TN)r� r r r r �stopNext� s zRunStateTests.stopNextc C s dd� }d| _ dS )zk Make the next result from my worker iterator be raising an L{UnhandledException}. c S s | � t� d S r )r r� )Zfailurer r r �ignoreUnhandled� s z.RunStateTests.dieNext.<locals>.ignoreUnhandledTN)r� )r r� r r r �dieNext� s zRunStateTests.dieNextc C s� | j �� | �| jdg� | j �� | �| jddg� | j�� | j �� | �| jddg� | j�� | �| jddg� | j �� | �| jdddg� dS )z� Cooperators should stop running their tasks when they're paused, and start again when they're resumed. rS rT r9 N)rx r r' r r �pause�resumer r r r �test_pauseResume� s z RunStateTests.test_pauseResumec C s< | � tj| jj� | j�� | j�� | � tj| jj� dS )z� L{CooperativeTask.resume} should raise a L{TaskNotPaused} exception if it was not paused; e.g. if L{CooperativeTask.pause} was not invoked more times than L{CooperativeTask.resume} on that object. N)� assertRaisesr Z NotPausedr� r� r r r r �test_resumeNotPaused� s z"RunStateTests.test_resumeNotPausedc C s� | j �� | j�� | �| jg � | j �� | j�� | �| jg � | j �� | j�� | �| jg � | j �� | j�� | �| jdg� dS )z~ Pauses on tasks should behave like a stack. If a task is paused twice, it needs to be resumed twice. rS N)r r� rx r r' r r� r r r r �test_pauseTwice� s z RunStateTests.test_pauseTwicec C s� | � � | j�� | �t| j�d� | �| jd tj� | j�� | �t| j�d� | j � � | j�� | �t| j�d� | j � � | j�� | �t| j�d� | jd � d� | j�� | �t| j�d� | �| jd d� dS )a C{pause()}ing a task while it is waiting on an outstanding L{defer.Deferred} should put the task into a state where the outstanding L{defer.Deferred} must be called back I{and} the task is C{resume}d before it will continue processing. rS r zSTUFF!rT N) r� rx r r' �lenr ZassertIsInstancer r5 r r� r� rD r r r r �test_pauseWhileDeferred� s z%RunStateTests.test_pauseWhileDeferredc s� | j �� }| j �� }g � g �g }g }� fdd�}�fdd�}|�|� |�|� |�|j� |�|j� | �� | j�� | �t� �d� | �t��d� | � � d | j j � | � �d | j j � | �|dg� | �|dg� dS ) a/ L{CooperativeTask.whenDone} returns a Deferred which fires when the Cooperator's iterator is exhausted. It returns a new Deferred each time it is called; callbacks added to other invocations will not modify the value that subsequent invocations will fire with. c s � � | � dS )NrS rP r( )�results1r r � callbackOne s z0RunStateTests.test_whenDone.<locals>.callbackOnec s � � | � dS )NrT rP r( )�results2r r � callbackTwo" s z0RunStateTests.test_whenDone.<locals>.callbackTworS r rT N) r �whenDoner/ r r� rx r r' r� ZassertIs� _iterator)r � deferred1Z deferred2Zfinal1Zfinal2r� r� r )r� r� r � test_whenDone s( zRunStateTests.test_whenDonec C sV | j �� }g }|�|j� | �� | j�� | �t|�d� | �|d � t �t � dS )z� L{CooperativeTask.whenDone} returns a L{defer.Deferred} that will fail when the iterable's C{next} method raises an exception, with that exception. rS r N) r r� r0 r r� rx r r' r� �checkr� )r r� �resultsr r r �test_whenDoneError; s z RunStateTests.test_whenDoneErrorc C sR | j �� }g }|�|j� | j �� | �t|�d� | �|d �t j�t j� dS )z� L{CooperativeTask.whenDone} returns a L{defer.Deferred} that fails with L{TaskStopped} when the C{stop} method is called on that L{CooperativeTask}. rS r N) r r� r0 r r, r' r� r� � TaskStopped)r r� �errorsr r r �test_whenDoneStopJ s z RunStateTests.test_whenDoneStopc C s> | � � | j�� g }| j�� �|j� | �|| jjg� dS )z� L{CooperativeTask.whenDone} will return a L{defer.Deferred} that will succeed immediately if its iterator has already completed. N) r� rx r r r� r/ r r' r� )r r� r r r �test_whenDoneAlreadyDoneX s z&RunStateTests.test_whenDoneAlreadyDonec C sf | j �� | j�� | �t| j�d� | �t j| j j� | �t j| j j � | j�� | �| jg � dS )z� C{stop()}ping a task should cause it to be removed from the run just as C{pause()}ing, with the distinction that C{resume()} will raise a L{TaskStopped} exception. r N) r r, rx r r' r� r r� r� r� r r r r �test_stopStopsd s z RunStateTests.test_stopStopsc C s: | j �� | j �� | j �� | j�� | �| jg � dS )z� C{resume()}ing a paused, stopped task should be a no-op; it should not raise an exception, because it's paused, but neither should it actually do more work from the task. N)r r� r, r� rx r r' r r r r r �test_pauseStopResumet s z"RunStateTests.test_pauseStopResumec C s� | � � | j�� | j�� }| �| jjd� g }|�|j � | j�� | j� � | j�� |� d� | j�� | �|dg� | �| jg � dS )a As a corrolary of the interaction of C{pause()} and C{unpause()}, C{stop()}ping a task which is waiting on a L{Deferred} should cause the task to gracefully shut down, meaning that it should not be unpaused when the deferred fires. rS � N) r� rx r r r| r' r Z _pauseCountry r r, rD )r r3 r� r r r �test_stopDeferred� s z RunStateTests.test_stopDeferredc C s( | � � | j�� | �tj| jj� dS )zx C{stop()}ping a L{CooperativeTask} whose iterator has been exhausted should raise L{TaskDone}. N)r� rx r r� r ZTaskDoner, r r r r �test_stopExhausted� s z RunStateTests.test_stopExhaustedc C s( | � � | j�� | �tj| jj� dS )z� C{stop()}ping a L{CooperativeTask} whose iterator has encountered an error should raise L{TaskFailed}. N)r� rx r r� r Z TaskFailedr, r r r r �test_stopErrored� s z RunStateTests.test_stopErroredc sL g � � �fdd�}�j �� �|� ��� �j�� ��� �j jdg� dS )a� If a callback of a L{Deferred} from L{CooperativeTask.whenDone} calls C{Cooperator.stop} on its L{CooperativeTask._cooperator}, the L{Cooperator} will stop, but the L{CooperativeTask} whose callback is calling C{stop} should already be considered 'stopped' by the time the callback is running, and therefore removed from the L{CoooperativeTask}. c s" � � | � �j�� � � d� d S )Nr )r r� r, r( �ZcallbackPhasesr r r �stopit� s z;RunStateTests.test_stopCooperatorReentrancy.<locals>.stopitr N)r r� r/ r� rx r r' r� )r r� r r� r � test_stopCooperatorReentrancy� s z+RunStateTests.test_stopCooperatorReentrancyN)r r r r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r� i s* , r� N)r Z __future__r r Ztwisted.internetr r r Z twisted.trialr �objectr r ZTestCaser � Exceptionr� r� r� r r r r �<module> s
Save File
Cancel