← Back
Editing: test_webclient.cpython-38.pyc
U s�@g�� � @ s� d Z ddlmZmZ ddlZddlZddlmZ zddlmZm Z W n$ e k rh ddl mZm Z Y nX ddl m Z mZmZ ddlmZmZ ddlmZmZmZmZ dd lmZ dd lmZ dd l m Z m Z m Z m Z dd l!m"Z" dd l#m$Z$ ddl%m&Z& ddl'm(Z(m)Z)m*Z* zddl m+Z+ W n dZ+Y nX ddl,m-Z- ddl.m/Z/m0Z0m1Z1m2Z2m3Z3 ddl4m5Z5m6Z6 e$e-j7��8d�Z9e9�:� j;Z<G dd� dej=�Z>G dd� dej=�Z?G dd� dej=�Z@G dd � d ej=�ZAG d d � d ej=�ZBG d d � d ej=�ZCG d!d"� d"ej=�ZDG d#d$� d$ej=�ZEG d%d&� d&ej=�ZFG d'd(� d(ej=�ZGG d)d*� d*ej=�ZHG d+d,� d,e�ZIG d-d.� d.ej=�ZJG d/d0� d0ejK�ZLG d1d2� d2ejK�ZMG d3d4� d4ejK�ZNG d5d6� d6eN�ZOG d7d8� d8ejK�ZPG d9d:� d:ejK�ZQG d;d<� d<ejK�ZRe+dk�s�eSe+d=��seOePfD ] ZTd>eT_U�qe �Ve d��s6eOePfD ] ZTd?eT_U�q(G d@dA� dA�ZWG dBdC� dCeWejK�ZXG dDdE� dEeWejK�ZYG dFdG� dGeWejK�ZZG dHdI� dIejK�Z[G dJdK� dKe5ej\�Z]G dLdM� dMe6ej\�Z^G dNdO� dOe5ej\�Z_G dPdQ� dQe6ej\�Z`dRdS� ZaG dTdU� dUe5ej\�ZbG dVdW� dWe6ej\�ZcG dXdY� dYeb�ZdG dZd[� d[ec�ZeG d\d]� d]e5ej\�ZfG d^d_� d_e6ej\�ZgG d`da� dae6ej\�ZhG dbdc� dce5ej\�ZiG ddde� dee6ej\�ZjG dfdg� dge6ej\�ZkdS )hzG Tests for the old L{twisted.web.client} APIs, C{getPage} and friends. � )�division�absolute_importN)�ENOSPC)�urlparse�urljoin)� networkString� nativeString� intToBytes)�unittest�util)�server�client�error�resource)�Data)�Redirect)�address�reactor�defer� interfaces)� ClientFactory)�FilePath)�WrappingFactory)�StringTransport�waitUntilAllDisconnected�EventLoggingObserver)�ssl)�test)�globalLogPublisher�FilteringLogObserver�LogLevelFilterPredicate�LogLevel�Logger)�MethodInjectionTestsMixin�URIInjectionTestsMixinz server.pemc @ s8 e Zd ZdZdZdZdd� Zdd� Zdd � Zd d � Z dS ) �ExtendedRedirectz� Redirection resource. The HTTP status code is set according to the C{code} query parameter. @type lastMethod: C{bytes} @ivar lastMethod: Last handled HTTP request method TNc C s t j�| � || _d S �N)r �Resource�__init__�url)�selfr) � r+ �A/usr/lib/python3/dist-packages/twisted/web/test/test_webclient.pyr( @ s zExtendedRedirect.__init__c C s@ | j r|j| _ dS |j| _ t|jd d �}| �| j||�S d S )Ns OK Thnx!s coder )� lastMethod�method�int�args� redirectTor) )r* �request�coder+ r+ r, �renderE s zExtendedRedirect.renderc C s | S r& r+ )r* �namer2 r+ r+ r, �getChildO s zExtendedRedirect.getChildc C s |� |� |�d|� dS )Ns locations OK Bye!)�setResponseCode� setHeader)r* r) r2 r3 r+ r+ r, r1 S s zExtendedRedirect.redirectTo) �__name__� __module__� __qualname__�__doc__ZisLeafr- r( r4 r6 r1 r+ r+ r+ r, r% 3 s r% c @ s" e Zd ZdZddd�Zdd� ZdS ) �ForeverTakingResourceza L{ForeverTakingResource} is a resource which never finishes responding to requests. Fc C s t j�| � || _d S r& )r r' r( �_write)r* �writer+ r+ r, r( _ s z ForeverTakingResource.__init__c C s | j r|�d� tjS �Ns some bytes)r> r? r � NOT_DONE_YET�r* r2 r+ r+ r, r4 c s z ForeverTakingResource.renderN)F�r9 r: r; r< r( r4 r+ r+ r+ r, r= Z s r= c @ s e Zd ZdZdd� Zdd� ZdS )� ForeverTakingNoReadingResourcez� L{ForeverTakingNoReadingResource} is a resource that never finishes responding and that removes itself from the read loop. c C s t j�| � d S r& )r r' r( �r* r+ r+ r, r( n s z'ForeverTakingNoReadingResource.__init__c C s |j �� tjS r& )� transportZpauseProducingr rA rB r+ r+ r, r4 q s z%ForeverTakingNoReadingResource.renderNrC r+ r+ r+ r, rD i s rD c @ s e Zd Zdd� ZdS )�CookieMirrorResourcec C sJ g }t t|j�� ��D ] \}}|�t|�t|�f� q|�� tt|��S r& ) �sorted�listZreceived_cookies�items�appendr �sortr �repr)r* r2 �l�k�vr+ r+ r, r4 x s zCookieMirrorResource.renderN�r9 r: r; r4 r+ r+ r+ r, rG w s rG c @ s e Zd Zdd� ZdS )�RawCookieMirrorResourcec C s& |� d�}|d krdS ttt|���S )Ns cookie� None)Z getHeaderr rM r )r* r2 �headerr+ r+ r, r4 � s z RawCookieMirrorResource.renderNrQ r+ r+ r+ r, rR s rR c @ s e Zd Zdd� ZdS )� ErrorResourcec C s& |� d� |j�d�r"|�dd� dS )Ni� s showlength� content-length� 0� )r7 r0 �getr8 rB r+ r+ r, r4 � s zErrorResource.renderNrQ r+ r+ r+ r, rU � s rU c @ s e Zd Zdd� ZdS )�NoLengthResourcec C s dS )N� nolengthr+ rB r+ r+ r, r4 � s zNoLengthResource.renderNrQ r+ r+ r+ r, rZ � s rZ c @ s e Zd ZdZdd� ZdS )�HostHeaderResourcezg A testing resource which renders itself as the value of the host header from the request. c C s |j �d�d S )N� hostr )�requestHeaders� getRawHeadersrB r+ r+ r, r4 � s zHostHeaderResource.renderN�r9 r: r; r< r4 r+ r+ r+ r, r\ � s r\ c @ s e Zd ZdZdd� ZdS )�PayloadResourcez� A testing resource which renders itself as the contents of the request body as long as the request body is 100 bytes long, otherwise which renders itself as C{"ERROR"}. c C s: |j �� }|j�d�d }t|�dks2t|�dkr6dS |S )NrV r �d s ERROR)Zcontent�readr^ r_ �lenr/ )r* r2 �dataZ contentLengthr+ r+ r, r4 � s zPayloadResource.renderNr` r+ r+ r+ r, ra � s ra c @ s e Zd Zdd� Zdd� ZdS )� DelayResourcec C s || _ d S r& )�seconds)r* rg r+ r+ r, r( � s zDelayResource.__init__c s � fdd�}t �| j|� tjS )Nc s � � d� � �� d S r@ )r? Zfinishr+ �r2 r+ r, �response� s z&DelayResource.render.<locals>.response)r Z callLaterrg r rA )r* r2 ri r+ rh r, r4 � s zDelayResource.renderN)r9 r: r; r( r4 r+ r+ r+ r, rf � s rf c @ s e Zd Zdd� ZdS )�BrokenDownloadResourcec C s |� dd� |�d� dS )NrV � 5� abcrX )r8 r? rB r+ r+ r, r4 � s z BrokenDownloadResource.renderNrQ r+ r+ r+ r, rj � s rj c @ s e Zd ZdZdd� Zdd� ZdS )�CountingRedirectzl A L{Redirect} resource that keeps track of the number of times the resource has been accessed. c O s t j| f|�|� d| _d S �Nr )r r( �count)r* �a�kwr+ r+ r, r( � s zCountingRedirect.__init__c C s | j d7 _ t�| |�S �N� )ro r r4 rB r+ r+ r, r4 � s zCountingRedirect.renderNrC r+ r+ r+ r, rm � s rm c @ s e Zd ZdZdd� Zdd� ZdS )�CountingResourcezR A resource that keeps track of the number of times it has been accessed. c C s t j�| � d| _d S rn )r r' r( ro rE r+ r+ r, r( � s zCountingResource.__init__c C s | j d7 _ dS )Nrs s Success)ro rB r+ r+ r, r4 � s zCountingResource.renderNrC r+ r+ r+ r, rt � s rt c @ s e Zd ZdZdd� Zdd� ZdS )� URLJoinTestsz' Tests for L{client._urljoin}. c C s@ | � t�dd�d� | � t�dd�d� | � t�dd�d� dS )z� L{client._urljoin} does not include a fragment identifier in the resulting URL if neither the base nor the new path include a fragment identifier. � http://foo.com/bar� /quuxs http://foo.com/quuxs http://foo.com/bar#s /quux#N�� assertEqualr Z_urljoinrE r+ r+ r, �test_noFragments� s � � �z URLJoinTests.test_noFragmentsc C s@ | � t�dd�d� | � t�dd�d� | � t�dd�d� dS )a L{client._urljoin} preserves the fragment identifier from either the new path or the base URL respectively, as specified in the HTTP 1.1 bis draft. @see: U{https://tools.ietf.org/html/draft-ietf-httpbis-p2-semantics-22#section-7.1.2} s http://foo.com/bar#fragrw s http://foo.com/quux#fragrv s /quux#frag2s http://foo.com/quux#frag2Nrx rE r+ r+ r, �test_preserveFragments� s � � �z#URLJoinTests.test_preserveFragmentsN)r9 r: r; r< rz r{ r+ r+ r+ r, ru � s ru c @ s& e Zd ZdZejed�gZdd� ZdS )�HTTPPageGetterTestszq Tests for L{HTTPPagerGetter}, the HTTP client protocol implementation used to implement L{getPage}. ��categoryc C sd t jddddiddddd d d �d �}t� }t �� }||_|�|� |�� }d D ]}| �||� qNdS )a, When a connection is made, L{HTTPPagerGetter} sends the headers from its factory's C{headers} dict. If I{Host} or I{Content-Length} is present in this dict, the values are not sent, since they are sent with special values before the C{headers} dict is processed. If I{User-Agent} is present in the dict, it overrides the value of the C{agent} attribute of the factory. If I{Cookie} is present in the dict, its value is added to the values from the factory's C{cookies} attribute. s http://foo/bars foobar� baz� quuxs some datas example.nets foobles blah blahs 12981s value)� Hosts User-Agents Cookies Content-Lengths Useful)�agent�cookies�postdata�headers)s Host: example.net s User-Agent: foobar s Content-Length: 9 s Useful: value s connection: close s Cookie: blah blah; baz=quux N)r �HTTPClientFactoryr �HTTPPageGetter�factory�makeConnection�value�assertIn)r* r� rF Zprotocol�resultZexpectedHeaderr+ r+ r, �test_earlyHeaders s& �� z%HTTPPageGetterTests.test_earlyHeadersN)r9 r: r; r< r �suppress�DeprecationWarningr� r+ r+ r+ r, r| s r| c @ sh e Zd Zejed�gZe� Zdd� Zdd� Z dd� Z dd � Z d d � Z d d � Z dd� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd&d'� Zd(d)� Zd*d+� Z d,d-� Z d.d/� Z d0d1� Z d2d3� Z d4d5� Z!d6d7� Z"d8d9� Z#d:d;� Z$d<d=� Z%d>d?� Z&d@dA� Z'dBdC� Z(dDdE� Z)dFdG� Z*dHdI� Z+dJdK� Z,dLdM� Z-dNdO� Z.dPdQ� Z/dRdS� Z0dTS )U�WebClientTestsr} c C s t jd|dd�S �Nr � 127.0.0.1�� interface�r � listenTCP�r* �siter+ r+ r, �_listen: s zWebClientTests._listenc C s� d | _ d| _t�� }|�dtdd�� |�dtd�� td�| _|�d| j� |�d t � � |�d t d d �� |�d t � � |�dt � � |�dt � � |�dt � � |�dt� � |�dt� � |�dt� � |�dtd�� |�dtd�� t� | _|�d| j� |�dtd�� tdd �}d d � |_|�d |� td �| _|�d!| j� tj|d d"�| _t| j�| _| � | j�| _ | j � � j | _ d S )#Nr s file� 0123456789z text/htmls redirect� /files /infiniteRedirects infiniteRedirects waits write-then-waitT)r? s never-reads errorr[ r] s payloads broken� cookiemirrors delay1rs s delay2� s afterFoundGetCounters afterFoundGetRedirects /afterFoundGetCounters" miscased-head GET response contentz major/minorc S s dS )N� miscased-head contentr+ rh r+ r+ r, �<lambda>V rX z&WebClientTests.setUp.<locals>.<lambda>s miscased-heads /extendedRedirects extendedRedirect�Ztimeout) r� �cleanupServerConnectionsr r' �putChildr r rm �infiniteRedirectResourcer= rD rU rZ r\ ra rj rG rf rt �afterFoundGetCounterZ render_Headr% �extendedRedirectr �Siter� r �wrapperr� �port�getHost�portno)r* �rZ miscasedHeadr+ r+ r, �setUp= s< zWebClientTests.setUpc C s� | j r| j �� d | _ t| jj�� �}ttt|�| j ��D ]&}|� � }| j j d|d� |j �� q:| j�� }t�ttt| jj�� ��|g�S )NzClosing {proto})�proto)r� ZcloseCachedConnectionsrI r� Z protocols�keys�range�minrd r� �pop�_log�inforF ZabortConnectionr� � stopListeningr � DeferredListr r )r* Z connections�nr� �dr+ r+ r, �tearDown` s ��zWebClientTests.tearDownc C s d| j }tt|t|���S )Nzhttp://127.0.0.1:%d/)r� r r r )r* �path�hostr+ r+ r, �getURLv s zWebClientTests.getURLc C s" d}t j| �d�|d��| j|�S )Nsd 0123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789Zpayload)r� �r �getPager� � addCallbackry )r* �sr+ r+ r, � testPayloadz s �zWebClientTests.testPayloadc s4 t �� �d��}� �|t j�}|�� fdd�� |S )z� If the connection is closed before the number of bytes indicated by I{Content-Length} have been received, the L{Deferred} returned by L{getPage} fails with L{PartialDownloadError}. �brokenc s � � | jd�S �Nrl )ry ri ��excrE r+ r, r� � rX z;WebClientTests.test_getPageBrokenDownload.<locals>.<lambda>)r r� r� � assertFailure�PartialDownloadErrorr� �r* r� r+ rE r, �test_getPageBrokenDownload� s z)WebClientTests.test_getPageBrokenDownloadc s` t ��� �� t���d�� j�}��|tj�}�fdd�}|�|� � �fdd�}|�|� |S )z� If the connection is closed before the number of bytes indicated by I{Content-Length} have been received, the L{Deferred} returned by L{downloadPage} fails with L{PartialDownloadError}. r� c s � � | jd� � � | jd� | S )z} The HTTP status code from the server is propagated through the C{PartialDownloadError}. � 200� OK)ry �status�message)ri rE r+ r, � checkResponse� s zEWebClientTests.test_downloadPageBrokenDownload.<locals>.checkResponsec s �� � �� d� d S r� )ry � getContent��ignored�r� r* r+ r, �cbFailed� s z@WebClientTests.test_downloadPageBrokenDownload.<locals>.cbFailed) r �mktempr � downloadPager� r� r� r� r� )r* r� r� r� r+ r� r, � test_downloadPageBrokenDownload� s z.WebClientTests.test_downloadPageBrokenDownloadc s� t td�� G � fdd�d�}t� �t�ttjd�g��t��� �� �fdd�� t � �� d�|� �}�� |t j�}� ��fdd �}|�|� |S ) z� If there is an exception closing the file being written to after the connection is prematurely closed, that exception is logged. zNo file left on devicec s e Zd Zdd� Z� fdd�ZdS )zFWebClientTests.test_downloadPageLogsFileCloseError.<locals>.BrokenFilec S s d S r& r+ )r* �bytesr+ r+ r, r? � s zLWebClientTests.test_downloadPageLogsFileCloseError.<locals>.BrokenFile.writec s � �d S r& r+ rE r� r+ r, �close� s zLWebClientTests.test_downloadPageLogsFileCloseError.<locals>.BrokenFile.closeN�r9 r: r; r? r� r+ r� r+ r, � BrokenFile� s r� )ZdefaultLogLevelc s t �� �S r& )r ZremoveObserverr+ )�filteredr+ r, r� � rX zDWebClientTests.test_downloadPageLogsFileCloseError.<locals>.<lambda>r� c sZ �� dt��� �d }|d }��|jt� �� |jj� j� ��t��t��d� d S )Nrs r Z log_failure)Z assertEqualsrd �assertIsInstancer� �IOErrorr0 ry ZflushLoggedErrors)r� Zevent�f)r� � logObserverr* r+ r, r� � s �zDWebClientTests.test_downloadPageLogsFileCloseError.<locals>.cbFailed)r� r r r r r! Zcriticalr Z addObserver� addCleanupr r� r� r� r� r� )r* r� r� r� r+ )r� r� r� r* r, �#test_downloadPageLogsFileCloseError� s � z2WebClientTests.test_downloadPageLogsFileCloseErrorc C sL t �t�| �d���| jdt| j� �tj| �d�ddid��| jd�g�S )Nr� s 127.0.0.1:r� s www.example.com)r� ) r � gatherResultsr r� r� r� ry r r� rE r+ r+ r, �testHostHeader� s � � ��z WebClientTests.testHostHeaderc C s" t �| �d��}|�| jd� |S )z� L{client.getPage} returns a L{Deferred} which is called back with the body of the response if the default method B{GET} is used. �filer� r� r� r+ r+ r, � test_getPage� s zWebClientTests.test_getPagec C s& t j| �d�dd�}|�| jd� |S )z� L{client.getPage} returns a L{Deferred} which is called back with the empty string if the method is I{HEAD} and there is a successful response code. r� s HEAD�r. rX r� r� r+ r+ r, �test_getPageHEAD� s z WebClientTests.test_getPageHEADc C s& t j| �d�dd�}|�| jd� |S )z� If the request method is a different casing of I{HEAD} (ie, not all capitalized) then it is not a I{HEAD} request and the response body is returned. z miscased-heads Headr� r� r� r� r+ r+ r, �test_getPageNotQuiteHEAD� s z'WebClientTests.test_getPageNotQuiteHEADc C s2 t j| �d�dd�}|�| jtd| jf �� |S )z� When a non-zero timeout is passed to L{getPage} and the page is retrieved before the timeout period elapses, the L{Deferred} is called back with the contents of the page. r� rb r� z 127.0.0.1:%s)r r� r� r� ry r r� r� r+ r+ r, �test_timeoutNotTriggering� s �z(WebClientTests.test_timeoutNotTriggeringc C s$ d| _ | �tj| �d�dd�tj�S )z� When a non-zero timeout is passed to L{getPage} and that many seconds elapse before the server responds to the request. the L{Deferred} is errbacked with a L{error.TimeoutError}. rs �waitg���ư>r� )r� r� r r� r� r � TimeoutErrorrE r+ r+ r, �test_timeoutTriggering s �z%WebClientTests.test_timeoutTriggeringc C sf g }d| � � dfd| � � dfg}|D ]6\}}}t�| �|�|�}|�| j||� |�|� q$t�|�S )Nr� r� Znolengthr[ ) r� r r� r� r� �_cbDownloadPageTestrK r r� )r* Z downloadsZ downloadDatar) r5 re r� r+ r+ r, �testDownloadPage s � z WebClientTests.testDownloadPagec C s. t |d��}|�� }W 5 Q R X | �||� d S )N�rb)�openrc ry )r* r� re r5 r� r� r+ r+ r, r� s z"WebClientTests._cbDownloadPageTestc C s. G dd� d�}|� }| � t�| �d�|�t�S )Nc @ s e Zd Zdd� Zdd� ZdS )z8WebClientTests.testDownloadPageError1.<locals>.errorfilec S s t d��d S )Nz badness happened during write�r� �r* re r+ r+ r, r? & s z>WebClientTests.testDownloadPageError1.<locals>.errorfile.writec S s d S r& r+ rE r+ r+ r, r� ( s z>WebClientTests.testDownloadPageError1.<locals>.errorfile.closeNr� r+ r+ r+ r, � errorfile% s r� r� �r� r r� r� r� �r* r� Zefr+ r+ r, �testDownloadPageError1$ s �z%WebClientTests.testDownloadPageError1c C s. G dd� d�}|� }| � t�| �d�|�t�S )Nc @ s e Zd Zdd� Zdd� ZdS )z8WebClientTests.testDownloadPageError2.<locals>.errorfilec S s d S r& r+ r� r+ r+ r, r? 1 s z>WebClientTests.testDownloadPageError2.<locals>.errorfile.writec S s t d��d S )Nz badness happened during closer� rE r+ r+ r, r� 3 s z>WebClientTests.testDownloadPageError2.<locals>.errorfile.closeNr� r+ r+ r+ r, r� 0 s r� r� r� r� r+ r+ r, �testDownloadPageError2/ s �z%WebClientTests.testDownloadPageError2c C sD t dd��� t�dd� | �t�| �d�d�t�}|� | j � |S )N� unwritable�wbr r� ) r� r� �os�chmodr� r r� r� r� ZaddBoth�_cleanupDownloadPageError3r� r+ r+ r, �testDownloadPageError3: s � z%WebClientTests.testDownloadPageError3c C s t �dd� t �d� |S )Nr� i� )r� r� �unlink)r* r� r+ r+ r, r� E s z)WebClientTests._cleanupDownloadPageError3c sV g }dD ]>\}}||�}� � |tj�}|�|f� fdd� � |�|� qtj|dd�S )N))Z nosuchfiles 404)r � 401)zerror?showlength=1r� c s � � | jd |�S rn )ry r0 )r� r3 rE r+ r, r� P rX z.WebClientTests._downloadTest.<locals>.<lambda>T)ZfireOnOneErrback)r� r �Errorr� rK r r� )r* r. Zdlr) r3 r� r+ rE r, � _downloadTestJ s z WebClientTests._downloadTestc s � � � fdd��S )Nc s t �� �| ��S r& )r r� r� �r) rE r+ r, r� U rX z0WebClientTests.testServerError.<locals>.<lambda>�r rE r+ rE r, �testServerErrorT s z WebClientTests.testServerErrorc s � � � fdd��S )Nc s t �� �| �| �d�d �S )N�?r )r r� r� �splitr rE r+ r, r� X rX z8WebClientTests.testDownloadServerError.<locals>.<lambda>r rE r+ rE r, �testDownloadServerErrorW s z&WebClientTests.testDownloadServerErrorc C sF | � d�}tj�|�}t�|�}t�t|j�|j |� |j � | j |�S �Nr� ) r� r �URI� fromBytesr� r Z connectTCPr r� r� �deferredr� �_cbFactoryInfo�r* r) �urir� r+ r+ r, �testFactoryInfoZ s z WebClientTests.testFactoryInfoc C sH | � |jd� | �|j�d�� | � |jd� | � |jd d d� d S )Nr� s HTTP/r� rV r � 10)ry r� Z assertTrue�version� startswithr� �response_headers)r* Z ignoredResultr� r+ r+ r, r a s z WebClientTests._cbFactoryInfoc C s" t �| �d��}|�| jd� |S )zy By default, L{client.getPage} follows redirects and returns the content of the target resource. �redirectr� r� r� r+ r+ r, �test_followRedirecth s z"WebClientTests.test_followRedirectc C s. | � tj| �d�dd�tj�}|�| j� |S )z� If C{followRedirect} is passed a false value, L{client.getPage} does not follow redirects and returns a L{Deferred} which fails with L{error.PageRedirect} when it encounters one. r F��followRedirect)r� r r� r� r � PageRedirectr� �_cbCheckLocationr� r+ r+ r, �test_noFollowRedirectr s � z$WebClientTests.test_noFollowRedirectc C s | � |jd� d S )Nr� )ry �location)r* r� r+ r+ r, r s z WebClientTests._cbCheckLocationc sD � �fdd�}t j��d�t jdd�� ��� jtj�}|�|� |S )�� When more than C{redirectLimit} HTTP redirects are encountered, the page request fails with L{InfiniteRedirection}. c s" �� � jd� �� �jjd� d S )N� �ry Z_redirectCountr� ro �rp �r� r* r+ r, �checkRedirectCount� s zCWebClientTests.test_infiniteRedirection.<locals>.checkRedirectCount�infiniteRedirectr )� redirectLimit) r �_makeGetterFactoryr� r� r� r r �InfiniteRedirectionr� �r* r r� r+ r r, �test_infiniteRedirection� s � z'WebClientTests.test_infiniteRedirectionc sH t j| �d�dd�� t j| �d�dd�}| �|tj��� fdd��}|S )z� C{client.HTTPPagerGetter} instances each obey the C{followRedirect} value passed to the L{client.getPage} call which created them. r Tr Fc s � S r& r+ )Zdummy�Zd1r+ r, r� � rX z<WebClientTests.test_isolatedFollowRedirect.<locals>.<lambda>)r r� r� r� r r r� )r* Zd2r� r+ r' r, �test_isolatedFollowRedirect� s �z*WebClientTests.test_isolatedFollowRedirectc sT � � d�}tj|ddd�}� �|jd� � fdd�}tj|dddd�}|�|� |S ) z� Enabling unsafe redirection behaviour overwrites the method of redirected C{POST} requests with C{GET}. �extendedRedirect?code=302T� POST)r r. z*By default, afterFoundGet must be disabledc s � � � jjdd� d S �N� GETz6With afterFoundGet, the HTTP method must change to GET�ry r� r- �ZpagerE r+ r, �gotPage� s �z2WebClientTests.test_afterFoundGet.<locals>.gotPage�r � afterFoundGetr. )r� r r� Z assertFalser1 r� r� )r* r) r� r/ r� r+ rE r, �test_afterFoundGet� s � � z!WebClientTests.test_afterFoundGetc s8 � � d�}� fdd�}tj|ddddd�}|�|� |S )z� Passing C{True} for C{afterFoundGet} to L{client.downloadPage} invokes the same kind of redirect handling as passing that argument to L{client.getPage} invokes. r) c s � � � jjdd� d S r+ r- r. rE r+ r, r/ � s �z:WebClientTests.test_downloadAfterFoundGet.<locals>.gotPageZ downloadTempTr* r0 )r� r r� r� )r* r) r/ r� r+ rE r, �test_downloadAfterFoundGet� s � z)WebClientTests.test_downloadAfterFoundGetc s6 � fdd�}� � d�}tj|dddd�}|�|� |S )z� When C{afterFoundGet} is C{True}, L{client.getPage} only issues one request to the server when following the redirect. This is a regression test, see #4760. c s � � � jjd� d S rr )ry r� ro r rE r+ r, r � s zLWebClientTests.test_afterFoundGetMakesOneRequest.<locals>.checkRedirectCountZafterFoundGetRedirectTr* r0 )r� r r� r� )r* r r) r� r+ rE r, �!test_afterFoundGetMakesOneRequest� s � z0WebClientTests.test_afterFoundGetMakesOneRequestc C s\ d| _ tj| �d�| �� dd�}tj| �d�| �� dd�}t�| �|tj�| �|tj�g�S )a4 If the timeout indicated by the C{timeout} parameter to L{client.HTTPDownloader.__init__} elapses without the complete response being received, the L{defer.Deferred} returned by L{client.downloadPage} fires with a L{Failure} wrapping a L{defer.TimeoutError}. r� r� g{�G�z�?r� zwrite-then-wait) r� r r� r� r� r r� r� r� )r* �first�secondr+ r+ r, �test_downloadTimeout� s � � �z#WebClientTests.test_downloadTimeoutc C s. d| _ tj| �d�| �� dd�}| �|tj�S )ax If the timeout indicated by the C{timeout} parameter to L{client.HTTPDownloader.__init__} elapses without the complete response being received, the L{defer.Deferred} returned by L{client.downloadPage} fires with a L{Failure} wrapping a L{defer.TimeoutError}, even if the remote peer isn't reading data from the socket. rs z never-readg�������?r� )r� r r� r� r� r� r r� r� r+ r+ r, �'test_downloadTimeoutsWorkWithoutReading� s �z6WebClientTests.test_downloadTimeoutsWorkWithoutReadingc s> �fdd�� t j��d�t j��� d���j�� �fdd��S )z� After L{client.HTTPDownloader.deferred} fires, the L{client.HTTPDownloader} instance's C{status} and C{response_headers} attributes are populated with the values from the response. c sJ � � | jd� � � | jd d d� � � | jd d d� t�| j� d S )Nr� s content-typer s text/htmlrV r )ry r� r r� r� ZfileName)r� rE r+ r, � checkHeaders s z9WebClientTests.test_downloadHeaders.<locals>.checkHeadersr� )� fileOrNamec s � ��S r& r+ ��_)r9 r� r+ r, r� rX z5WebClientTests.test_downloadHeaders.<locals>.<lambda>)r r# r� �HTTPDownloaderr� r r� rE r+ )r9 r� r* r, �test_downloadHeaders s �z#WebClientTests.test_downloadHeadersc sF �� � � tj��d�tj� ddid�}� �fdd�}|j�|� |jS )z� The C{cookies} dict passed to the L{client.HTTPDownloader} initializer is used to populate the I{Cookie} header included in the request sent to the server. � cookiemirror� foo� bar)r: r� c s �� t� ��� d� d S )Ns [('foo', 'bar')])ry r r� r� ��outputr* r+ r, � cbFinished' s �z7WebClientTests.test_downloadCookies.<locals>.cbFinished)r� r r# r� r= r r� )r* r� rD r+ rB r, �test_downloadCookies s � z#WebClientTests.test_downloadCookiesc sJ � �fdd�}t j��d�t j��� dd�� ��� jtj�}|� |� |S )r c s" �� � jd� �� �jjd� d S )N� r r r r+ r, r 4 s zEWebClientTests.test_downloadRedirectLimit.<locals>.checkRedirectCountr! rF )r: r" ) r r# r� r= r� r� r r r$ r� r% r+ r r, �test_downloadRedirectLimit/ s � z)WebClientTests.test_downloadRedirectLimitc C s< d}t �|�}| �|ddddf|j|j|j|j|jf� dS )zv L{client.HTTPClientFactory.setURL} alters the scheme, host, port and path for absolute URLs. � http://example.com� http� example.com�P � /N)r r� ry r) �schemer� r� r� )r* r) r� r+ r+ r, � test_setURLB s �zWebClientTests.test_setURLc C sF t �d�}d}|�|� | �|ddddf|j|j|j|j|jf� dS )zu L{client.HTTPClientFactory.setURL} removes the fragment identifier from the path component. rH s# https://foo.com:8443/bar;123?a#frags httpss foo.comi� s /bar;123?aN� r r� �setURLry r) rM r� r� r� �r* r� r) r+ r+ r, �test_setURLRemovesFragmentN s �z)WebClientTests.test_setURLRemovesFragmentc C sF t �d�}d}|�|� | �|ddddf|j|j|j|j|jf� dS )zW L{client.HTTPClientFactory.setURL} alters the path in a relative URL. rH s /hellorI rJ rK NrO rQ r+ r+ r, �test_setURLRelativePath[ s �z&WebClientTests.test_setURLRelativePathN)1r9 r: r; r r� r� r" r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r r r r r& r( r2 r3 r4 r7 r8 r> rE rG rN rR rS r+ r+ r+ r, r� 5 sV # ( r� c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )�WebClientSSLTestsc C s t jd|t�tt�dd�S )Nr r� �ZcontextFactoryr� )r � listenSSLr � DefaultOpenSSLContextFactory� serverPEMPathr� r+ r+ r, r� i s ��zWebClientSSLTests._listenc C s t d| j|f �S �Nzhttps://127.0.0.1:%d/%s�r r� �r* r� r+ r+ r, r� p s zWebClientSSLTests.getURLc C sL | � d�}tj�|�}t�|�}t�t|j�|j |t � � � |j � | j|�S r )r� r r r r� r Z connectSSLr r� r� r ZClientContextFactoryr r� r r r+ r+ r, r s s �z!WebClientSSLTests.testFactoryInfoN)r9 r: r; r� r� r r+ r+ r+ r, rT h s rT c @ sB e Zd Zejed�gZdd� Zdd� Zdd� Zdd � Z d d � Z d S ) �,WebClientRedirectBetweenSSLandPlainTextTestsr} c C s t d| j|f �S rY )r � tlsPortnor[ r+ r+ r, �getHTTPS� s z5WebClientRedirectBetweenSSLandPlainTextTests.getHTTPSc C s t d| j|f �S �Nzhttp://127.0.0.1:%d/%s)r � plainPortnor[ r+ r+ r, �getHTTP� s z4WebClientRedirectBetweenSSLandPlainTextTests.getHTTPc C s� t dd�}t dd�}tj|d d�}tj|d d�}tjd|t�tt�dd�| _tj d|dd�| _ | j � � j | _ | j� � j | _|�d t| �d ��� |�d t| �d ��� |�d t| �d��� |�dt dd�� d S )Ns not me� text/plains me neitherr� r r� rU r� s oneZtwos twoZthrees threeZfours four� FOUND IT!)r r r� r rV r rW rX �tlsPortr� � plainPortr� r� r` r] r� r r^ ra )r* Z plainRootZtlsRootZ plainSiteZtlsSiter+ r+ r, r� � s( ��z2WebClientRedirectBetweenSSLandPlainTextTests.setUpc C s& t ttj| jj| jjg��}t�|�S r& )rI �mapr Z maybeDeferredre r� rd r� )r* Zdsr+ r+ r, r� � s ��z5WebClientRedirectBetweenSSLandPlainTextTests.tearDownc C s t �| �d���| jd�S )NZonerc �r r� ra r� ry rE r+ r+ r, �testHoppingAround� s �z>WebClientRedirectBetweenSSLandPlainTextTests.testHoppingAroundN) r9 r: r; r r� r� r^ ra r� r� rh r+ r+ r+ r, r\ ~ s r\ c @ sb e Zd Zejed�gZdd� Zdd� Zdd� Zdd � Z d d � Z d d � Z dd� Z dd� Z dd� ZdS )� CookieTestsr} c C s t jd|dd�S r� r� r� r+ r+ r, r� � s zCookieTests._listenc C sR t dd�}|�dt� � |�dt� � tj|d d�}| �|�| _| j�� j| _ d S )Ns El toro!rb r� s rawcookiemirrorr� ) r r� rG rR r r� r� r� r� r� )r* �rootr� r+ r+ r, r� � s zCookieTests.setUpc C s | j �� S r& )r� r� rE r+ r+ r, r� � s zCookieTests.tearDownc C s t d| j|f �S r_ rZ r[ r+ r+ r, ra � s zCookieTests.getHTTPc C s t �| �d���| jd�S )Nr? s []rg rE r+ r+ r, � testNoCookies� s �zCookieTests.testNoCookiesc C s( ddd�}t j| �d�|d��| jd�S )NrA r� �r@ r r? �r� s! [('baz', 'quux'), ('foo', 'bar')]rg �r* r� r+ r+ r, �testSomeCookies� s �zCookieTests.testSomeCookiesc C s t �| �d���| jd�S )N�rawcookiemirrorrS rg rE r+ r+ r, �testRawNoCookies� s �z CookieTests.testRawNoCookiesc C s( ddd�}t j| �d�|d��| jd�S )NrA r� rl rp rm )s 'foo=bar; baz=quux's 'baz=quux; foo=bar')r r� ra r� r� rn r+ r+ r, �testRawSomeCookies� s �z CookieTests.testRawSomeCookiesc C sf t �d�}|�d�}t� }|�|� dD ]}|�|d � q(| �|�� d� | �|jdddd �� d S ) N� http://foo.example.com/� 127.42.42.42) s 200 Oks Squash: yess Hands: stolensU Set-Cookie: CUSTOMER=WILE_E_COYOTE; path=/; expires=Wednesday, 09-Nov-99 23:12:40 GMTs4 Set-Cookie: PART_NUMBER=ROCKET_LAUNCHER_0001; path=/s% Set-Cookie: SHIPPING=FEDEX; path=/foos Set-Cookie: HttpOnly;SecurerX s bodys more body� sI GET / HTTP/1.0 Host: foo.example.com User-Agent: Twisted PageGetter s WILE_E_COYOTEs ROCKET_LAUNCHER_0001s FEDEX)s CUSTOMERs PART_NUMBERs SHIPPING) r r� � buildProtocolr r� Z dataReceivedry r� r� )r* r� r� rF �liner+ r+ r, �testCookieHeaderParsing� s ���z#CookieTests.testCookieHeaderParsingN)r9 r: r; r r� r� r� r� r� ra rk ro rq rr rx r+ r+ r+ r, ri � s ri c @ sV e Zd ZdZejed�gZdd� Zdd� Zdd� Z d d � Z d d � Z d d� Z dd� Z dS )�HostHeaderTestsz\ Test that L{HTTPClientFactory} includes the port in the host header if needed. r} c C s\ |� d�D ]L}z2|� dd�\}}|�� �� dkr>|�� W S W q tk rT Y q X q dS )zq Retrieve the value of the I{Host} header from the serialized request given by C{bytes}. ru � :rs r] N)r �strip�lower� ValueError)r* r� rw r5 r� r+ r+ r, �_getHost� s zHostHeaderTests._getHostc C s< t �d�}|�d�}|�t� � | �| �|j�� �d� dS )zq No port should be included in the host header when connecting to the default HTTP port. rs s 127.42.42.42� foo.example.comN� r r� rv r� r ry r~ rF r� �r* r� r� r+ r+ r, �test_HTTPDefaultPort s �z$HostHeaderTests.test_HTTPDefaultPortc C s< t �d�}|�d�}|�t� � | �| �|j�� �d� dS )z� No port should be included in the host header when connecting to the default HTTP port even if it is in the URL. s http://foo.example.com:80/rt r Nr� r� r+ r+ r, �test_HTTPPort80 s �z HostHeaderTests.test_HTTPPort80c C s< t �d�}|�d�}|�t� � | �| �|j�� �d� dS )zx The port should be included in the host header when connecting to the a non default HTTP port. � http://foo.example.com:8080/rt � foo.example.com:8080Nr� r� r+ r+ r, �test_HTTPNotPort80$ s �z"HostHeaderTests.test_HTTPNotPort80c C s< t �d�}|�d�}|�t� � | �| �|j�� �d� dS )zr No port should be included in the host header when connecting to the default HTTPS port. s https://foo.example.com/rt r Nr� r� r+ r+ r, �test_HTTPSDefaultPort0 s �z%HostHeaderTests.test_HTTPSDefaultPortc C s< t �d�}|�d�}|�t� � | �| �|j�� �d� dS )z� No port should be included in the host header when connecting to the default HTTPS port even if it is in the URL. s https://foo.example.com:443/rt r Nr� r� r+ r+ r, �test_HTTPSPort443< s �z!HostHeaderTests.test_HTTPSPort443c C s< t �d�}|�d�}|�t� � | �| �|j�� �d� dS )zy The port should be included in the host header when connecting to the a non default HTTPS port. r� rt r� Nr� r� r+ r+ r, �test_HTTPSNotPort443H s �z$HostHeaderTests.test_HTTPSNotPort443N)r9 r: r; r< r r� r� r~ r� r� r� r� r� r� r+ r+ r+ r, ry � s ry rW zOpenSSL not presentzReactor doesn't support SSLc @ s� e Zd ZdZdd� Zd$dd�Zdd� Zd d � Zd d � Zd d� Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#S )%�URITestsa Abstract tests for L{twisted.web.client.URI}. Subclass this and L{unittest.TestCase}. Then provide a value for C{host} and C{uriHost}. @ivar host: A host specification for use in tests, must be L{bytes}. @ivar uriHost: The host specification in URI form, must be a L{bytes}. In most cases this is identical with C{host}. IPv6 address literals are an exception, according to RFC 3986 section 3.2.2, as they need to be enclosed in brackets. In this case this variable is different. c C sB | � | jt� | � | jt� | � |t� | �d|� |�d| j�S )a� Replace the string "HOST" in C{template} with this test's host. Byte strings Python between (and including) versions 3.0 and 3.4 cannot be formatted using C{%} or C{format} so this does a simple replace. @type template: L{bytes} @param template: A string containing "HOST". @rtype: L{bytes} @return: A string where "HOST" has been replaced by C{self.host}. s HOST)r� r� r� �uriHostr� �replace)r* �templater+ r+ r, � makeURIStringm s zURITests.makeURIStringrX c C s@ | � |||||||| f|j|j|j|j|j|j|j|jf� dS )aU Assert that all of a L{client.URI}'s components match the expected values. @param uri: U{client.URI} instance whose attributes will be checked for equality. @type scheme: L{bytes} @param scheme: URI scheme specifier. @type netloc: L{bytes} @param netloc: Network location component. @type host: L{bytes} @param host: Host name. @type port: L{int} @param port: Port number. @type path: L{bytes} @param path: Hierarchical path. @type params: L{bytes} @param params: Parameters for last path segment, defaults to C{b''}. @type query: L{bytes} @param query: Query string, defaults to C{b''}. @type fragment: L{bytes} @param fragment: Fragment identifier, defaults to C{b''}. N) ry rM �netlocr� r� r� �params�query�fragment) r* r rM r� r� r� r� r� r� r� r+ r+ r, �assertURIEquals� s ! ��zURITests.assertURIEqualsc C sd t j�| �d��}| �d|j� t j�| �d��}| �d|j� t j�| �d��}| �d|j� dS )z� L{client.URI.fromBytes} by default assumes port 80 for the I{http} scheme and 443 for the I{https} scheme. � http://HOSTrK s http://HOST:� https://HOSTi� N�r r r r� ry r� �r* r r+ r+ r, �test_parseDefaultPort� s z URITests.test_parseDefaultPortc C sL t jj| �d�dd�}| �d|j� t jj| �d�dd�}| �d|j� dS )z� L{client.URI.fromBytes} accepts a C{defaultPort} parameter that overrides the normal default port logic. r� � )Z defaultPortr� Nr� r� r+ r+ r, �test_parseCustomDefaultPort� s � �z$URITests.test_parseCustomDefaultPortc C sj t j�| �d��}| �d|j� | �| j|j� | �| jd |j� t j�| �d��}| �| j|j� dS )zj Parsing a I{URI} splits the network location component into I{host} and I{port}. s http://HOST:5144r� s :5144s http://HOST N) r r r r� ry r� r� r� r� r� r+ r+ r, �test_netlocHostPort� s �z URITests.test_netlocHostPortc C sD | � d�}tj�|�}| j|d| j| jddd� | �||�� � dS )z/ Parse the path from a I{URI}. s http://HOST/foo/barrI rK � /foo/bar�rM r� r� r� r� N� r� r r r r� r� r� ry �toBytes�r* r Zparsedr+ r+ r, � test_path� s �zURITests.test_pathc C sD | � d�}tj�|�}| j|d| j| jddd� | �||�� � dS )zL The path of a I{URI} that has no path is the empty string. r� rI rK rX r� Nr� r� r+ r+ r, � test_noPath� s �zURITests.test_noPathc C s0 | � d�}| jtj�|�d| j| jddd� dS )zE The path of a I{URI} with an empty path is C{b'/'}. � http://HOST/rI rK rL r� N)r� r� r r r r� r� r� r+ r+ r, �test_emptyPath� s �zURITests.test_emptyPathc C sF | � d�}tj�|�}| j|d| j| jdddd� | �||�� � dS )z8 Parse I{URI} parameters from a I{URI}. s http://HOST/foo/bar;paramrI rK r� � param)rM r� r� r� r� r� Nr� r� r+ r+ r, � test_param s �zURITests.test_paramc C sH | � d�}tj�|�}| j|d| j| jddddd� | �||�� � dS ) z7 Parse the query string from a I{URI}. s! http://HOST/foo/bar;param?a=1&b=2rI rK r� r� � a=1&b=2)rM r� r� r� r� r� r� Nr� r� r+ r+ r, � test_query s � zURITests.test_queryc C sJ | � d�}tj�|�}| j|d| j| jdddddd� | �||�� � d S ) z> Parse the fragment identifier from a I{URI}. s& http://HOST/foo/bar;param?a=1&b=2#fragrI rK r� r� r� s frag)rM r� r� r� r� r� r� r� Nr� r� r+ r+ r, � test_fragment$ s � zURITests.test_fragmentc C s$ t j�| �d��}| �d|j� dS )zn L{client.URI.originForm} produces an absolute I{URI} path including the I{URI} path. s http://HOST/foos /fooN�r r r r� ry Z originFormr� r+ r+ r, �test_originForm7 s �zURITests.test_originFormc C s$ t j�| �d��}| �d|j� dS )z� L{client.URI.originForm} produces an absolute I{URI} path including the I{URI} path, parameters and query string but excludes the fragment identifier. s http://HOST/foo;param?a=1#frags /foo;param?a=1Nr� r� r+ r+ r, �test_originFormComplexA s �z URITests.test_originFormComplexc C s$ t j�| �d��}| �d|j� dS )zp L{client.URI.originForm} produces a path of C{b'/'} when the I{URI} specifies no path. r� rL Nr� r� r+ r+ r, �test_originFormNoPathL s z URITests.test_originFormNoPathc C s$ t j�| �d��}| �d|j� dS )zv L{client.URI.originForm} produces a path of C{b'/'} when the I{URI} specifies an empty path. r� rL Nr� r� r+ r+ r, �test_originFormEmptyPathU s �z!URITests.test_originFormEmptyPathc C sV | � d�}|�d�}t|� tj�|�}| �|jt� | �|j t� | �|j t� dS )z� L{client.URI.fromBytes} parses the scheme, host, and path elements into L{bytes}, even when passed an URL which has previously been passed to L{urlparse} as a L{unicode} string. s http://HOST/path�asciiN) r� �decoder r r r r� rM r� r� r� )r* Z goodInputZbadInputr r+ r+ r, � test_externalUnicodeInterference_ s z)URITests.test_externalUnicodeInterferenceN)rX rX rX )r9 r: r; r< r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r+ r+ r+ r, r� ^ s( � ' r� c @ s e Zd ZdZd ZZdS )�URITestsForHostnamez> Tests for L{twisted.web.client.URI} with host names. rJ N�r9 r: r; r< r� r� r+ r+ r+ r, r� o s r� c @ s e Zd ZdZd ZZdS )�URITestsForIPv4zG Tests for L{twisted.web.client.URI} with IPv4 host addresses. s 192.168.1.67Nr� r+ r+ r+ r, r� x s r� c @ s e Zd ZdZdZdZdd� ZdS )�URITestsForIPv6z� Tests for L{twisted.web.client.URI} with IPv6 host addresses. IPv6 addresses must always be surrounded by square braces in URIs. No attempt is made to test without. s fe80::20c:29ff:fea4:c60s [fe80::20c:29ff:fea4:c60]c C s< t j�d�}| �|jd� | �|jd� | �|�� d� dS )z� Brackets around IPv6 addresses are stripped in the host field. The host field is then exported with brackets in the output of L{client.URI.toBytes}. s http://[::1]:80/index.htmls ::1s [::1]:80N)r r r ry r� r� r� r� r+ r+ r, �"test_hostBracketIPv6AddressLiteral� s z2URITestsForIPv6.test_hostBracketIPv6AddressLiteralN)r9 r: r; r< r� r� r� r+ r+ r+ r, r� � s r� c @ sH e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Zd d � Z dd� Z dS )�DeprecationTestszB Tests that L{client.getPage} and friends are deprecated. c C s� t jdt�tdd��dd�}|�� j}| �|j� t d|f �}t � |�}| � | j g�}| �t|�d� | �|d d t� | �|d d d � |�d d � �S ) z2 L{client.getPage} is deprecated. r rX rb r� r� �http://127.0.0.1:%drs r~ r� z�twisted.web.client.getPage was deprecated in Twisted 16.7.0; please use https://pypi.org/project/treq/ or twisted.web.client.Agent insteadc S s d S r& r+ r; r+ r+ r, r� � rX z9DeprecationTests.test_getPageDeprecated.<locals>.<lambda>)r r� r r� r r� r� r� r� r r r� � flushWarnings�test_getPageDeprecatedry rd r� � addErrback)r* r� r� r) r� � warningInfor+ r+ r, r� � s" � �z'DeprecationTests.test_getPageDeprecatedc C s� t jdt�tdd��dd�}|�� j}| �|j� t d|f �}t | � � �}t � ||j�}| �| jg�}| �t|�d� | �|d d t� | �|d d d � |�d d � �S ) z7 L{client.downloadPage} is deprecated. r rX rb r� r� r� rs r~ r� z�twisted.web.client.downloadPage was deprecated in Twisted 16.7.0; please use https://pypi.org/project/treq/ or twisted.web.client.Agent insteadc S s d S r& r+ r; r+ r+ r, r� � rX z>DeprecationTests.test_downloadPageDeprecated.<locals>.<lambda>)r r� r r� r r� r� r� r� r r r� r r� r� r� �test_downloadPageDeprecatedry rd r� r� )r* r� r� r) r� r� r� r+ r+ r, r� � s$ � �z,DeprecationTests.test_downloadPageDeprecatedc C sT t t|� | �� }| �t|�d� | �|d d t� | �|d d d�|�� dS )z� Assert that accessing the given class was deprecated. @param klass: The class being deprecated. @type klass: L{str} rs r r~ r� z�twisted.web.client.{} was deprecated in Twisted 16.7.0: please use https://pypi.org/project/treq/ or twisted.web.client.Agent insteadN)�getattrr r� ry rd r� �format)r* �klassr� r+ r+ r, �_testDeprecatedClass� s ��z%DeprecationTests._testDeprecatedClassc C s | � d� dS )z9 L{client.HTTPPageGetter} is deprecated. r� N�r� rE r+ r+ r, � test_httpPageGetterDeprecated� s z.DeprecationTests.test_httpPageGetterDeprecatedc C s | � d� dS )z= L{client.HTTPPageDownloader} is deprecated. �HTTPPageDownloaderNr� rE r+ r+ r, �!test_httpPageDownloaderDeprecated� s z2DeprecationTests.test_httpPageDownloaderDeprecatedc C s | � d� dS )z< L{client.HTTPClientFactory} is deprecated. r� Nr� rE r+ r+ r, � test_httpClientFactoryDeprecated� s z1DeprecationTests.test_httpClientFactoryDeprecatedc C s | � d� dS )z9 L{client.HTTPDownloader} is deprecated. r= Nr� rE r+ r+ r, � test_httpDownloaderDeprecated� s z.DeprecationTests.test_httpDownloaderDeprecatedN) r9 r: r; r< r� r� r� r� r� r� r� r+ r+ r+ r, r� � s r� c @ s e Zd ZdZdd� ZdS )�GetPageMethodInjectionTests�@ Test L{client.getPage} against HTTP method injections. c C s d}t j||d� dS )�v Attempt a request with the provided method. @param method: see L{MethodInjectionTestsMixin} � http://twisted.invalidr� N�r r� �r* r. r r+ r+ r, �!attemptRequestWithMaliciousMethod s z=GetPageMethodInjectionTests.attemptRequestWithMaliciousMethodN�r9 r: r; r< r� r+ r+ r+ r, r� � s r� c @ s e Zd ZdZdd� ZdS )�GetPageURIInjectionTestsz8 Test L{client.getPage} against URI injections. c C s t �|� dS )�m Attempt a request with the provided URI. @param uri: see L{URIInjectionTestsMixin} Nr� r� r+ r+ r, � attemptRequestWithMaliciousURI s z7GetPageURIInjectionTests.attemptRequestWithMaliciousURIN�r9 r: r; r< r� r+ r+ r+ r, r� s r� c @ s e Zd ZdZdd� ZdS )� DownloadPageMethodInjectionTestsr� c C s d}t j|t�� |d� dS )r� r� )r� r. N�r r� �io�BytesIOr� r+ r+ r, r� * s zBDownloadPageMethodInjectionTests.attemptRequestWithMaliciousMethodNr� r+ r+ r+ r, r� " s r� c @ s e Zd ZdZdd� ZdS )� DownloadPageURIInjectionTestsz= Test L{client.downloadPage} against URI injections. c C s t j|t�� d� dS )r� )r� Nr� r� r+ r+ r, r� = s z<DownloadPageURIInjectionTests.attemptRequestWithMaliciousURINr� r+ r+ r+ r, r� 5 s r� c C s> t �| �}||_||_||_d|_d|_i |_d|_i |_ |S )aV Make a L{ClientFactory} that can be used with L{client.HTTPPageGetter} and its subclasses. @param protocolClass: The protocol class @type protocolClass: A subclass of L{client.HTTPPageGetter} @param method: the HTTP method @param host: the host @param path: The URI path @return: A L{ClientFactory}. rI r s User/Agent) r Z forProtocolr. r� r� rM r� r� r� r� )� protocolClassr. r� r� r� r+ r+ r, �makeHTTPPageGetterFactoryG s r� c @ s e Zd ZdZejZdd� ZdS )�"HTTPPageGetterMethodInjectionTestszG Test L{client.HTTPPageGetter} against HTTP method injections. c C s: t � }t| j|ddd�}|�t�ddd��}|�|� dS )�r Attempt a request with the provided method. @param method: L{MethodInjectionTestsMixin} s twisted.invalidrL �r. r� r� �TCPr� r N�r r� r� rv r Z IPv4Addressr� )r* r. rF r� �getterr+ r+ r, r� p s � �zDHTTPPageGetterMethodInjectionTests.attemptRequestWithMaliciousMethodN)r9 r: r; r< r r� r� r� r+ r+ r+ r, r� g s r� c @ s e Zd ZdZejZdd� ZdS )� HTTPPageGetterURIInjectionTestszD Test L{client.HTTPPageGetter} against HTTP URI injections. c C s: t � }t| jd||d�}|�t�ddd��}|�|� dS )�i Attempt a request with the provided URI. @param uri: L{URIInjectionTestsMixin} r, r� r� r� r Nr� )r* r rF r� r� r+ r+ r, r� � s � �z>HTTPPageGetterURIInjectionTests.attemptRequestWithMaliciousURIN)r9 r: r; r< r r� r� r� r+ r+ r+ r, r� � s r� c @ s e Zd ZdZejZdS )�&HTTPPageDownloaderMethodInjectionTestszK Test L{client.HTTPPageDownloader} against HTTP method injections. N�r9 r: r; r< r r� r� r+ r+ r+ r, r� � s r� c @ s e Zd ZdZejZdS )�#HTTPPageDownloaderURIInjectionTestszH Test L{client.HTTPPageDownloader} against HTTP URI injections. Nr� r+ r+ r+ r, r� � s r� c @ s e Zd ZdZdd� ZdS )�%HTTPClientFactoryMethodInjectionTestszK Tests L{client.HTTPClientFactory} against HTTP method injections. c C s t �d|� dS )r� � https://twisted.invalidN�r r� �r* r. r+ r+ r, r� � s zGHTTPClientFactoryMethodInjectionTests.attemptRequestWithMaliciousMethodNr� r+ r+ r+ r, r� � s r� c @ s e Zd ZdZdd� ZdS )�"HTTPClientFactoryURIInjectionTestszH Tests L{client.HTTPClientFactory} against HTTP URI injections. c C s t �|� dS �r� Nr� r� r+ r+ r, r� � s zAHTTPClientFactoryURIInjectionTests.attemptRequestWithMaliciousURINr� r+ r+ r+ r, r� � s r� c @ s e Zd ZdZdd� ZdS )�(HTTPClientFactorySetURLURIInjectionTestszO Tests L{client.HTTPClientFactory.setURL} against HTTP URI injections. c C s t �d��|� dS �r� r� N)r r� rP r� r+ r+ r, r� � s zGHTTPClientFactorySetURLURIInjectionTests.attemptRequestWithMaliciousURINr� r+ r+ r+ r, r� � s r� c @ s e Zd ZdZdd� ZdS )�"HTTPDownloaderMethodInjectionTestszH Tests L{client.HTTPDownloader} against HTTP method injections. c C s t jdt�� |d� dS )r� r� r� N�r r= r� r� r� r+ r+ r, r� � s �zDHTTPDownloaderMethodInjectionTests.attemptRequestWithMaliciousMethodNr� r+ r+ r+ r, r� � s r� c @ s e Zd ZdZdd� ZdS )� HTTPDownloaderURIInjectionTestszE Tests L{client.HTTPDownloader} against HTTP URI injections. c C s t �|t�� � dS r� r� r� r+ r+ r, r� s z>HTTPDownloaderURIInjectionTests.attemptRequestWithMaliciousURINr� r+ r+ r+ r, r� s r� c @ s e Zd ZdZdd� ZdS )�%HTTPDownloaderSetURLURIInjectionTestszL Tests L{client.HTTPDownloader.setURL} against HTTP URI injections. c C s t �dt�� �}|�|� dS r� )r r= r� r� rP )r* r Z downloaderr+ r+ r, r� s �zDHTTPDownloaderSetURLURIInjectionTests.attemptRequestWithMaliciousURINr� r+ r+ r+ r, r� s r� )lr< Z __future__r r r� r� �errnor r r � ImportErrorZ urllib.parseZtwisted.python.compatr r r Z twisted.trialr r Z twisted.webr r r r Ztwisted.web.staticr Ztwisted.web.utilr Ztwisted.internetr r r r Ztwisted.internet.protocolr Ztwisted.python.filepathr Ztwisted.protocols.policiesr Ztwisted.test.proto_helpersr r r r Ztwistedr Ztwisted.loggerr r r r! r" Z!twisted.web.test.injectionhelpersr# r$ �__file__ZsiblingZ serverPEMZ asBytesModer� rX r' r% r= rD rG rR rU rZ r\ ra rf rj rm rt ZTestCaseru r| r� rT r\ ri ry �hasattrZcase�skipZ IReactorSSLr� r� r� r� r� ZSynchronousTestCaser� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r+ r+ r+ r, �<module> s� ' ). 7,L^ b � � � � � � � � � � � � � �
Save File
Cancel