← Back
Editing: test_cftp.cpython-38.pyc
U s�@g�� � @ s� d Z ddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl m Z ddlmZ e d�Ze d�Ze d �ZdZer�er�zPdd lmZ dd lmZ dd lmZ dd lmZ ddl m Z m Z ddl m Z W n e!k r� Y nX ddl"m#Z# ddl$m%Z% ddlm&Z& ddlm'Z' ddl(m)Z) ddl*m+Z+m,Z,m-Z-m.Z.m/Z/ ddl0m1Z1m2Z2 ddl3m4Z4 ddl5m6Z6m7Z7 ddl8m9Z9 ddl:m;Z; ddl<m=Z= dd l>m?Z? G d d � d e?�Z@G d d � d e?�ZAG d!d"� d"e;eB�ZCG d#d$� d$eB�ZDG d%d&� d&eB�ZEee%�G d'd(� d(e ��ZFG d)d*� d*e?�ZGG d+d,� d,�ZHG d-d.� d.e,jI�ZJG d/d0� d0e&�ZKG d1d2� d2eK�ZLG d3d4� d4eK�ZMG d5d6� d6eK�ZNdeeee-�Oe+d�fk�r�edk�r�d7ZeeL_PeeM_PeeN_PeeG_Pee@_Pn dd8lQmRZR eRd9��s�d:eN_PdS );z* Tests for L{twisted.conch.scripts.cftp}. � N)�BytesIO)�FilePath)� requireModule)� implementer�pyasn1� cryptographyztwisted.conch.unix)�cftp)� SSHSession)� filetransfer)�FileTransferForTestAvatar)�test_ssh� test_conch)� FakeStdio)�ls)� ISFTPFile)� SFTPTestBase)�FileTransferTestAvatar)�portal)�reactor�protocol� interfaces�defer�error)�getProcessOutputAndValue�getProcessValue)�log)�_PY3�unicode)� UserDatabase)�StringTransport)�Clock)�TestCasec @ s e Zd ZdZdd� ZdS )�SSHSessionTestsz= Tests for L{twisted.conch.scripts.cftp.SSHSession}. c C s* t � }t� }||_|�� | �|j� dS )z| L{twisted.conch.scripts.cftp.SSHSession.eofReceived} loses the write half of its stdio connection. N)r r �stdioZ eofReceived� assertTrueZ writeConnLost)�selfr# Zchannel� r& �>/usr/lib/python3/dist-packages/twisted/conch/test/test_cftp.py�test_eofReceived6 s z SSHSessionTests.test_eofReceivedN)�__name__� __module__� __qualname__�__doc__r( r& r& r& r' r" 2 s r" c @ s� e Zd ZdZeedd�dkr dZdd� Zdd� Zd d � Z d d � Z d d� Z dd� Z e �� ZzBze �e jd� W n e jk r� de _Y nX e �e je� W n Y nX dd� ZdS )� ListingTestsz� Tests for L{lsLine}, the function which generates an entry for a file or directory in an SFTP I{ls} command's output. �tzsetNz8Cannot test timestamp formatting code without time.tzsetc sh d� _ � fdd�}� �td|� dtjkrR� �tjtjdtjd � � �tj � ndd� }� �|� dS ) zo Patch the L{ls} module's time function so the results of L{lsLine} are deterministic. i�[c s � j S �N)�nowr& �r% r& r' �fakeTimeR s z$ListingTests.setUp.<locals>.fakeTime�time�TZc S s. z t jd= W n tk r Y nX t�� d S )Nr4 )�os�environ�KeyErrorr3 r. r& r& r& r' �cleanup\ s z#ListingTests.setUp.<locals>.cleanupN) r0 �patchr r5 r6 � addCleanup�operator�setitemr3 r. )r% r2 r8 r& r1 r' �setUpL s zListingTests.setUpc C s |t jd< t�� t�d|�S )zl Call L{ls.lsLine} after setting the timezone to C{timezone} and return the result. r4 �foo)r5 r6 r3 r. r ZlsLine)r% �timezone�statr& r& r' � _lsInTimezonef s zListingTests._lsInTimezonec C sT | j d }t�dddddddd|df �}| �| �d|�d� | �| �d|�d� dS )z� A file with an mtime six months (approximately) or more in the past has a listing including a low-resolution timestamp. � r �America/New_Yorkz;!--------- 0 0 0 0 Apr 26 1973 foo�Pacific/Aucklandz;!--------- 0 0 0 0 Apr 27 1973 fooN�r0 r5 � stat_result� assertEqualrA �r% �thenr@ r& r& r' � test_oldFiler s � �zListingTests.test_oldFilec C sX | j d d }t�dddddddd|df �}| �| �d|�d� | �| �d|�d� dS ) �� A file with a high-resolution timestamp which falls on a day of the month which can be represented by one decimal digit is formatted with one padding 0 to preserve the columns which come after it. rB i�� r rC z;!--------- 0 0 0 0 May 01 1973 foorD z;!--------- 0 0 0 0 May 02 1973 fooNrE rH r& r& r' � test_oldSingleDigitDayOfMonth� s � �z*ListingTests.test_oldSingleDigitDayOfMonthc C sT | j d }t�dddddddd|df �}| �| �d|�d� | �| �d|�d� dS )z� A file with an mtime fewer than six months (approximately) in the past has a listing including a high-resolution timestamp excluding the year. 逛z r rC �;!--------- 0 0 0 0 Aug 28 17:33 foorD �;!--------- 0 0 0 0 Aug 29 09:33 fooNrE rH r& r& r' � test_newFile� s � �zListingTests.test_newFilec C s| | j d }t�dddddddd|df �}t�� }t�tjd� | �tjtj|� | �| � d|�d� | �| � d|�d� dS ) zC The month name in the date is locale independent. rM r � es_AR.UTF8rC rN rD rO N) r0 r5 rF �locale� getlocale� setlocale�LC_ALLr: rG rA )r% rI r@ � currentLocaler& r& r' �test_localeIndependent� s � �z#ListingTests.test_localeIndependentrQ z'The es_AR.UTF8 locale is not installed.c C sX | j d d }t�dddddddd|df �}| �| �d|�d� | �| �d|�d� dS ) rK rM i F r rC z;!--------- 0 0 0 0 Sep 01 17:33 foorD z;!--------- 0 0 0 0 Sep 02 09:33 fooNrE rH r& r& r' � test_newSingleDigitDayOfMonth� s � �z*ListingTests.test_newSingleDigitDayOfMonth)r) r* r+ r, �getattrr3 �skipr= rA rJ rL rP rW rR rS rV rT rU �ErrorrX r& r& r& r' r- C s& r- c s e Zd ZdZ� fdd�Z� ZS )�InMemorySSHChannelzp Minimal implementation of a L{SSHChannel} like class which only reads and writes data from memory. c s || _ d| _tt| ��� dS )zt @param conn: The SSH connection associated with this channel. @type conn: L{SSHConnection} r N)�connZ localClosed�superr\ �__init__)r% r] �� __class__r& r' r_ � s zInMemorySSHChannel.__init__)r) r* r+ r, r_ � __classcell__r& r& r` r' r\ � s r\ c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) � FilesystemAccessExpectationszC A test helper used to support expected filesystem access. c C s i | _ d S r/ ��_cacher1 r& r& r' r_ � s z%FilesystemAccessExpectations.__init__c C s || j ||f< dS )z� @param path: Path at which the stream is requested. @type path: L{str} @param path: Flags with which the stream is requested. @type path: L{str} @param stream: A stream. @type stream: C{File} Nrd )r% �path�flags�streamr& r& r' �put� s z FilesystemAccessExpectations.putc C s | j �||f�S )a Remove a stream from the memory. @param path: Path at which the stream is requested. @type path: L{str} @param path: Flags with which the stream is requested. @type path: L{str} @return: A stream. @rtype: C{File} )re �pop)r% rf rg r& r& r' rj s z FilesystemAccessExpectations.popN)r) r* r+ r, r_ ri rj r& r& r& r' rc � s rc c @ s e Zd ZdZdd� Zdd� ZdS )�InMemorySFTPClienta' A L{filetransfer.FileTransferClient} which does filesystem operations in memory, without touching the local disc or the network interface. @ivar _availableFiles: File like objects which are available to the SFTP client. @type _availableFiles: L{FilesystemRegister} c C s t | �| _ddd�| _|| _d S )N� � )Zrequests� buffersize)r\ � transport�options�_availableFiles)r% ZavailableFilesr& r& r' r_ ! s �zInMemorySFTPClient.__init__c C s | j �||�S )z} @see: L{filetransfer.FileTransferClient.openFile}. Retrieve and remove cached file based on flags. )rq rj )r% �filenamerg �attrsr& r& r' �openFile* s zInMemorySFTPClient.openFileN)r) r* r+ r, r_ rt r& r& r& r' rk s rk c @ s0 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd S ) �InMemoryRemoteFilez; An L{ISFTPFile} which handles all data in memory. c C s || _ t�| � dS )zL @param name: Name of this file. @type name: L{str} N)�namer r_ )r% rv r& r& r' r_ : s zInMemoryRemoteFile.__init__c C s | � |� | �|� t�| �S )z/ @see: L{ISFTPFile.writeChunk} )�seek�writer �succeed)r% �start�datar& r& r' � writeChunkC s z InMemoryRemoteFile.writeChunkc C s d| _ dS )zo @see: L{ISFTPFile.writeChunk} Keeps data after file was closed to help with testing. TN)�_closedr1 r& r& r' �closeL s zInMemoryRemoteFile.closec C s t �| �S )zb Get current data of file. Allow reading data event when file is closed. )r �getvaluer1 r& r& r' r U s zInMemoryRemoteFile.getvalueN)r) r* r+ r, r_ r| r~ r r& r& r& r' ru 4 s ru c @ s� e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Zd d � Z dd� Z dd� Z dd� Z dd� Z dd� Zdd� Zd)d d �Zd*d d �Zd!d"� Zd#d$� Zd%d&� Zd'd(� ZdS )+�StdioClientTestsz( Tests for L{cftp.StdioClient}. c C sT t � | _t| j�}t�|�| _d| j_t� | _| j_ | � dd� | jjj | j_ dS )zm Create a L{cftp.StdioClient} hooked up to dummy transport and a fake user database. �/i� � N) rc �fakeFilesystemrk r � StdioClient�clientZcurrentDirectoryr �databaseZ_pwd�setKnownConsoleSizero )r% Z sftpClientr& r& r' r= c s zStdioClientTests.setUpc C s@ | j �t�� dt�� dddtj� | j� d�}|� | j d� |S )zs The I{exec} command runs its arguments locally in a child process using the user's shell. �secret�� r> �barzexec print(1 + 2)s 3 ) r� �addUser�getpass�getuserr5 �getuid�sys� executabler� �_dispatchCommand� addCallbackrG �r% �dr& r& r' � test_execw s � zStdioClientTests.test_execc C s> | j �t�� dt�� dddd� | j�d�}|�| j d� |S )zr If the local user has no shell, the I{exec} command runs its arguments using I{/bin/sh}. r� r� r> r� � zexec echo hello� hello � r� r� r� r� r5 r� r� r� r� rG r� r& r& r' �test_execWithoutShell� s � z&StdioClientTests.test_execWithoutShellc C s> | j �t�� dt�� dddd� | j�d�}|�| j d� |S )zO The I{exec} command is run for lines which start with C{"!"}. r� r� r> r� z/bin/shz !echo hellor� r� r� r& r& r' � test_bang� s � zStdioClientTests.test_bangc s4 ddl �G � ��fdd�dt�}| �td|� � dS )a For the duration of this test, patch C{cftp}'s C{fcntl} module to return a fixed width and height. @param width: the width in characters @type width: L{int} @param height: the height in characters @type height: L{int} r Nc s e Zd Z� ��fdd�ZdS )z7StdioClientTests.setKnownConsoleSize.<locals>.FakeFcntlc s& |�j kr| �d� t�d� �dd�S )Nz#Only window-size queries supported.Z4Hr )Z TIOCGWINSZZfail�structZpack)r% �fdZoptZmutate��height�tty�widthr& r' �ioctl� s z=StdioClientTests.setKnownConsoleSize.<locals>.FakeFcntl.ioctlN)r) r* r+ r� r& r� r& r' � FakeFcntl� s r� Zfcntl)r� �objectr9 r )r% r� r� r� r& r� r' r� � s z$StdioClientTests.setKnownConsoleSizec C s� | � dd� t� }| j_td�}d|_t�|�}d|_|� � }|� d� | j d7 _ | j� ||� t rpd}nd }| �| jj�� |� d S ) a( L{StdioClient._printProgressBar} prints a progress description, including percent done, amount transferred, transfer rate, and time remaining, all based the given start time, the given L{FileWrapper}'s progress information and the reactor's current time. rm �" � x� samplei ( g @i s# b'sample' 40% 4.0kB 2.0kBps 00:03 z sample 40% 4.0kB 2.0kBps 00:03 N)r� r r� r r rv r � FileWrapper�size�secondsZadvanceZtotal�_printProgressBarr rG ro �value�r% Zclock�wrapped�wrapperZ startTime�resultr& r& r' � test_printProgressBarReporting� s z/StdioClientTests.test_printProgressBarReportingc C sn | � dd� t� }| j_td�}d|_t�|�}|�� }| j� ||� t rRd}nd}| � | jj � � |� dS )z� L{StdioClient._printProgressBar} prints a progress description that indicates 0 bytes transferred if no bytes have been transferred and no time has passed. rm r� r� r� s! b'sample' 0% 0.0B 0.0Bps 00:00 z sample 0% 0.0B 0.0Bps 00:00 N)r� r r� r r rv r r� r� r� r rG ro r� r� r& r& r' � test_printProgressBarNoProgress� s z0StdioClientTests.test_printProgressBarNoProgressc C sV | � dd� t� }d|_t�|�}| j�|d� tr:d}nd}| �|| jj � � � dS )z5 Print the progress for empty files. rm r� s empty-filer s% b'empty-file'100% 0.0B 0.0Bps 00:00 z" empty-file100% 0.0B 0.0Bps 00:00 N) r� r rv r r� r� r� r rG ro r� )r% r� r� r� r& r& r' � test_printProgressBarEmptyFile� s z/StdioClientTests.test_printProgressBarEmptyFilec C s | j �d�}| �d|� dS )zK Returns empty value for both filename and remaining data. z )r� r� N�r� Z _getFilenamerG �r% r� r& r& r' �test_getFilenameEmpty� s z&StdioClientTests.test_getFilenameEmptyc C s | j �d�}| �d|� dS )zd Returns empty value for remaining data when line contains only a filename. � only-local)r� r� Nr� r� r& r& r' �test_getFilenameOnlyLocal s z*StdioClientTests.test_getFilenameOnlyLocalc C s | j �d�}| �d|� dS )ze Returns filename and remaining data striped of leading and trailing spaces. z local remote file )�localz remote fileNr� r� r& r& r' �test_getFilenameNotQuoted s z*StdioClientTests.test_getFilenameNotQuotedc C s | j �d�}| �d|� dS )z� Returns filename and remaining data not striped of leading and trailing spaces when quoted paths are requested. z" " local file " " remote file " )z local file z" remote file "Nr� r� r& r& r' �test_getFilenameQuoted s z'StdioClientTests.test_getFilenameQuotedN� c C s4 |dkr| � � }t|d��}|�|� W 5 Q R X |S )ab Create a local file and return its path. When `path` is L{None}, it will create a new temporary file. @param path: Optional path for the new file. @type path: L{str} @param content: Content to be written in the new file. @type content: L{bytes} @return: Path to the newly create file. N�wb)�mktemp�openrx )r% rf �content�filer& r& r' �makeFile s zStdioClientTests.makeFileFc C sf | j j�� }tr|�d�}|�d�}g }g }|D ]�\}}}g } |D ]} | �d|| f � qB| �d||f � |�| � |�d��d��d�} | dd� } | d �d ��d �} | � | � g }| dd� D ]F} | �� � d d �d } | �� �d d �} |�d| d | d �� f � q�|�| d � |�|� q0|�rD| � t |�t |�� n | � ||� | � dt |�d � dS )a Check output of cftp client for a put request. @param transfers: List with tuple of (local, remote, progress). @param randomOrder: When set to C{True}, it will ignore the order in which put reposes are received �utf-8z z%s %szTransferred %s to %sr � N���� � � rl z5There are still put responses which were not checked.)r� ro r� r �decode�split�appendrj �strip�extend�rsplitrG �sorted�len)r% Z transfers� randomOrder�output�expectedOutputZ actualOutputr� ZremoteZexpectedZexpectedTransfer�lineZ progressPartsZactualZlastZactualTransferr& r& r' �checkPutMessage3 s> �z StdioClientTests.checkPutMessagec C s� d}| j |d�}tjtjB tjB }tj�dtj�|��}t |�}| j � ||t � |�� d| jjjd< | j�|�}| �|� | �||�� � | �|j� | �||dddgfg� dS ) z� A name based on local path is used when remote path is not provided. The progress is updated while chunks are transferred. s Test Content)r� r� rm rn z 76% 10.0Bz 100% 13.0BN)r� r � FXF_WRITE� FXF_CREAT� FXF_TRUNCr5 rf �join�basenameru r� ri r ry r� rp �cmd_PUT�successResultOfrG r r$ r} r� )r% r� � localPathrg � remoteName� remoteFile�deferredr& r& r' � test_cmd_PUTSingleNoRemotePathq s* ��� ��z/StdioClientTests.test_cmd_PUTSingleNoRemotePathc C s� | � � }tjtjB tjB }d}t|�}| j�||t� |�� | j � d||f �}| � |� | � ||dgfg� | �|j� | �d|�� � dS )z� Remote path is extracted from first filename after local file. Any other data in the line is ignored. z /remote-pathz %s %s ignored� 100% 0.0Br� N)r� r r� r� r� ru r� ri r ry r� r� r� r� r$ r} rG r )r% r� rg r� r� r� r& r& r' � test_cmd_PUTSingleRemotePath� s" ��� � z-StdioClientTests.test_cmd_PUTSingleRemotePathc C s | � � }tj�|�}d}tj�|�}| j tj�||�d�}tjtjB tj B }d|f }d|f }t |�} t |�} | j � ||t �| �� | j � ||t �| �� | j�tj�|d��} | �| � | �| j� | �d| �� � | �| j� | �d| �� � | j||dgf||dgfgdd� d S ) z� When a gobbing expression is used local files are transferred with remote file names based on local names. � second-name�rf z/%s�*r� r� T�r� N�r� r5 rf r� �dirnamer� r r� r� r� ru r� ri r ry r� r� r� r$ r} rG r r� ) r% �first� firstName� secondName�parent�secondrg �firstRemotePath�secondRemotePath�firstRemoteFile�secondRemoteFiler� r& r& r' � test_cmd_PUTMultipleNoRemotePath� sJ ��� � � ��z1StdioClientTests.test_cmd_PUTMultipleNoRemotePathc C s | � � }tj�|�}d}tj�|�}| j tj�||�d�}tjtjB tj B }t |�}t |�}d|f } d|f } | j � | |t �|�� | j � | |t �|�� | j�dtj�|d�f �} | �| � | �|j� | �d|�� � | �|j� | �d|�� � | j||dgf||dgfgdd � d S ) z� When a gobbing expression is used local files are transferred with remote file names based on local names. when a remote folder is requested remote paths are composed from remote path and local filename. r� r� z /remote/%sz %s remoter� r� r� Tr� Nr� ) r% r� r� r� r� r� rg r� r� r� r� r� r& r& r' �"test_cmd_PUTMultipleWithRemotePath� sN ��� � �� ��z3StdioClientTests.test_cmd_PUTMultipleWithRemotePath)Nr� )F)r) r* r+ r, r= r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r& r& r& r' r� _ s& > 'r� c @ s e Zd Zdd� Zdd� ZdS )�FileTransferTestRealmc C s || _ d S r/ )�testDir)r% r� r& r& r' r_ � s z FileTransferTestRealm.__init__c G s t | j�}|d |dd� fS )Nr c S s d S r/ r& r& r& r& r' �<lambda> r� z5FileTransferTestRealm.requestAvatar.<locals>.<lambda>)r r� )r% ZavatarIDZmindr �ar& r& r' � requestAvatar� s z#FileTransferTestRealm.requestAvatarN)r) r* r+ r_ r� r& r& r& r' r� � s r� c @ s` e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Zd d � Z dd� Z dd� Z dd� Z dd� Z dS )�SFTPTestProcessz� Protocol for testing cftp. Provides an interface between Python (where all the tests are) and the cftp client process (which does the work that is being tested). c C s$ | � � || _d| _d| _d| _dS )zr @param onOutReceived: A L{Deferred} to be fired as soon as data is received from stdout. NF)� clearBuffer� onOutReceived� onProcessEnd�_expectingCommand� _processEnded)r% r� r& r& r' r_ s zSFTPTestProcess.__init__c C s d| _ g | _d| _dS )zR Clear any buffered data received from stdout. Should be private. r� N)�buffer�_linesReceived� _lineBufferr1 r& r& r' r� s zSFTPTestProcess.clearBufferc C sr t �d| � | j| �d�}|�d�| _| j�|� | jdk rX| jd }| _|�|� | j |7 _ | � � dS )zO Called by Twisted when the cftp client prints data to stdout. zgot %r� r� N) r �msgr r� rj r r� r� �callbackr� �_checkForCommand)r% r{ �linesr� r& r& r' � outReceived s zSFTPTestProcess.outReceivedc C s^ d}| j rZ| j|krZd�| j�}|�|�r:|t|�d � }| �� | j d }| _ |�|� d S )Ns cftp> r )r� r r� r � startswithr� r� r )r% �promptZbufr� r& r& r' r 2 s z SFTPTestProcess._checkForCommandc C s t �d| � dS )zO Called by Twisted when the cftp client prints data to stderr. zerr: %sN)r r )r% r{ r& r& r' � errReceived= s zSFTPTestProcess.errReceivedc C s | j S )zQ Return the contents of the buffer of data received from stdout. )r� r1 r& r& r' � getBufferD s zSFTPTestProcess.getBufferc C s< t �� | _| �� t|t�r&|�d�}| j�|d � | jS )a� Issue the given command via the cftp client. Return a C{Deferred} that fires when the server returns a result. Note that the C{Deferred} will callback even if the server returns some kind of error. @param command: A string containing an sftp command. @return: A C{Deferred} that fires when the sftp server returns a result. The payload is the server's response string. r� r ) r �Deferredr� r� � isinstancer �encodero rx �r% �commandr& r& r' � runCommandK s zSFTPTestProcess.runCommandc s( t �d��� �fdd�|D �}t �|�S )ax Run each command in sequence and return a Deferred that fires when all commands are completed. @param commands: A list of strings containing sftp commands. @return: A C{Deferred} that fires when all commands are completed. The payload is a list of response strings from the server, in the same order as the commands. rl c s g | ]}�� � j|��qS r& )�runr )�.0r �r% Zsemr& r' � <listcomp>j s z-SFTPTestProcess.runScript.<locals>.<listcomp>)r ZDeferredSemaphoreZ gatherResults)r% �commandsZdlr& r r' � runScript^ s zSFTPTestProcess.runScriptc C s, | j rt�d�S t�� | _| j�d� | jS )z� Kill the process if it is still running. If the process is still running, sends a KILL signal to the transport and returns a C{Deferred} which fires when L{processEnded} is called. @return: a C{Deferred}. N�KILL)r� r ry r r� ro � signalProcessr1 r& r& r' � killProcessn s zSFTPTestProcess.killProcessc C s( d| _ | jr$| jd }| _|�d� dS )zF Called by Twisted when the cftp client process ends. TN)r� r� r )r% �reasonr� r& r& r' � processEnded~ s z SFTPTestProcess.processEndedN)r) r* r+ r, r_ r� r r r r r r r r r& r& r& r' r� s r� c @ s4 e Zd Zdd� Zdd� Zdd� Zdd� Zd d � Zd S ) �CFTPClientTestBasec C s� t dd��}|�tj� W 5 Q R X t dd��}|�tj� W 5 Q R X t�dd� t dd��}|�dtj � W 5 Q R X t� | �S )N� dsa_test.pubr� �dsa_testi�� �kh_tests 127.0.0.1 ) r� rx r ZpublicDSA_opensshZprivateDSA_opensshr5 �chmodZpublicRSA_opensshr r= �r% �fr& r& r' r= � s zCFTPClientTestBase.setUpc C sF t | j�}t�|�}|�t�� � t�� }||_tj d|dd�| _ d S )Nr z 127.0.0.1)Z interface) r� r� r ZPortalZregisterCheckerr ZconchTestPublicKeyCheckerZConchTestServerFactoryr Z listenTCP�server)r% Zrealm�pZfacr& r& r' � startServer� s z CFTPClientTestBase.startServerc C sH t | jjd�s| �d �S d| jjj_t�| jjjjj �}|� | j� |S )N�protorl ) �hasattrr$ �factory� _cbStopServerr' �expectedLoseConnectionr � maybeDeferredro ZloseConnectionr� r� r& r& r' � stopServer� s � z CFTPClientTestBase.stopServerc C s t �| jj�S r/ )r r, r$ Z stopListening�r% �ignoredr& r& r' r* � s z CFTPClientTestBase._cbStopServerc C s0 dD ] }zt �|� W q Y qX qt�| �S )N)r r r )r5 �remover �tearDownr" r& r& r' r1 � s zCFTPClientTestBase.tearDownN)r) r* r+ r= r& r- r* r1 r& r& r& r' r � s r c @ s� e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Zd d � Z dd� Z dd� Z dd� Z d-dd�Z dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Zd+d,� ZdS ).�OurServerCmdLineClientTestsz� Functional tests which launch a SFTP server over TCP on localhost and check cftp command line interface using a spawned process. Due to the spawned process you can not add a debugger breakpoint for the client code. c s, t �� � � �� d}� j�� j}tj|| �� dd�}t � dt j |f � t �� }t|�� _|�� fdd�� tj�� }tj�t j�|d< g }i }|D ]"}t|t�r�|�d�}|�|� q�|D ]<}|| } t|t�r�|�d�}t| t�r�| �d�} | ||< q�t � |� t � |� t j � jt j ||d � |S ) Nz�-p %i -l testuser --known-hosts kh_test --user-authentications publickey --host-key-algorithms ssh-rsa -i dsa_test -a -v 127.0.0.1r ��mod� running %s %sc s � j �� S r/ )�processProtocolr� ��_r1 r& r' r� � r� z3OurServerCmdLineClientTests.setUp.<locals>.<lambda>� PYTHONPATHr� ��env) r r= r& r$ �getHost�portr � _makeArgsr� r r r� r� r r r� r6 r� r5 r6 �copy�pathsepr� rf r r r r� r Z spawnProcess) r% �cmdsr= r� r; Z encodedCmdsZ encodedEnv�cmd�var�valr& r1 r' r= � s< �z!OurServerCmdLineClientTests.setUpc s � � � }|�� fdd�� |S )Nc s � j �� S r/ )r6 r r7 r1 r& r' r� � r� z6OurServerCmdLineClientTests.tearDown.<locals>.<lambda>)r- r� r� r& r1 r' r1 � s z$OurServerCmdLineClientTests.tearDownc C s. z| j j�d� W n tjk r( Y nX d S )Nr )r6 ro r r ZProcessExitedAlreadyr. r& r& r' � _killProcess� s z(OurServerCmdLineClientTests._killProcessc C s | j �|�S )z� Run the given command with the cftp client. Return a C{Deferred} that fires when the command is complete. Payload is the server's output for that command. )r6 r r r& r& r' r � s z&OurServerCmdLineClientTests.runCommandc G s | j �|�S )z� Run the given commands with the cftp client. Returns a C{Deferred} that fires when the commands are all complete. The C{Deferred}'s payload is a list of output for each command. )r6 r )r% r r& r& r' r � s z%OurServerCmdLineClientTests.runScriptc C sL | j }| �ddddd�}dd� }|�|� |�| j|jt�� d|jg� |S )z� Test that 'pwd' reports the current remote directory, that 'lpwd' reports the current local directory, and that changing to a subdirectory then changing to its parent leaves you in the original remote directory. �pwdZlpwdzcd testDirectory�cd ..c S sH g }| D ]&}t r$t|t�r$|�d�}|�|� q|dd� |dd� S )zH Callback function for handling command output. r� N� � )r r �bytesr� r� )r� rA rB r& r& r' � cmdOutput s z8OurServerCmdLineClientTests.testCdPwd.<locals>.cmdOutputr� )r� r r� rG rf r5 �getcwd)r% ZhomeDirr� rK r& r& r' � testCdPwd s �z%OurServerCmdLineClientTests.testCdPwdc s& � fdd�}� � dddd�}|�|�S )z� Check that 'ls -l' output includes the access permissions and that this output changes appropriately with 'chmod'. c sZ � � � � �| d �d�� � �| d d� � �| d �d�| d � � �| d d� d S )Nr s -rw-r--r--rl r� r� s ----------rH )�flushLoggedErrorsr$ r rG �Zresultsr1 r& r' �_check' s z7OurServerCmdLineClientTests.testChAttrs.<locals>._checkzls -l testfile1zchmod 0 testfile1zchmod 644 testfile1�r r� �r% rP r� r& r1 r' � testChAttrs" s �z'OurServerCmdLineClientTests.testChAttrsc s@ � fdd�}� � dd� j�� ddd�}|�dd � � |�|�S ) z� Check 'ls' works as expected. Checks for wildcards, hidden files, listing directories and listing empty directories. c sp � � | d ddddg� � � | d ddddg� � � | d ddg� � � | d d ddg� � � | d d g� d S ) Nr � testDirectory� testRemoveFile� testRenameFile� testfile1rl r� rH s .testHiddenFilerI r� �rG rO r1 r& r' rP 9 s � ��z4OurServerCmdLineClientTests.testList.<locals>._checkr zls ../zls *Filez ls -a *Filezls -l testDirectoryc S s dd� | D �S )Nc S s g | ]}|� d ��qS )r )r� )r �xr& r& r' r D s zJOurServerCmdLineClientTests.testList.<locals>.<lambda>.<locals>.<listcomp>r& )Zxsr& r& r' r� D r� z6OurServerCmdLineClientTests.testList.<locals>.<lambda>)r r� r� r� rR r& r1 r' �testList4 s �z$OurServerCmdLineClientTests.testListc C sD | � d�}t�d��d��� }t|t�r2|�d�}|�| j |� |S )zB Check that running the '?' command returns help. �?Nr� r� ) r r r� Zcmd_HELPr� r r r r� rG )r% r� ZhelpTextr& r& r' �testHelpH s z$OurServerCmdLineClientTests.testHelpNc C s | � |�� |�� |� dS )zg Assert that the files at C{name1} and C{name2} contain exactly the same data. N)rG Z getContent)r% Zname1Zname2r r& r& r' �assertFilesEqualU s z,OurServerCmdLineClientTests.assertFilesEqualc sj d�j j�j jf � t� t�r(� �d�� � �fdd�}��d�j jf �}|�|� |��fdd�� |S )z� Test that 'get' saves the remote file to the correct local location, that the output of 'get' is correct and that 'rm' actually removes the file. z)Transferred %s/testfile1 to %s/test file2r� c s8 �� | �� �� ���j�d��j�d�d� ��d�S )N� testfile1� test file2z get failedzrm "test file2")r$ �endswithr] r� �childr �r� �r� r% r& r' � _checkGeth s �z6OurServerCmdLineClientTests.testGet.<locals>._checkGetz get testfile1 "%s/test file2"c s � � � j�d��� �S )Nr_ �Z assertFalser� ra �existsr7 r1 r& r' r� q s �z5OurServerCmdLineClientTests.testGet.<locals>.<lambda>)r� rf r r r r r� )r% rd r� r& rc r' �testGet] s � z#OurServerCmdLineClientTests.testGetc s � fdd�}� � d�}|�|�S )zQ Test that 'get' works correctly when given wildcard parameters. c s8 � � � j�d�td�d� � � � j�d�td�d� d S )N�testRemoveFile�testRemoveFile get failed�testRenameFile�testRenameFile get failed)r] r� ra r )r/ r1 r& r' rP z s ��z;OurServerCmdLineClientTests.testWildcardGet.<locals>._checkz get testR*)r r� rR r& r1 r' �testWildcardGetv s z+OurServerCmdLineClientTests.testWildcardGetc sf d�j �� j d �j �� j d � � �fdd�}��d�j jf �}|�|� |��fdd�� |S ) z� Check that 'put' uploads files correctly and that they can be successfully removed. Also check the output of the put command. s Transferred s /testfile1 to s /test"file2c s6 �� �j�d��j�d�� ��| �� �� ��d�S )Nr^ � test"file2zrm "test\"file2")r] r� ra r$ r` r rb rc r& r' � _checkPut� s �z6OurServerCmdLineClientTests.testPut.<locals>._checkPutz put %s/testfile1 "test\"file2"c s � � � j�d��� �S )Nrm re r7 r1 r& r' r� � s �z5OurServerCmdLineClientTests.testPut.<locals>.<lambda>)r� � asBytesModerf r r� )r% rn r� r& rc r' �testPut� s � ��� z#OurServerCmdLineClientTests.testPutc s� � j �d�jdd��}|�d� W 5 Q R X � j �d�jdd��}|�d� W 5 Q R X � fdd�}� �d � j jf �}|�|� |S ) zb Check that 'put' uploads files correctly when overwriting a longer file. � shorterFile�w��mode� a� longerFile� bbc s � � � j�d�� j�d�� d S )Nrq rv )r] r� ra rb r1 r& r' rn � s �zEOurServerCmdLineClientTests.test_putOverLongerFile.<locals>._checkPutz put %s/shorterFile longerFile)r� ra r� rx r rf r� �r% r# rn r� r& r1 r' �test_putOverLongerFile� s � z2OurServerCmdLineClientTests.test_putOverLongerFilec s� � j �d����� ��d�jdd��}|�d� W 5 Q R X � j �d�jdd��}|�d� W 5 Q R X � �fdd�}� �d � j jf �}|�|� |S ) z� Check that 'put' uploads files correctly when overwriting a longer file and you use a wildcard to specify the files to upload. �dirr� rr rs ru rw c s � � ��d�� j�d�� d S )Nr� )r] ra r� rb �r% ZsomeDirr& r' rn � s �zMOurServerCmdLineClientTests.test_putMultipleOverLongerFile.<locals>._checkPutz put %s/dir/*)r� ra ZcreateDirectoryr� rx r rf r� rx r& r{ r' � test_putMultipleOverLongerFile� s � z:OurServerCmdLineClientTests.test_putMultipleOverLongerFilec s< � fdd�}� � dd� jjf d� j�� �}|�|� |S )z� What happens if you issue a 'put' command and include a wildcard (i.e. '*') in parameter? Check that all files matching the wildcard are uploaded to the correct directory. c sh � � | d d� � � | d d� � �� j�d�� j�� �d�d� � �� j�d�� j�� �d�d� d S )Nr r� r� rh ri rj rk )rG r] r� ra r� rO r1 r& r' �check� s ��z:OurServerCmdLineClientTests.testWildcardPut.<locals>.checkrG z put %s/testR*zcd %s)r r� rf r� r� )r% r} r� r& r1 r' �testWildcardPut� s � z+OurServerCmdLineClientTests.testWildcardPutc s4 � fdd�}� � dd�}|�|� |�� jd� |S )z� Test that 'ln' creates a file which appears as a link in the output of 'ls'. Check that removing the new file succeeds without output. c s8 � � � � �| d d� � �| d �d�d� � �d�S )Nr r� rl � lz link failedz rm testLink)rN rG r$ r r rO r1 r& r' rP � s z4OurServerCmdLineClientTests.testLink.<locals>._checkzln testLink testfile1zls -l testLinkr� �r r� rG rR r& r1 r' �testLink� s z$OurServerCmdLineClientTests.testLinkc s4 � fdd�}� � dd�}|�|� |�� jd� |S )zV Test that we can create and remove directories with the cftp client. c s. � � | d d� � �| d �d�� � �d�S )Nr r� rl � dzrmdir testMakeDirectory)rG r$ r r rO r1 r& r' rP � s z?OurServerCmdLineClientTests.testRemoteDirectory.<locals>._check�mkdir testMakeDirectoryzls -l testMakeDirector?r� r� rR r& r1 r' �testRemoteDirectory� s � z/OurServerCmdLineClientTests.testRemoteDirectoryc s& � fdd�}� � dd�}|�|� |S )z� Test that a C{mkdir} on an existing directory fails with the appropriate error, and doesn't log an useless error server side. c s$ � � | d d� � � | d d� d S )Nr r� rl s remote error 11: mkdir failedrX rO r1 r& r' rP s �zHOurServerCmdLineClientTests.test_existingRemoteDirectory.<locals>._checkr� rQ rR r& r1 r' � test_existingRemoteDirectory s � z8OurServerCmdLineClientTests.test_existingRemoteDirectoryc sF � � d� jjf �}|�� jd� |�� fdd�� |�� jd� |S )z� Test that we can create a directory locally and remove it with the cftp client. This test works because the 'remote' server is running out of a local directory. z lmkdir %s/testLocalDirectoryr� c s � � d�S )Nzrmdir testLocalDirectory)r r7 r1 r& r' r� r� z@OurServerCmdLineClientTests.testLocalDirectory.<locals>.<lambda>)r r� rf r� rG r� r& r1 r' �testLocalDirectory s z.OurServerCmdLineClientTests.testLocalDirectoryc s4 � fdd�}� � dd�}|�|� |�� jd� |S )z1 Test that we can rename a file. c s* � � | d d� � � | d d� � �d�S )Nr r� rl s testfile2zrename testfile2 testfile1)rG r rO r1 r& r' rP ! s z6OurServerCmdLineClientTests.testRename.<locals>._checkzrename testfile1 testfile2z ls testfile?r� r� rR r& r1 r' � testRename s z&OurServerCmdLineClientTests.testRename)N)r) r* r+ r, r= r1 rE r r rM rS rZ r\ r] rg rl rp ry r| r~ r� r� r� r� r� r& r& r& r' r2 � s, ( r2 c @ s@ e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Zd d � Z dS )�OurServerBatchFileTestszm Functional tests which launch a SFTP server over localhost and checks csftp in batch interface. c C s t �| � | �� d S r/ �r r= r& r1 r& r& r' r= 3 s z OurServerBatchFileTests.setUpc C s t �| � | �� S r/ )r r1 r- r1 r& r& r' r1 8 s z OurServerBatchFileTests.tearDownc s� | � � � t� d��}|�|� W 5 Q R X | j�� j}d|� f }tj|�� dd�dd � }t � dt j |f � t j�� }t j�t j�|d< d| jj_tt j ||d�}� fd d �}|�d d � � |�|� |S ) Nrr z�-p %i -l testuser --known-hosts kh_test --user-authentications publickey --host-key-algorithms ssh-rsa -i dsa_test -a -v -b %s 127.0.0.1r r3 rl r5 r9 r: c s t �� � | S r/ )r5 r0 ��res��fnr& r' �_cleanupR s z9OurServerBatchFileTests._getBatchOutput.<locals>._cleanupc S s | d S )Nr r& r� r& r& r' r� V r� z9OurServerBatchFileTests._getBatchOutput.<locals>.<lambda>)r� r� rx r$ r< r= r r> r� r r r� r� r5 r6 r? r@ r� rf r) r+ r r� ZaddBoth)r% r# �fpr= rA r; r� r� r& r� r' �_getBatchOutput= s" � z'OurServerBatchFileTests._getBatchOutputc s( d}� fdd�}� � |�}|�|� |S )z� Test whether batch file function of cftp ('cftp -b batchfile'). This works by treating the file as a list of commands to be run. z pwd ls exit c sT | � d�} t�dt| � � � �� j�� j| d � � �| dd� dddd g� d S ) Nr zRES %srl rH ���rT rU rV rW ) r� r r �repr�assertInr� ro rf rG r� r1 r& r' �_cbCheckResultf s �z=OurServerBatchFileTests.testBatchFile.<locals>._cbCheckResult�r� r� �r% rA r� r� r& r1 r' � testBatchFile\ s z%OurServerBatchFileTests.testBatchFilec s( d}� fdd�}� � |�}|�|� |S )zO Test that an error in the batch file stops running the batch. z chown 0 missingFile pwd exit c s � � � j�� j| � d S r/ )Z assertNotInr� ro rf r� r1 r& r' r� { s z9OurServerBatchFileTests.testError.<locals>._cbCheckResultr� r� r& r1 r' � testErrorr s z!OurServerBatchFileTests.testErrorc s( d}� fdd�}� � |�}|�|� |S )z_ Test that a minus sign '-' at the front of a line ignores any errors. z -chown 0 missingFile pwd exit c s � � � j�� j| � d S r/ )r� r� ro rf r� r1 r& r' r� � s z@OurServerBatchFileTests.testIgnoredError.<locals>._cbCheckResultr� r� r& r1 r' �testIgnoredError� s z(OurServerBatchFileTests.testIgnoredErrorN) r) r* r+ r, r= r1 r� r� r� r� r& r& r& r' r� - s r� c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �OurServerSftpClientTestsz@ Test the sftp server against sftp command line client. c C s t �| � | �� S r/ r� r1 r& r& r' r= � s z OurServerSftpClientTests.setUpc C s | � � S r/ )r- r1 r& r& r' r1 � s z!OurServerSftpClientTests.tearDownc s� �� � � t� d��}|�d� W 5 Q R X �j�� j�tj��fdd�}��td|� d�jj _ t dd�}� �fd d �}�fd d �}|� |� |� d d� � |� |�S )a Test the return of extended attributes by the server: the sftp client should ignore them, but still be able to parse the response correctly. This test is mainly here to check that L{filetransfer.FILEXFER_ATTR_EXTENDED} has the correct value. rr z ls . exitc s � | |�}d|d< |S )Nr� Zext_foor& )r% �srs )� oldGetAttrr& r' � _getAttrs� s zCOurServerSftpClientTests.test_extendedAttributes.<locals>._getAttrsr� TZssh)�-o� PubkeyAcceptedKeyTypes=ssh-dssz-Vc s> | dkrd}nd}|dddddddd dd �f d � d f 7 }|S ) Nr )r� r� r& z-Fz /dev/nullr� zIdentityFile=dsa_testzUserKnownHostsFile=kh_testzHostKeyAlgorithms=ssh-rsazPort=%iz-bztestuser@127.0.0.1r& )Zstatus�args)r� r= r& r' �hasPAKT� s" �zAOurServerSftpClientTests.test_extendedAttributes.<locals>.hasPAKTc s. � � | d d� dD ]}� �|| d � qd S )Nr� r )rT rU rV rW )rG r� )r� �ir1 r& r' r} � s z?OurServerSftpClientTests.test_extendedAttributes.<locals>.checkc S s t d| �S )N�sftp)r )r� r& r& r' r� � r� zBOurServerSftpClientTests.test_extendedAttributes.<locals>.<lambda>) r� r� rx r$ r< r= r r� r9 r) r+ r r� )r% r# r� r� r� r} r& )r� r� r= r% r' �test_extendedAttributes� s" � z0OurServerSftpClientTests.test_extendedAttributesN)r) r* r+ r, r= r1 r� r& r& r& r' r� � s r� z4don't run w/o spawnProcess or cryptography or pyasn1)�whichr� z%no sftp command-line client available)Sr, rR r3 r� r5 r; r� r� �ior Ztwisted.python.filepathr Ztwisted.python.reflectr Zzope.interfacer r r ZunixZ_reasonZtwisted.conch.scriptsr Ztwisted.conch.scripts.cftpr Ztwisted.conch.sshr Z$twisted.conch.test.test_filetransferr Ztwisted.conch.testr r Z twisted.conch.test.test_conchr � ImportErrorZ twisted.conchr Ztwisted.conch.interfacesr r r Z twisted.credr Ztwisted.internetr r r r r Ztwisted.internet.utilsr r Ztwisted.pythonr Ztwisted.python.compatr r Ztwisted.python.fakepwdr Ztwisted.test.proto_helpersr Ztwisted.internet.taskr Ztwisted.trial.unittestr! r" r- r� r\ rc rk ru r� r� ZProcessProtocolr� r r2 r� r� ZIReactorProcessrZ Ztwisted.python.procutilsr� r& r& r& r' �<module> s� 0 ) * - yhD �
Save File
Cancel