U ¹êW[ð—ã@sdZddlmZmZmZddlmZe ¡r4edƒ‚ddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlZddlZddlZz ddlZWnek r dZYnXzddlZddlZWnek rÎdZYnXddlmZddlmZmZddlmZdd lmZmZmZdd l m!Z!m"Z"m#Z#dd l$m%Z%m&Z&dd l'm(Z(dd l)m*Z*e#j+Z+iZ,dd„Z-dd„Z.dd„Z/dd„Z0e0ƒZ1Gdd„de"j2ƒZ3Gdd„de"j2ƒZ4Gdd„de(e5ƒZ6Gdd„de5ƒZ7e7ƒZ8dd„Z9ee*ƒGd d!„d!e6ƒƒZ:ee*ƒGd"d#„d#e"j2e6ƒƒZ;dS)$z… UNIX Process management. Do NOT use this module directly - use reactor.spawnProcess() instead. Maintainer: Itamar Shtull-Trauring é)ÚdivisionÚabsolute_importÚprint_function)Úplatformz^twisted.internet.process does not work on Windows. Use the reactor.spawnProcess() API instead.N)Ú implementer)ÚlogÚfailure)Ú switchUID)ÚitemsÚrangeÚ_PY3)ÚfdescÚabstractÚerror)ÚCONNECTION_LOSTÚCONNECTION_DONE)Ú BaseProcess)ÚIProcessTransportcCstt ¡ƒD] }| ¡q dS)z( Reap all registered processes. N)ÚlistÚreapProcessHandlersÚvaluesÚ reapProcess)Úprocess©rú:/usr/lib/python3/dist-packages/twisted/internet/process.pyÚreapAllProcesses9srcCsj|tkrtdƒ‚zt |tj¡\}}Wn&t d|¡t ¡d}YnX|r^| |¡n|t|<dS)z² Register a process handler for the given pid, in case L{reapAllProcesses} is called. @param pid: the pid of the process. @param process: a process handler. z.Try to register an already registered process.úFailed to reap %d:N) rÚ RuntimeErrorÚosÚwaitpidÚWNOHANGrÚmsgÚerrÚ processEnded)ÚpidrZauxPIDÚstatusrrrÚregisterReapProcessHandlerDs  r&cCs&|tkrt||kstdƒ‚t|=dS)zd Unregister a process handler previously registered with L{registerReapProcessHandler}. z+Try to unregister a process not registered.N)rr)r$rrrrÚunregisterReapProcessHandler\s  ÿr'cCsVt ¡\}}t |d¡t |gggd¡\}}}|r:d}nd}t |¡t |¡|S)a On some Linux version, write-only pipe are detected as readable. This function is here to check if this bug is present or not. See L{ProcessWriter.doRead} for a more detailed explanation. @return: C{True} if Linux pipe behaviour is broken. @rtype : L{bool} óarTF)rÚpipeÚwriteÚselectÚclose)ÚrÚwZreadsZwritesZexesZbrokenPipeBehaviorrrrÚdetectLinuxBrokenPipeBehaviorhs    r/c@sNeZdZdZdZdZdZddd„Zdd„Zd d „Z d d „Z d d„Z dd„Z dS)Ú ProcessWriteraÿ (Internal) Helper class to write into a Process's input pipe. I am a helper which describes a selectable asynchronous writer to a process's input pipe, including stdin. @ivar enableReadHack: A flag which determines how readability on this write descriptor will be handled. If C{True}, then readability may indicate the reader for this write descriptor has been closed (ie, the connection has been lost). If C{False}, then readability events are ignored. érFcCs–tj ||¡t |¡||_||_||_t  t   |  ¡¡j ¡sHd|_n<|rTd|_n0zt  |  ¡d¡Wntk r‚d|_YnX|jr’| ¡dS)zJ Initialize, specifying a Process instance to connect to. FTrN)rÚFileDescriptorÚ__init__r ÚsetNonBlockingÚprocÚnameÚfdÚstatÚS_ISFIFOrÚfstatÚfilenoÚst_modeÚenableReadHackÚreadÚOSErrorÚ startReading)ÚselfÚreactorr5r6r;Ú forceReadHackrrrr3•s  zProcessWriter.__init__cCs|jS)z< Return the fileno() of my process's stdin. ©r7©rArrrr;µszProcessWriter.filenocCs,t |j|¡}|t|ƒkr(|jr(| ¡|S©z6 Write some data to the open process. )r Ú writeToFDr7Úlenr=r@)rAÚdataÚrvrrrÚ writeSomeData¼szProcessWriter.writeSomeDatacCs| ¡tj ||¡dS©N)Ú stopReadingrr2r*©rArIrrrr*ÉszProcessWriter.writecCsJ|jr>tr8|j}t |g|ggd¡\}}}|r<|r POLLOUT (writable in select), write pipe is not completely empty => POLLIN (readable in select), write pipe's reader closed => POLLIN|POLLERR (readable and writable in select) That's what this funky code is for. If linux was not broken, this function could be simply "return CONNECTION_LOST". BUG: We call select no matter what the reactor. If the reactor is pollreactor, and the fd is > 1024, this will fail. (only occurs on broken versions of linux, though). rN)r=ÚbrokenLinuxPipeBehaviorr7r+rrM)rAr7r-r.ÚxrrrÚdoReadÎszProcessWriter.doReadcCs.t |j¡tj ||¡|j |j|¡dS)z= See abstract.FileDescriptor.connectionLost. N) r Z setBlockingr7rr2ÚconnectionLostr5ÚchildConnectionLostr6©rAÚreasonrrrrRís zProcessWriter.connectionLostN)F) Ú__name__Ú __module__Ú __qualname__Ú__doc__Ú connectedZicr=r3r;rKr*rQrRrrrrr0„s   r0c@sLeZdZdZdZdd„Zdd„Zdd„Zd d „Zd d „Z d d„Z dd„Z dS)Ú ProcessReaderzx ProcessReader I am a selectable representation of a process's output pipe, such as stdout and stderr. TcCs6tj ||¡t |¡||_||_||_| ¡dS)zA Initialize, specifying a process to connect to. N) rr2r3r r4r5r6r7r@)rArBr5r6r;rrrr3s  zProcessReader.__init__cCs|jS)z= Return the fileno() of my process's stderr. rDrErrrr;szProcessReader.filenocCs|dks t‚tS)Nó)ÚAssertionErrorrrNrrrrKs zProcessReader.writeSomeDatacCst |j|j¡S)z@ This is called when the pipe becomes readable. )r Ú readFromFDr7Ú dataReceivedrErrrrQszProcessReader.doReadcCs|j |j|¡dSrL)r5ÚchildDataReceivedr6rNrrrr_&szProcessReader.dataReceivedcCs6|jr2|js2d|_| ¡|j d|jt t¡¡dS)Nr1r) rZZ disconnectingrMrBZ callLaterrRrZFailurerrErrrÚloseConnection*s   ÿzProcessReader.loseConnectioncCs"tj ||¡|j |j|¡dS)zk Close my end of the pipe, signal the Process (which signals the ProcessProtocol). N)rr2rRr5rSr6rTrrrrR2szProcessReader.connectionLostN) rVrWrXrYrZr3r;rKrQr_rarRrrrrr[ûs r[c@sXeZdZdZdZdZdd„Zdd„Zdd„Zd d „Z d d „Z d d„Z dd„Z dd„Z dS)Ú _BaseProcessz0 Base class for Process and PTYProcess. Nc CsšzTzt |jtj¡\}}Wn6tk rP}z|jtjkr>d}n‚W5d}~XYnXWn(t d|j¡t  ¡d}YnX|r–|  |¡t ||ƒdS)a Try to reap a process (without blocking) via waitpid. This is called when sigchild is caught or a Process object loses its "connection" (stdout is closed) This ought to result in reaping all zombie processes, since it will be called twice as often as it needs to be. (Unfortunately, this is a slightly experimental approach, since UNIX has no way to be really sure that your process is going to go away w/o blocking. I don't want to block.) Nr) rrr$r r?ÚerrnoZECHILDrr!r"r#r')rAr$r%ÚerrrrCs    z_BaseProcess.reapProcesscCsHd}}t |¡rt |¡}n t |¡}|s0|r>t |||¡St |¡SrL)rÚ WIFEXITEDÚ WEXITSTATUSÚWTERMSIGrZProcessTerminatedZ ProcessDone)rAr%ZexitCodeZsigrrrÚ _getReasonbs   z_BaseProcess._getReasonc Csx|dkrttd|fƒ}|jdkr(tƒ‚zt |j|¡Wn8tk rr}z|jtjkr`tƒ‚n‚W5d}~XYnXdS)a* Send the given signal C{signalID} to the process. It'll translate a few signals ('HUP', 'STOP', 'INT', 'KILL', 'TERM') from a string representation to its int value, otherwise it'll pass directly the value provided @type signalID: C{str} or C{int} )ZHUPZSTOPZINTZKILLZTERMzSIG%sN) ÚgetattrÚsignalr$ÚProcessExitedAlreadyrÚkillr?rcZESRCH)rAZsignalIDrdrrrÚ signalProcessms   z_BaseProcess.signalProcesscCs4tdtjƒD]"}t |¡tjkr t |tj¡q dS©Nr1)r rjÚNSIGÚ getsignalÚSIG_IGNÚSIG_DFL)rAZ signalnumrrrÚ_resetSignalDispositionƒsz$_BaseProcess._resetSignalDispositionc Ks t ¡}t ¡zt ¡|_Wn|r2t ¡‚YnÐX|jdkrz.t d¡|j f|Ž|  ||||||¡Wnˆznt  dd¡} d  |t |ƒt|ƒ¡} tr²tj| dd} |  | ¡tj| d|  ¡td ƒD]} t | ¡qØWn YnXYnXt d ¡|rt ¡d |_dS) aÀ Fork and then exec sub-process. @param path: the path where to run the new process. @type path: L{bytes} or L{unicode} @param uid: if defined, the uid used to run the new process. @type uid: L{int} @param gid: if defined, the gid used to run the new process. @type gid: L{int} @param executable: the executable to run in a new process. @type executable: L{str} @param args: arguments used to create the new process. @type args: L{list}. @param environment: environment used for the new process. @type environment: L{dict}. @param kwargs: keyword arguments to L{_setupChild} method. rNéÚwbz,Upon execvpe {0} {1} in environment id {2} :zutf-8)Úencoding©Úfileér1éÿÿÿÿ)ÚgcÚ isenabledÚdisablerÚforkr$ÚenableÚsysÚsettraceÚ _setupChildÚ _execChildÚfdopenÚformatÚstrÚidr ÚioÚ TextIOWrapperr*Ú tracebackÚ print_excÚflushr r,Ú_exitr%) rAÚpathÚuidÚgidÚ executableÚargsÚ environmentÚkwargsZcollectorEnabledÚstderrr!r7rrrÚ_forksH   ÿ þ     z_BaseProcess._forkcOs tƒ‚dS)zB Setup the child process. Override in subclasses. N)ÚNotImplementedError)rAr’r”rrrr‚õsz_BaseProcess._setupChildcCsn|rt |¡|dk s|dk r\|dkr.t ¡}|dkr>t ¡}t d¡t d¡t||ƒt |||¡dS)z? The exec() which is done in the forked child. Nr)rÚchdirÚgeteuidÚgetegidÚsetuidÚsetgidr Úexecvpe)rArŽrrr‘r’r“rrrrƒüs    z_BaseProcess._execChildcCsd|jj|j|jfS)z5 String representation of a process. z<%s pid=%s status=%s>)Ú __class__rVr$r%rErrrÚ__repr__sÿz_BaseProcess.__repr__)rVrWrXrYr%r$rrhrmrsr–r‚rƒrŸrrrrrb<s  frbc@sPeZdZdZejZejZeZdd„Z dd„Z dd„Z dd „Z d d „Z d d „ZdS)Ú _FDDetectorav This class contains the logic necessary to decide which of the available system techniques should be used to detect the open file descriptors for the current process. The chosen technique gets monkey-patched into the _listOpenFDs method of this class so that the detection only needs to occur once. @ivar listdir: The implementation of listdir to use. This gets overwritten by the test cases. @ivar getpid: The implementation of getpid to use, returns the PID of the running process. @ivar openfile: The implementation of open() to use, by default the Python builtin. cCs|j|j|jg|_dSrL)Ú_procFDImplementationÚ_devFDImplementationÚ_fallbackFDImplementationÚ_implementationsrErrrr3+sþz_FDDetector.__init__cCs| ¡|_| ¡S)zÄ Return an iterable of file descriptors which I{may} be open in this process. This will try to return the fewest possible descriptors without missing any. )Ú_getImplementationÚ _listOpenFDsrErrrr¦1s z_FDDetector._listOpenFDsc CsZ|jD]N}z |ƒ}WnYqYnX| dd¡ |ƒ}W5QRX||kr|Sq|S)a¿ Pick a method which gives correct results for C{_listOpenFDs} in this runtime environment. This involves a lot of very platform-specific checks, some of which may be relatively expensive. Therefore the returned method should be saved and re-used, rather than always calling this method to determine what it is. See the implementation for the details of how a method is selected. z /dev/nullr-)r¤Úopenfile)rAÚimplZbeforeZafterrrrr¥=s    z_FDDetector._getImplementationcCsd}dd„| |¡Dƒ}|S)z‰ Simple implementation for systems where /dev/fd actually works. See: http://www.freebsd.org/cgi/man.cgi?fdescfs z/dev/fdcSsg|] }t|ƒ‘qSr©Úint©Ú.0r7rrrÚ asz4_FDDetector._devFDImplementation..)Úlistdir)rAÚdnameÚresultrrrr¢[sz _FDDetector._devFDImplementationcCs"d| ¡f}dd„| |¡DƒS)zk Simple implementation for systems where /proc/pid/fd exists (we assume it works). z /proc/%d/fdcSsg|] }t|ƒ‘qSrr©r«rrrr­ksz5_FDDetector._procFDImplementation..)Úgetpidr®)rAr¯rrrr¡esz!_FDDetector._procFDImplementationcCsDz ddl}Wntk r$d}YnXtd| |j¡dƒ}t|ƒS)au Fallback implementation where either the resource module can inform us about the upper bound of how many FDs to expect, or where we just guess a constant maximum if there is no resource module. All possible file descriptors from 0 to that upper bound are returned with no attempt to exclude invalid file descriptor values. rNir1)ÚresourceÚ ImportErrorÚminZ getrlimitZ RLIMIT_NOFILEr )rAr²Zmaxfdsrrrr£ns   z%_FDDetector._fallbackFDImplementationN)rVrWrXrYrr®r±Úopenr§r3r¦r¥r¢r¡r£rrrrr s   r cCst ¡S)zZ Use the global detector object to figure out which FD implementation to use. )Údetectorr¦rrrrr¦†sr¦c@s²eZdZdZdZdZdZdZeZ e Z d'dd„Z dd„Z d d „Zd d „Zd d„Zdd„Zdd„Zdd„Zdd„Zdd„Zdd„Zdd„Zdd„Zdd „Zd!d"„Zd#d$„Zd%d&„ZdS)(ÚProcessaÍ An operating-system Process. This represents an operating-system process with arbitrary input/output pipes connected to it. Those pipes may represent standard input, standard output, and standard error, or any other file descriptor. On UNIX, this is implemented using fork(), exec(), pipe() and fcntl(). These calls may not exist elsewhere so this code is not cross-platform. (also, windows can only select on sockets...) FrzNc  sP|s$d|  ¡kst‚d|  ¡ks$t‚t ||¡i|_i} | dkrNddddœ} |j} | rbtd| ƒg‰‡fdd„} i} zöt| ƒD]°\}}| rštd||ƒ|dkrÒ| ƒ\}}| rÀtd ||fƒ|| |<|| |<q€|dkr | ƒ\}}| rútd ||fƒ|| |<|| |<q€t|ƒt ks(td |fƒ‚|| |<q€| rBtd | ƒ| rRtd | ƒ|j ||||||| d Wn$ˆD]} t   | ¡qx‚YnX||_ t| ƒD]l\}}t   | |¡| |dkrÞ| ||||¡}||j|<| |dkr |j||||dd}||j|<q z|j dk r(|j  |¡Wnt ¡YnXt|j|ƒdS)á  Spawn an operating-system process. This is where the hard work of disconnecting all currently open files / forking / executing the new process happens. (This is executed automatically when a Process is instantiated.) This will also run the subprocess as a given user ID and group ID, if specified. (Implementation Note: this doesn't support all the arcane nuances of setXXuid on UNIX: it will assume that either your effective or real UID is 0.) r-r.N)rr1rtÚchildFDscs"t ¡\}}ˆ ||g¡||fSrL)rr)Úextend)r-r.©Z _openedPipesrrr)Ìs zProcess.__init__..pipez[%d]zreadFD=%d, writeFD=%dz%r should be an intÚfdmapÚhelpers)r¼T)rC)rr]rbr3ÚpipesÚdebugÚprintr Útyperªr–rr,ÚprotoÚprocessReaderFactoryÚprocessWriterFactoryÚmakeConnectionrr"r&r$)rArBr‘r’r“rŽrÂrrr¹r½r¿r)r¼ÚchildFDÚtargetZreadFDZwriteFDZparentFDÚreaderÚwriterrr»rr3¦s€ þ           ÿ  ÿ zProcess.__init__c Cs¨|j}|rtj}| d¡| ¡}tƒD]<}||kr6q(|rH|| ¡krHq(zt |¡Wq(Yq(Xq(|rxt d||dt |  ¡ƒD]¶}||}||kr¸|r¬t d||dt   |¡q„|| ¡krt |¡}|rèt d||f|dt |¡t|ƒD]\} } | |krú||| <qú|r.t d||f|dt ||¡q„g} | ¡D](}|| krH||  ¡krH|  |¡qH|r†t d| |d| D]}t |¡qŠ| ¡dS) a fdmap[childFD] = parentFD The child wants to end up with 'childFD' attached to what used to be the parent's parentFD. As an example, a bash command run like 'command 2>&1' would correspond to an fdmap of {0:0, 1:1, 2:1}. 'command >foo.txt' would be {0:0, 1:os.open('foo.txt'), 2:2}. This is accomplished in two steps:: 1. close all file descriptors that aren't values of fdmap. This means 0 .. maxfds (or just the open fds within that range, if the platform supports '/proc//fd'). 2. for each childFD:: - if fdmap[childFD] == childFD, the descriptor is already in place. Make sure the CLOEXEC flag is not set, then delete the entry from fdmap. - if childFD is in fdmap.values(), then the target descriptor is busy. Use os.dup() to move it elsewhere, update all fdmap[childFD] items that point to it, then close the original. Then fall through to the next case. - now fdmap[childFD] is not in fdmap.values(), and is free. Use os.dup2() to move it to the right place, then close the original. zstarting _setupChild r¼rwz%d already in placezos.dup(%d) -> %dzos.dup2(%d,%d)ÚoldN)Ú debug_childr€r•r*rr¦r;rr,rÀÚsortedÚkeysr Z_unsetCloseOnExecÚdupr Údup2Úappendrs) rAr¼r¿ZerrfdZdestListr7ZchildrÇZ newtargetÚcÚprÊrrrr‚ sZ     ÿ     zProcess._setupChildcCs|j| |¡dSrL©r¾r*)rArÆrIrrrÚ writeToChildjszProcess.writeToChildcCs||jkr|j| ¡dSrL)r¾ra)rArÆrrrÚ closeChildFDns zProcess.closeChildFDcCs&|j ¡D]}t|tƒr | ¡q dSrL)r¾Ú itervaluesÚ isinstancer[rM©rArÒrrrÚpauseProducingws zProcess.pauseProducingcCs&|j ¡D]}t|tƒr | ¡q dSrL)r¾rÖr×r[r@rØrrrÚresumeProducing}s zProcess.resumeProducingcCs| d¡dS)zD Call this to close standard input on this process. rN©rÕrErrrÚ closeStdinƒszProcess.closeStdincCs| d¡dSrnrÛrErrrÚ closeStdoutŠszProcess.closeStdoutcCs| d¡dS©NrtrÛrErrrÚ closeStderrŽszProcess.closeStderrcCs| ¡| ¡| ¡dSrL)rÜrßrÝrErrrra’szProcess.loseConnectioncCsd|jkr|jd |¡dS©z’ Call this to write to standard input on this process. NOTE: This will silently lose data if there is no standard input. rNrÓrNrrrr*˜s z Process.writecCs*d|jkr|jd ||¡n| ¡dS)z¨ Call this to register producer for standard input. If there is no standard input producer.stopProducing() will be called immediately. rN)r¾ÚregisterProducerZ stopProducing)rAZproducerZ streamingrrrrá¢s zProcess.registerProducercCsd|jkr|jd ¡dS)z= Call this to unregister producer for standard input.rN)r¾ÚunregisterProducerrErrrrâ¯s zProcess.unregisterProducercCsd|jkr|jd |¡dSrà)r¾Ú writeSequence)rAÚseqrrrrã¶s zProcess.writeSequencecCs|j ||¡dSrL©rÂr`)rAr6rIrrrr`ÀszProcess.childDataReceivedcCsNt |j| ¡¡|j|=z|j |¡Wnt ¡YnX| ¡dSrL) rr,r¾r;rÂrSrr"ÚmaybeCallProcessEnded)rArÆrUrrrrSÄszProcess.childConnectionLostcCs*|jr dS|js| ¡dSt |¡dSrL)r¾Ú lostProcessrrbrærErrrræÐs zProcess.maybeCallProcessEnded)NNN)rVrWrXrYr¿rËr%r$r0rÄr[rÃr3r‚rÔrÕrÙrÚrÜrÝrßrar*rárârãr`rSrærrrrr·s6 þ g]     r·c@sjeZdZdZdZdZddd„Zdd„Zdd „Zd d „Z d d „Z dd„Z dd„Z dd„Z dd„Zdd„ZdS)Ú PTYProcessz< An operating-system Process that uses PTY support. rzNc Cstdkrt| ttfƒstdƒ‚tj ||¡t ||¡t| ttfƒrR| \} } } n t  ¡\} } z|j ||||||| | dWn0t| ttfƒs¦t   | ¡t   | ¡‚YnXt   | ¡t  | ¡| |_| ¡d|_d|_z|j |¡Wnt ¡YnXt|j|ƒdS)r¸Nz:cannot use PTYProcess on platforms without the pty module.)ÚmasterfdÚslavefdr1rz)Úptyr×Útuplerr—rr2r3rbÚopenptyr–rr,r r4r7r@rZr%rÂrÅrr"r&r$) rArBr‘r’r“rŽrÂrrZusePTYrérêÚ_rrrr3ès<ÿ   ÿ     zPTYProcess.__init__cCs¢t |¡t ¡t |tjd¡tdƒD]}||kr*t |¡q*t |d¡t |d¡t |d¡t ƒD](}|dkrlzt |¡WqlYqlXql|  ¡dS)a9 Set up child process after C{fork()} but before C{exec()}. This involves: - closing C{masterfd}, since it is not used in the subprocess - creating a new session with C{os.setsid} - changing the controlling terminal of the process (and the new session) to point at C{slavefd} - duplicating C{slavefd} to standard input, output, and error - closing all other open file descriptors (according to L{_listOpenFDs}) - re-setting all signal handlers to C{SIG_DFL} @param masterfd: The master end of a PTY file descriptors opened with C{openpty}. @type masterfd: L{int} @param slavefd: The slave end of a PTY opened with C{openpty}. @type slavefd: L{int} Úryrr1rtN) rr,ÚsetsidÚfcntlZioctlÚtermiosZ TIOCSCTTYr rÏr¦rs)rArérêr7rrrr‚s        zPTYProcess._setupChildcCsdSrLrrErrrrÜJszPTYProcess.closeStdincCsdSrLrrErrrrÝPszPTYProcess.closeStdoutcCsdSrLrrErrrrßTszPTYProcess.closeStderrcst ˆj‡fdd„¡S)zM Called when my standard output stream is ready for reading. csˆj d|¡Srnrå)rIrErrÚ^r\z#PTYProcess.doRead..)r r^r7rErrErrQXs þzPTYProcess.doReadcCs|jS)zR This returns the file number of standard output on this process. rDrErrrr;aszPTYProcess.filenocCs|jdkrt |¡dSrÞ)rçrbrærErrrræhs z PTYProcess.maybeCallProcessEndedcCs4tj ||¡t |j¡|jd7_| ¡dS)zU I call this to clean up when one or all of my connections has died. r1N)rr2rRrr,r7rçrærTrrrrRss zPTYProcess.connectionLostcCst |j|¡SrF)r rGr7rNrrrrK}szPTYProcess.writeSomeData)NNN)rVrWrXrYr%r$r3r‚rÜrÝrßrQr;rærRrKrrrrrèßs ÿ 11   rè)sb          wA\m Q