`gj9dZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z m Z ddl mZmZmZmZmZej&eZd dZGdde Zy) zKSSH remote execution environment with ControlMaster connection persistence.N)Path)BaseEnvironment _popen_bash)FileSyncManageriter_sync_filesquoted_mkdir_commandquoted_rm_commandunique_parent_dirsctjds tdtjds tdy)z@Fail fast with a clear error when the SSH client is unavailable.sshzWSSH is not installed or not in PATH. Install OpenSSH client: apt install openssh-clientscpzWSCP is not installed or not in PATH. Install OpenSSH client: apt install openssh-clientN)shutilwhich RuntimeErrorI/root/.hermes/venv/lib/python3.12/site-packages/tools/environments/ssh.py_ensure_ssh_availablersA <<  e   <<  e   rc eZdZdZ d"dedededededef fd Zd#d ed zd efd Zd Z d efdZ d$dZ deded d fdZ dee eefd d fdZded d fdZdeed d fdZd$dZddd ddedededed zd ej*f d Zd!ZxZS)%SSHEnvironmentaRun commands on a remote machine over SSH. Spawn-per-call: every execute() spawns a fresh ``ssh ... bash -c`` process. Session snapshot preserves env vars across calls. CWD persists via in-band stdout markers. Uses SSH ControlMaster for connection reuse. hostusercwdtimeoutportkey_pathct|||_|_|_|_t tjdz _ jjddtj|d|d|jjdd}j|dz _t!j#j%_j)t+fd j,j.j0j2 _j4j7d j9y) N)rrz hermes-sshT)parentsexist_ok@:z.sockc4tjdS)N/.hermes)r _remote_homeselfsrz)SSHEnvironment.__init__..IsD4E4E3Fh1O!Pr) get_files_fn upload_fn delete_fnbulk_upload_fnbulk_download_fn)force)super__init__rrrrrtempfile gettempdir control_dirmkdirhashlibsha256encode hexdigestcontrol_socketr_establish_connection_detect_remote_homer%_ensure_remote_dirsr _scp_upload _ssh_delete_ssh_bulk_upload_ssh_bulk_download _sync_managersync init_session) r'rrrrrr _socket_id __class__s ` rr0zSSHEnvironment.__init__-sF S'2      3 3 56E td;^^fAdV1TF # * * , )+cr #..J?@ D./0 D./0 D/*+ D<=> D-./ 99? JJc$))n- . == JJdmm, -  JJz " dii[$))-. rc|j}|jd tj|dddtj}|j dk7rD|j jxs|jj}td|y#tj$r'td|jd|jd wxYw) Nz!echo 'SSH connection established'Tcapture_outputtextrstdinrzSSH connection failed: zSSH connection to r z timed out) rQrO subprocessrunDEVNULL returncodestderrstripstdoutrTimeoutExpiredrr)r'rPresult error_msgs rr:z$SSHEnvironment._establish_connectionds%%' 67 W^^# (( F  A%"MM//1JV]]5H5H5J "%t j>} t j<||j@t j>t j>}|j@jI |jKd\}}d}|jM|jKd\}}n(|jr|jjOnd}|jdk7r9td|jd|jSd j|jdk7r9td!|jd|jSd j dddtTjWd"tY|y#t"$r} td |d || d} ~ wwxYw#t0$r3} t3| dddk(rt5j6|| nYd} ~ -d} ~ wwxYw#tB$r"|jE|jGwxYw#t jP$rL|jE|jE|jG|jGtdwxYw#1swYxYw)#aUpload many files in a single tar-over-SSH stream. Pipes ``tar c`` on the local side through an SSH connection to ``tar x`` on the remote, transferring all files in one TCP stream instead of spawning a subprocess per file. Directory creation is batched into a single ``mkdir -p`` call beforehand. Typical improvement: ~580 files goes from O(N) scp round-trips to a single streaming transfer. Nr$TrorTrzremote mkdir failed: zhermes-ssh-bulk-)prefixz remote path z is not under sync base .z../z escapes sync base )rwinerrori"tarz-chf-z-Cztar xf - --no-overwrite-dir -C )rWr^r\x)rrrczSSH bulk upload timed outztar create failed (rc=z): replaceerrorsz tar extract over SSH failed (rc=z*SSH: bulk-uploaded %d file(s) via tar pipe)-r%r rQrOrrXrYrZr[rr\r]r1TemporaryDirectoryospathrelpath ValueError startswithjoinmakedirsdirnamesymlinkabspathOSErrorgetattrrcopy2rqrrPopenPIPEr^rgkillwaitclose communicatepollreadr_decodererflen)r'rurjrrPr`stagingrlrm rel_remoteexcstagedetar_cmdssh_cmdtar_procssh_proc_ ssh_stderrtar_stderr_raws rr?zSSHEnvironment._ssh_bulk_uploads ##$H-$U+ ))+C JJ+G4 5^^# (( F  A%"%:6==;N;N;P:Q#RSS ( (0B CM w*/ & ;!#d!CJ $ (=(=e(D&&{o5HQgz: BGGOOF3dCJJrwwy96B! 0fc4#>G--/G NNDDFGI""a'"6x7J7J6K3!(( (:@@BCE(SM ^  A3u:NW"&&{o5MdXVq*d3t; Y784    ",, @    "#>??  @{M M s= R N'A;R#3N6BR?O5R5A%P#BR N3N..N33R6 O2?(O-'R-O22R5+P  R#ARRRdestc|jdjd}|j}|jdt j |t |d5}tj|tj|tjd}dddjdk7r6td |jjd jy#1swYOxYw) z*Download remote .hermes/ as a tar archive.r$/ztar cf - -C / wbr|)rWr^r\rNrzSSH bulk download failed: r}r~)r%lstriprQrOrqrropenrXrYrZrr[rr\rr])r'rrel_baserfr`s rr@z!SSHEnvironment._ssh_bulk_download/s''(188=))+ H(='>?@ $  ^^ ((! F     !!;FMMzSSHEnvironment._ssh_deleteAs{%%' $\23 $$      !!3FMM4G4G4I3JKL L "rc8|jjy)zCSync files to remote via FileSyncManager (rate-limited internally).N)rArBr&s r_before_executezSSHEnvironment._before_executeOs !rFr|)loginr stdin_data cmd_stringrrc|j}|r)|jdddtj|gn'|jddtj|gt ||S)z7Spawn an SSH process that runs bash on the remote host.bashz-lz-c)rQrMrqrrr)r'rrrrrPs r _run_bashzSSHEnvironment._run_bashWs\%%'  JJdEKK ,CD E JJekk*&=> ?3 ++rc|jr/tjd|jj|jj rr ddd|jdd|j d|jg}tj|dd tj  |jjyy#ttjf$rY8wxYw#t$rYywxYw) Nz"SSH: syncing files from sandbox...r rIrJz-Oexitr T)rUrrW)rAreinfo sync_backr9existsrrrXrYrZrSubprocessErrorunlink)r'rPs rcleanupzSSHEnvironment.cleanupcs    KK< =    ( ( *    % % ' dl43F3F2G$HV {!DII;%?A#'$,,  ##**, (Z778    s%AC -C( C%$C%( C43C4)~<rK)NrGN)__name__ __module__ __qualname____doc__rNintr0listrQr:r;r<r=tupler?rr@r>rboolrXrrr __classcell__)rEs@rrr$s19A$LTD[D"W"$S$4  GSGsGtG:qOd5c?&;qOqOfntnn$ MS Md M";@!$+/ ,C ,4 , ,!Dj ,4>4D4D ,rrr)rr5loggingrrqrrXr1pathlibrtools.environments.baserrtools.environments.file_syncrrrr r getLoggerrrerrrrrrsTQ @   8 $  S_Sr