`gjSdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z m Z ddlmZddlmZddlmZmZmZddlmZddlmZdd lmZej8eZeej@d Z!e!rejEejFejHZ%d Z&Gd d Z'dee(gdfdzddfdZ)dee(gdfdzfdZ*de+de(ddfdZ,defdZ-dej\de(ddfdZ/ d)de0e(de(dzdej\fdZ1dede+fdZ2dede+ddfdZ3de(de4e5e6fdzfd Z7Gd!d"eZ8Gd#d$Z9d%e(de(fd&Z:Gd'd(e Z;y)*aCBase class for all Hermes execution environment backends. Unified spawn-per-call model: every command spawns a fresh ``bash -c`` process. A session snapshot (env vars, functions, aliases) is captured once at init and re-sourced before each command. CWD persists via in-band stdout markers (remote) or a temp file (local). N)ABCabstractmethod)deque)Path)IOCallableProtocol)get_hermes_home)windows_hide_flags)is_interruptedHERMES_DEBUG_INTERRUPTlcneZdZdZdefdZedefdZedefdZde ddfd Z d d d e de fd Z y)_BoundedOutputCollectorz9Retain a bounded 40/60 head-tail window of streamed text. max_charsc6tdt||_t|jdz|_|j|jz |_g|_t |_d|_d|_ d|_ tj|_ y)N皙?r)maxintr _head_limit _tail_limit_headr_tail _head_chars _tail_chars _total_chars threadingLock_lock)selfrs J/root/.hermes/venv/lib/python3.12/site-packages/tools/environments/base.py__init__z _BoundedOutputCollector.__init__8swQI/t~~34>>D,<,<< " !& ^^% returncx|j5|j|jzcdddS#1swYyxYwN)rrrr s r!buffered_charsz&_BoundedOutputCollector.buffered_charsCs2 ZZ 7##d&6&66 7 7 7s09c^|j5|jcdddS#1swYyxYwr&)rrr's r! total_charsz#_BoundedOutputCollector.total_charsHs' ZZ %$$ % % %s #,textNc|sy|j5t|}|xj|z c_d}|j|jkrZt |j|jz |}|r5|j j|d||xj|z c_|}||z }|dks|jdkr dddy||jk\r^|jj|jj||j d|j|_ dddy||d}|jj||xjt|z c_ |j|jkDr|j|jz }|jd}t||kr9|jj|xjt|zc_ n'||d|jd<|xj|zc_ |j|jkDrdddy#1swYyxYw)Nr) rlenrrrminrappendrrclearrpopleft) r r+text_lenstarttake remainingchunkexcessfirsts r!r/z_BoundedOutputCollector.appendMs  ZZ /4yH    ) E$"2"224++d.>.>>IJJ%%d5Dk2$$,$ E 5(IA~!1!1Q!6 / /D,,,   " !!$(8(8'8':";<#'#3#3 ' / /*LE JJ  e $   E * ""T%5%55))D,<,<< 1 u:'JJ&&($$E 2$$)&'NDJJqM$$.$""T%5%551 / / /sB0I A$I6DIIsuffixr;c |j5t||jk\r||j dcdddSdj|j}dj|j }|jt|z }|j |kr||z|zcdddSd}tdD]g}td|t|z }t|dz}||z } td|j |z | z } d| dd|j dd } | |k(rn| }itd|t|z }t|dz}||z } | r|| dnd} |d||d|z| z|zcdddS#1swYyxYw) zARender within ``max_chars``, preserving a required status suffix.Nr9rrz ... [OUTPUT TRUNCATED - ,z chars omitted out of z total] ... ) rr-rjoinrrrrangerr) r r;headtail availablenotice_content_budget head_chars tail_charsomittedupdated rendered_tails r!renderz_BoundedOutputCollector.renderrs ZZ S6{dnn,t~~o/0 S S774::&D774::&DV4I  I-d{V+ S SF1X !!$Q CK(?!@ #!56 +j8 a!2!2Z!?*!LM271+>"//2/Cf$  !!IF $;Register a callback that _wait_for_process fires periodically.N)_activity_callback_localcallback)rTs r!set_activity_callbackrXs (*%r#c$ttddS)NrW)getattrrVrSr#r!_get_activity_callbackr[s +Z >>r#statelabelctj}|jdd}||dz |kry||d< t}|r t ||dz }||d|dyy#t $rYywxYw)a_Fire the activity callback at most once every ``state['interval']`` seconds. *state* must contain ``last_touch`` (monotonic timestamp) and ``start`` (monotonic timestamp of the operation start). An optional ``interval`` key overrides the default 10 s cadence. Swallows all exceptions so callers don't need their own try/except. intervalg$@ last_touchNr3z (z s elapsed))time monotonicgetr[r Exception)r\r]nowr_rTelapseds r!touch_activity_if_duergs .. CyyT*H U<  8+E, # % #g./G %7):. /     s+A&& A21A2ctjd}|r t|}n tdz }|j dd|S)zReturn the host-side root for all sandbox storage (Docker workspaces, Singularity overlays/SIF cache, etc.). Configurable via TERMINAL_SANDBOX_DIR. Defaults to {HERMES_HOME}/sandboxes/. TERMINAL_SANDBOX_DIR sandboxesTparentsexist_ok)osgetenvrr mkdir)customps r!get_sandbox_dirrssA YY- .F L   +GGD4G( Hr#procdatac^fd}tj|djy)uWrite *data* to proc.stdin on a daemon thread to avoid pipe-buffer deadlocks. On Windows, text-mode stdin (``text=True`` / ``encoding="utf-8"``) translates ``\n`` → ``\r\n`` as the data flows through the pipe — which corrupts every write_file / patch call because the bytes that land on disk include injected carriage returns. The file IS created, but every subsequent byte-count / content compare against the caller's ``\n``-only string fails. Workaround: write through ``proc.stdin.buffer`` (the underlying byte buffer), encoding to UTF-8 ourselves. That bypasses Python's newline translation entirely on every platform. No behaviour change on POSIX — the byte sequence is identical to what text-mode would produce there. c ttrjdn}tjdj}|j ||j y#ttf$rYywxYw)Nutf-8buffer) isinstancerRencoderZstdinwritecloseBrokenPipeErrorOSError)rawtargetrurts r!_writez_pipe_stdin.._writese  +5T3*?$++g&TCTZZ4::>F LL  LLN)   sA%A))A;:A;TrdaemonN)rThreadr3)rtrurs`` r! _pipe_stdinrs#" F40668r#cmd stdin_datac |jdttj|ftjtj |tjntj dd|}| t|||S)aSpawn a subprocess with standard stdout/stderr/stdin setup. If *stdin_data* is provided, writes it asynchronously via :func:`_pipe_stdin`. Backends with special Popen needs (e.g. local's ``preexec_fn``) can bypass this and call :func:`_pipe_stdin` directly. creationflagsT)stdoutstderrr|r+) setdefaultr subprocessPopenPIPESTDOUTDEVNULLr)rrkwargsrts r! _popen_bashrsx o'9';<       !+!7jooZ=O=O      DD*% Kr#pathc|jr& tj|jdSiS#t$rYiSwxYw)z:Load a JSON file as a dict, returning ``{}`` on any error.rxencoding)existsjsonloads read_textrd)rs r!_load_json_storersJ {{} ::dnngn>? ? I   I s$9 AAc|jjdd|jtj|ddy)z.Write *data* as pretty-printed JSON to *path*.Trk)indentrxrN)parentrp write_textrdumps)rrus r!_save_json_storer s4KKdT2OODJJtA.OAr# host_pathc t|j}|j|jfS#t$rYywxYw)zIReturn ``(mtime, size)`` for cache comparison, or ``None`` if unreadable.N)rstatst_mtimest_sizer)rsts r!_file_mtime_keyrs> )_ ! ! # RZZ(( s 03 ??ceZdZdZdedzfdZd dZd dedzdefdZe de e dzfdZ e dedzfd Z y) ProcessHandlezDuck type that every backend's _run_bash() must return. subprocess.Popen satisfies this natively. SDK backends (Modal, Daytona) return _ThreadedProcessHandle which adapts their blocking calls. r$Ncyr&rSr's r!pollzProcessHandle.poll(r#cyr&rSr's r!killzProcessHandle.kill)rr#timeoutcyr&rSr rs r!waitzProcessHandle.wait*rr#cyr&rSr's r!rzProcessHandle.stdout,(+r#cyr&rSr's r! returncodezProcessHandle.returncode/rr#r$Nr&)rMrNrOrPrrrfloatrrQrrRrrrSr#r!rr!s[ &cDj% (output_str, exit_code)`` in a background thread and exposes a ProcessHandle-compatible interface. An optional ``cancel_fn`` is invoked on ``kill()`` for backend-specific cancellation (e.g. Modal sandbox.terminate, Daytona sandbox.stop). Nexec_fn cancel_fnc6|_tj_d_d_t j\}}t j|ddd_ |_ fd}tj|d}|jy)Nrrxreplace)rerrorsc$ \}}|_ tjj|j dd tjjjjy#t $rYFwxYw#t $r}|_d_Yd}~fd}~wwxYw#t $rYYwxYw# tjjn#t $rYnwxYwjjwxYw)Nrxrrr) _returncodernr} _write_fdr{rrd_errorr~_doneset)output exit_codeexcrr s r!_workerz0_ThreadedProcessHandle.__init__.._workerKs !$+I! #, HHT^^V]]79]-UVHHT^^,   %! #$   % HHT^^,  s|B1BB4 B  B B  B B1B,'C,B11C4 C?CDC%$D% C1.D0C11DTr) _cancel_fnrEventrrrrnpipefdopen_stdoutrrr3)r rrread_fdwrite_fdrts`` r!r"z_ThreadedProcessHandle.__init__<sz $__& '+(, GGIyy# R ! !&   GD 9  r#c|jSr&)rr's r!rz_ThreadedProcessHandle.stdoutas ||r#r$c|jSr&)rr's r!rz!_ThreadedProcessHandle.returncodeesr#cR|jjr |jSdSr&)ris_setrr's r!rz_ThreadedProcessHandle.pollis"#'::#4#4#6t@D@r#c^|jr |jyy#t$rYywxYwr&)rrdr's r!rz_ThreadedProcessHandle.killls1 ?? !   s  ,,rcR|jj||jS)Nr)rrrrs r!rz_ThreadedProcessHandle.waitss  (r#r&)rMrNrOrPrtuplerRrr"rQrrrrrrrSr#r!rr3s04#"eCHo-.#BH%,#J C$J  AcDjA EDL C r#r session_idcd|dS)N __HERMES_CWD___rS)rs r! _cwd_markerr}s :,b ))r#ceZdZUdZdZeed<dZeed<defdZ d,d ed ed e fd Z d ddddede d ededzde f dZedZdZed edefdZdedefdZded edefdZedededefdZ d-d dde d ede de fdZde fd Zd!e fd"Zd!e fd#Zd.d$Z d/ddd%d d&ded ed edzdedzd'e de de fd(Zd)Zd*Zdedeeedzffd+Z y)0BaseEnvironmentaCommon interface and unified execution flow for all Hermes backends. Subclasses implement ``_run_bash()`` and ``cleanup()``. The base class provides ``execute()`` with session snapshot sourcing, CWD tracking, interrupt handling, and timeout enforcement. r _stdin_mode_snapshot_timeoutr$cy)a,Return the backend temp directory used for session artifacts. Most sandboxed backends use ``/tmp`` inside the target environment. LocalEnvironment overrides this on platforms like Termux where ``/tmp`` may be missing and ``TMPDIR`` is the portable writable location. z/tmprSr's r! get_temp_dirzBaseEnvironment.get_temp_dirsr#Ncwdrenvct||_||_|xsi|_tjj dd|_|jjdxsd}|d|j d|_ |d|j d|_ t|j |_ d|_ d|_ y)N /z /hermes-snap-z.shz /hermes-cwd-z.txtF)rrruuiduuid4hex _session_idrrstrip_snapshot_path _cwd_filer_snapshot_ready_prefer_nonlogin)r rrrtemp_dirs r!r"zBaseEnvironment.__init__s 9"::<++CR0$$&--c29c!) -8H8H7IM$:\$2B2B1C4H&t'7'78$!&r#Fxloginrr cmd_stringrrcDtt|jd)zSpawn a bash process to run *cmd_string*. Returns a ProcessHandle (subprocess.Popen or _ThreadedProcessHandle). Must be overridden by every backend. z must implement _run_bash())NotImplementedErrortyperM)r rrrrs r! _run_bashzBaseEnvironment._run_bashs""T$Z%8%8$99T"UVVr#cy)z z __hermes_fns=$(declare -F | awk '{print $3}' | grep -vE '^_[^_]') || true [ -n "$__hermes_fns" ] && declare -f $__hermes_fns >> z! 2>/dev/null || true alias -p >> z# echo 'shopt -s expand_aliases' >> z echo 'set +e' >> z echo 'set +u' >> z mv -f  z || rm -f z builtin cd -- z 2>/dev/null || true printf '\n%sz\n' "$(pwd -P)" T)rrrrrz)snapshot bootstrap failed with exit code z-Session snapshot created (session=%s, cwd=%s)Ftruerz; non-login probe: Nu_init_session failed (session=%s): %s — login bash unusable; falling back to non-login bash -cuLinit_session failed (session=%s): %s — falling back to bash -l per command)_quote_cwd_for_cdr_quote_shell_pathrrrr_wait_for_processrrc RuntimeErrorr _update_cwdloggerinforrdrRr.striprwarning) r _quoted_cwd _quoted_snap _snap_tmp bootstraprtresultrdetailprefer_nonloginprobe probe_result probe_excs r! init_sessionzBaseEnvironment.init_sessions ,,TXX6 --d.A.AB $**4+>+>+HIJV $+&$+&11: < ){+ ){+Kqj D(M***+2d.>.>-??S3 U 8- >>)4AWAW>XD++D$:P:P+QF6::l+0q1Q6"? <@X?YZ$(D   V $ KK?     #(D XF#O CvUCDLbLbDcd#55eSTMcMcEd5e "%l&6&6|&D&I"Ja"O&*..x8BFIIKUvF C"8#6ykB C%4D !M$$ :$$ ' sEB>$ EKKAB012 2{{3r#rc,tj|S)zQuote *path* for interpolation into a bash script. LocalEnvironment overrides this to rewrite native/mixed Windows paths to ``/c/...`` before quoting. Remote backends leave paths as-is (they already speak POSIX). )r$r%)r rs r!rz!BaseEnvironment._quote_shell_pathMs{{4  r#commandc |jdd}|j|j}|j|jdzdz}g}|jr|j d|d|j |}|j d|d|j d |d|j d |j d |jr|j d |d |d|d|d |j d|j d|j d|j ddj|S)zwBuild the full bash script that sources snapshot, cd's, runs command, re-dumps env vars, and emits CWD markers.'z'\''rrzsource z >/dev/null 2>&1 || truezbuiltin cd -- z || exit 126zeval 'z__hermes_ec=$?z umask 077z{ export -p > z && mv -f r z; } 2>/dev/null || rm -f z 2>/dev/null || truez printf '\nr z\n' "$(pwd -P)"zexit $__hermes_ec )rrrrr/r rr?)r r'rescapedrrparts quoted_cwds r! _wrap_commandzBaseEnvironment._wrap_commandVs[//#w/--d.A.AB **4+>+>+HIJV     LL,'?@  ++C0  ~j\>?  vgYa() %&  [!    LL!)Jyk<.Q((1{2FH   $**+2d.>.>-??Q R   ()yyr#cddtjjdd}|d|d|d|S)z;Append stdin_data as a shell heredoc to the command string. HERMES_STDIN_Nrz << 'z' r*)rrr)r'r delimiters r!_embed_stdin_heredocz$BaseEnvironment._embed_stdin_heredocsA$DJJL$4$4Sb$9#:; % {#j\I;GGr#)bounded_capturertr3c |r ddlm}|}nt}t |t j ddfdfd}tj|d }|jtj|z}tj} | | d } tjj} td d } d} | }d}td u}t r&t"j%d| | ||sdndt' d}j)| dz } t'rot r1t"j%d| | | tj| dz |j+|j-dj/dddStj|kDrt rt"j%d| | | ||j+|j-dd|d}j0dk(r j/|j3nj/|ddSt5| d t rtj|z d!k\rhtd u}t"j%d"| | | tj| dz t'|sdnd|r|sd#nd$tj}|}tj6||d%krt9|d&zd%}j)|j-d j>jAt r._drain_iterables #2E} !%/ gnnU&;< c%j1 2">>#T>:D d+   ! ">>#T>:D d+ s`ABB &B B B BB  BB C"&C C CCCCc j}|yt|dd} t|r|nd}t |t r|dkr |yt jdk(re t j|d}|sn! j j|: jdd}|r j|yd} tj|gggd\}}}|r= t j|d}|sn? j j|d}n j |d z }|d k\rny jdd}|r j|yy#t$rd}YJwxYw#ttf$rYwxYw#t$rYywxYw# jdd}|r j|ww#t$rYwwxYwxYw#ttf$rYwxYw#ttf$rYwxYw#t$rYywxYw# jdd}|r j|ww#t$rYwwxYwxYw) NfilenorntTr#r7g?r)rrZcallablerdrzrrnnamereadr/r: ValueErrorrselectr) r;r@fdr6rBidle_after_exitreadyrEr>r=rrts r!_drainz1BaseEnvironment._wait_for_process.._drains[[F~VXt4F !)&!1VXtb#&"q&'ww$ "D 1$! gnnU&;< " &~~c~>"MM$/O &,mmRD"b#&F q!"$&GGB$5E %! gnnU&;<*+0(1,*a/!)2">>#T>:D d+m  #G,% &~~c~>"MM$/ $'0 !+G4"!"*! ">>#T>:D d+ sE/%;F F%"&F HG!+H.G6AH&H / E>=E>FF%FF% F"!F"%G'&G G GGGG!G30H2G33H6HHHH HHI&II I IIITr)r`r3pidNFzg[interrupt-debug] _wait_for_process ENTER tid=%s pid=%s timeout=%ss activity_cb=%s initial_interrupt=%srMISSINGg{Gzt?rut[interrupt-debug] _wait_for_process INTERRUPT DETECTED tid=%s pid=%s iter=%d elapsed=%.1fs — killing process groupr3rrz [Command interrupted]r:)rrzM[interrupt-debug] _wait_for_process TIMEOUT tid=%s pid=%s iter=%d timeout=%ssz [Command timed out after zs]|zterminal command runningg>@zo[interrupt-debug] _wait_for_process HEARTBEAT tid=%s pid=%s iter=%d elapsed=%.0fs interrupt=%s activity_cb=%s%sz (LOST during run)r9g?g?u[interrupt-debug] _wait_for_process EXCEPTION_EXIT tid=%s pid=%s iter=%d elapsed=%.1fs — killing subprocess group before re-raisezd[interrupt-debug] _wait_for_process EXIT (natural) tid=%s pid=%s iter=%d elapsed=%.1fs returncode=%s)"tools.tool_output_limitsr5rd_UNBOUNDED_CAPTURE_CHARSrcodecsgetincrementaldecoderrrr3rarbcurrent_threadidentrZr[_DEBUG_INTERRUPTrrr r _kill_processr?rLr*lstriprgsleepr.KeyboardInterrupt SystemExitrr~r)r rtrr3r5 capture_limitrL drain_threaddeadline_now_activity_state_tid_pid _iter_count_last_heartbeat_last_interrupt_state _cb_was_none _poll_sleep timeout_msg _cb_now_noner>r=rs ` @@@r!rz!BaseEnvironment._wait_for_processs#4  'B - 5M(748&..w7yI 4F P!''vdC >>#g-~~ '')//tUD)  %-/47  KKBdG)y  U K))+%q !#' \ $ T^^5EX_H`5` &&t, %%a%0"(--7P-"Q&)>>#h.' @ $ W &&t, %%a%0$?y"KK"--2#)--{-"C"J"J"L#]]+]>&) &o7QR $(8?(Jd(R#9#;t#CLKK8dK(?7+CC&(%1y0<\,WY '+nn&6O#/L ;'$"%kC&7"=K}))+%p !$  KK     KKDdK ?7#;;  !--/IIW ' &  'D":.   g$ NN$w'??   ""4(!!!!,    % :   sc N!BN3#B"N3C N3(P1! N0/N03AP.:#PP. P*'P.)P**P.1 P=<P=cZ |jy#tttf$rYywxYw)zDTerminate a process. Subclasses may override for process-group kill.N)rProcessLookupErrorPermissionErrorr)r rts r!rXzBaseEnvironment._kill_processs)  IIK"OW=   s **rc&|j|y)zDExtract CWD from command output. Override for local file-based read.N)_extract_cwd_from_output)r rs r!rzBaseEnvironment._update_cwds %%f-r#c|jdd}|j}|j|}|dk(rytd|dz }|j|||}|dk(s||k(ry||t |z|j }|r||_|jdd|}|dk(r|}|jd|t |z} | dk7r| dzn t |} |d||| dz|d<y) zParse the __HERMES_CWD_{session}__ marker from stdout output. Updates self.cwd and strips the marker from result["output"]. Used by remote backends (Docker, SSH, Modal, Daytona, Singularity). rr9NrrBr*r)rcrrfindrr-rrfind) r rrmarkerlast search_startr8cwd_path line_startline_ends r!roz(BaseEnvironment._extract_cwd_from_outputs Hb)!!||F# 2: 1dTk*  V\48 B;%4- %#f+-5;;= DH \\$51  J;;tTCK%78#+r>8aHook called before each command execution. Remote backends (SSH, Modal, Daytona) override this to trigger their FileSyncManager. Bind-mount backends (Docker, Singularity) and Local don't need file sync — the host filesystem is directly visible inside the container/process. NrSr's r!_before_executezBaseEnvironment._before_executes r#T)rrrewrite_compound_backgroundr3r|c|j|j|\}}|rddlm} | |}|xs |j} |xs |j } ||||z} n||} n|} | r#|j dk(r|j|| }d} |j|| } |j xr |j }|j| || | }|j|| |}|j||S)uExecute a command, return {"output": str, "returncode": int}. ``bounded_capture=True`` caps stdout/stderr retention at ``tool_output.max_bytes`` WHILE the stream is drained (head/tail window) instead of holding the full output in memory (#64435). It must only be set by callers whose output is destined for the model/tool payload (the foreground terminal tool). Internal full-fidelity consumers — file operations ``cat`` reads that feed the patch engine, code-execution RPC reads, log reads — MUST leave it False: truncating those corrupts data, not just display. r)_rewrite_compound_backgroundNheredocr)rr3)r{_prepare_commandtools.terminal_toolr~rrrr2r.rrrrr)r r'rrrr|r3 exec_command sudo_stdinr~effective_timeout effective_cwdeffective_stdinwrappedrrtrs r!executezBaseEnvironment.executes$* #'#8#8#A j ' H7 EL#3t||txx   !j&<(:5O  #(O(O t//9<44\?SL"O$$\=A(((F1F1F-F~~ 5*; '' +_(    r#c$|jy)z.Alias for cleanup (compat with older callers).N)rr's r!stopzBaseEnvironment.stopWs  r#cD |jy#t$rYywxYwr&)rrdr's r!__del__zBaseEnvironment.__del__[s"  LLN   s  cddlm}||S)z6Transform sudo commands if SUDO_PASSWORD is available.r)_transform_sudo_command)rr)r r'rs r!rz BaseEnvironment._prepare_commandas?&w//r#r&)rr)r9)!rMrNrOrPrrR__annotations__rrrdictr"boolrrrrr  staticmethodr rr.r2rrXrror{rrrrrrSr#r!rrs,K sc&C&#&D&0!% W W W  W $J W  W  sr s s  !c!c!@ S@ s@ s@ LHcHsHsHH36jJRWjJ!jJ,/jJKOjJ jJX -.$. Ct CL "< #!%,0 %<<< t < $J <&*<< <D 00c3:o0F0r#rr&)rs   #)),<*   8 $   ":;<  OOGLL!+9??, %ZSZSz+hud{3d:+t+ ?# 5 <?     4    (9j&&9c9d9F.2 c #d .4DB4BtBB suUCZ'84'?,H,$B B T*C*C*_ 0c_ 0r#