`gjz$
d Z ddlZddlZddlZddlZddlZddlZddlmZm Z m
Z
ej e Z
dZdZdZdZdZ ej& d Zd
Zd efd Zd
ed efdZefdeded eeef fdZ ded efdZ deded efdZ dedededed ef
dZ de
dfdeded
ede d ee z dz d ef d Z!de
fd e"e# de d e"e# fd Z$y) a Tool result persistence -- preserves large outputs instead of truncating.
Defense against context-window overflow operates at three levels:
1. **Per-tool output cap** (inside each tool): Tools like search_files
pre-truncate their own output before returning. This is the first line
of defense and the only one the tool author controls.
2. **Per-result persistence** (maybe_persist_tool_result): After a tool
returns, if its output exceeds the tool's registered threshold
(registry.get_max_result_size), the full output is written INTO THE
SANDBOX temp dir (for example /tmp/hermes-results/{tool_use_id}.txt on
standard Linux, or $TMPDIR/hermes-results/{tool_use_id}.txt on Termux)
via env.execute(). The in-context content is replaced with a preview +
file path reference. The model can read_file to access the full output
on any backend.
3. **Per-turn aggregate budget** (enforce_turn_budget): After all tool
results in a single assistant turn are collected, if the total exceeds
MAX_TURN_BUDGET_CHARS (200K), the largest non-persisted results are
spilled to disk until the aggregate is under budget. This catches cases
where many medium-sized results combine to overflow context.
N)DEFAULT_PREVIEW_SIZE_CHARS BudgetConfigDEFAULT_BUDGETzzz/tmp/hermes-resultsHERMES_PERSIST_EOF__budget_enforcement__z[^A-Za-z0-9_.-]+x returnc | Bt | dd }t | r* | }|r|j d xs d}| dS t S t S # t $ r%}t j d| Y d}~t S d}~ww xY w)z=Return the best temp-backed storage dir for this environment.N get_temp_dir/z/hermes-resultsz"Could not resolve env temp dir: %s)getattrcallablerstrip Exceptionloggerdebug STORAGE_DIR)envr temp_direxcs L/root/.hermes/venv/lib/python3.12/site-packages/tools/tool_result_storage.py_resolve_storage_dirr 0 s
sND9 L !
8'> 's 3 :sH &Z77 ;
H A3GG
Hs A A9A44A9 tool_use_idc b t | xs d }t j d| j d }||k7 }|sd}d}|st | t
kD rXt
j |j d j dd }|dt
j d xs d}| d| }| dS ) z3Return a single safe filename for a tool result id. tool_result_z._-Tzutf-8N z.txt) str _UNSAFE_RESULT_FILENAME_CHARSsubstriplen_MAX_RESULT_FILENAME_STEMhashlibsha256encode hexdigestr )r raw_id safe_stemchangeddigests r _safe_result_filenamer, @ s
-
.F-11#v>DDUKI6!G ! #i.#<<
g 67AACCRH 8 89@@GX= k6(+ [ content max_charsc z t | |k r| dfS | d| }|j d }||dz kD r|d|dz }|dfS )zGTruncate at last newline within max_chars. Returns (preview, has_more).FN
T)r" rfind)r. r/ truncatedlast_nls r generate_previewr7 R sX
7|y ~
#Iood#Ga lw{+ d?r- c f t | vrt S dt j j dd S )z=Return a heredoc delimiter that doesn't collide with content.HERMES_PERSIST_N )HEREDOC_MARKERuuiduuid4hex)r. s r _heredoc_markerr? ] s1 W$
TZZ\ - -bq 1 2 33r- remote_pathc t j j | }dt j | dt j | }|j |d| }|j
dd dk( S )u Write content into the sandbox via env.execute(). Returns True on success.
Pushes ``content`` through stdin rather than embedding it in the command
string. Linux's ``MAX_ARG_STRLEN`` caps any single argv element at 128 KB
(32 * PAGE_SIZE), so the previous heredoc-in-the-command-string approach
silently failed with ``OSError: [Errno 7] Argument list too long`` for any
tool result over ~128 KB — exactly the case persistence exists to handle.
Routing through stdin removes that ceiling on local + ssh (``_stdin_mode
== "pipe"``); remote backends with ``_stdin_mode == "heredoc"`` keep their
existing API-body sized limit, which is orders of magnitude larger than
the exec-arg ceiling.
z mkdir -p z
&& cat > )timeout
stdin_data
returncoder3 r )ospathdirnameshlexquoteexecuteget)r. r@ r storage_dircmdresults r _write_to_sandboxrP d sf ''//+.K ekk+./z%++k:R9S
TC
[[bW[
=F ::lA &! ++r- previewhas_more
original_size file_pathc |dz }|dk\ r
|dz dd}n|dd}t d}|d|dd| d z
}|d
| dz
}|d z
}|d t | d
z
}|| z
}|r|dz
}|dt z
}|S )z/Build the replacement block.i z.1fz MBz KBr1 z This tool result was too large (,z
characters, z).
zFull output saved to: zZUse the read_file tool with offset and limit to access specific sections of this output.
zPreview (first z chars):
z
...)PERSISTED_OUTPUT_TAGr" PERSISTED_OUTPUT_CLOSING_TAG)rQ rR rS rT size_kbsize_strmsgs r _build_persisted_messager\ w s d"G$ nS)- c]#&
! ""
%C
-mA->mH:UY ZZC
#I;b 11C iiC_S\N* 55C7NC wR,- ..C Jr- tool_nameconfig thresholdc ( ||n|j | }|t d k( r| S t | |k r| S t | }| dt | }t | |j \ } }
|H t | || r9t j d||t | | t | |
t | | S t j d|t | | dt | d d
S # t $ r!} t j d|| Y d} ~ Wd} ~ ww xY w) a Layer 2: persist oversized result into the sandbox, return preview + path.
Writes via env.execute() so the file is accessible from any backend
(local, Docker, SSH, Modal, Daytona). Falls back to inline truncation
if write fails or no env is available.
Args:
content: Raw tool result string.
tool_name: Name of the tool (used for threshold lookup).
tool_use_id: Unique ID for this tool call (used as filename).
env: The active BaseEnvironment instance, or None.
config: BudgetConfig controlling thresholds and preview size.
threshold: Explicit override; takes precedence over config resolution.
Returns:
Original content if small, or replacement.
Ninfr )r/ z4Persisted large tool result: %s (%s, %d chars -> %s)z Sandbox write failed for %s: %szDInline-truncating large tool result: %s (%d chars, no sandbox write)z
[Truncated: tool response was rV z3 chars. Full output could not be saved to sandbox.])
resolve_thresholdfloatr" r r, r7 preview_sizerP r infor\ r warning) r. r] r r r^ r_ effective_thresholdrM r@ rQ rR r s r maybe_persist_tool_resultrh s1 2 (1'<)&BZBZ[dBeeEl*
7|**&s+K M#8#E"FGK(Fz%enforce_turn_budget.. s
!A$ r- T)keyreverse tool_call_idbudget_)r. r] r r r^ r_ z7Budget enforcement: persisted tool result %s (%d chars)) enumeraterL r" rW append turn_budgetsortrh _BUDGET_TOOL_NAMEr re ) ri r r^
candidates
total_sizeir[ r. sizeidxr replacements r enforce_turn_budgetr sJ JJM* )3'')R(7|d
w . q$i ( ) V''' OOO5 T ++ + , + C i.ggnuo> /'#
' ! $ J #k* *J,7M# y ) KKIT
'0 r- )%__doc__r$ loggingrF rerI r< tools.budget_configr r r getLogger__name__r rW rX r r; rx compiler r# r r r, inttupleboolr7 r? rP r\ rc rh listdictr rm r- r r s 0
8 $+ 4 # %, *
+> ?
s s $ 5O c c SXY\^bYbSc 4S 4S 4,s , ,d ,&
:
)$(
8
88 8
8 U{T!
8 8z
)3:3
3
$Z 3r-