`gjfdZddlmZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z ddl mZmZmZddlmZmZddlmZmZddlmZdd lmZdd lmZdd lmZdd lm Z dd l!m"Z"ddl#m$Z$m%Z%ddl&m'Z'm(Z(ddl)m*Z*ddl+m,Z,m-Z-m.Z.m/Z/ej`e1Z2hdZ3dZ4dZ5d3dZ6d4dZ7d5dZ8d6dZ9d7dZ:d8dZ; d9dZd;dZ?d;dZ@dd"ZCd4d#ZDd>d$ZEd>d%ZFd?d&ZGd@d'ZHdAd(ZIdBd)ZJdCd*ZKdDdEd+ZLdFd,ZMdGd-ZNdd.d/ZOdd0d>d1ZPgd2ZQy)HuuHelper functions for the chat-completions code path. Extracted from :class:`AIAgent` for cleanliness — bodies of the non-streaming API call, request kwargs builder, assistant-message materializer, provider-fallback activator, max-iterations handler, and per-turn resource cleanup. Each function takes the parent ``AIAgent`` as its first argument (``agent``). :class:`AIAgent` keeps thin forwarder methods so call sites unchanged. Symbols that tests patch on ``run_agent`` (e.g. ``cleanup_vm`` / ``cleanup_browser`` in ``test_zombie_process_cleanup.py``) are resolved through :func:`_ra` so the patch contract is preserved. ) annotationsN)SimpleNamespace)AnyDictOptional)get_provider_request_timeoutget_provider_stale_timeout)PARTIAL_STREAM_STUB_IDFINISH_REASON_LENGTH)FailoverReason)EmptyStreamError)substitute_api_content)is_native_gemini_base_url)is_local_endpoint)flatten_message_text)_sanitize_surrogates_repair_tool_call_arguments)claim_stream_writerstream_writer_is_current)is_persistent_env)base_url_host_matchesbase_url_hostname env_floatenv_int>pricelatency throughputg@cddl}|S)zLazy ``run_agent`` reference. Used to honor test patches like ``patch("run_agent.cleanup_vm")`` / ``patch("run_agent.cleanup_browser")`` that target symbols imported into ``run_agent``'s namespace. rN run_agentrs P/root/.hermes/venv/lib/python3.12/site-packages/agent/chat_completion_helpers.py_rar"<s  cd dd fd }t|tr ||dzSt|tr|jd}t|tr+||}d|vr||jdz }|dzSd|vrL|jd|jdz|jdz}|dzSt fd|j DdzS|dzS) a Estimate context/load tokens from an API payload, dict or messages list. The stale-call detectors historically assumed a Chat Completions request: they pulled ``api_kwargs["messages"]`` and ran a cheap char/4 estimate. Codex / Responses API requests carry the conversational payload in ``input`` (with additional load in ``instructions`` and ``tools``), so the legacy estimator reported ~0 tokens for every Codex turn and the context-tier scaling never fired. This helper handles both shapes: - bare list -> treat as Chat Completions ``messages`` - dict with ``messages`` -> Chat Completions (+ ``tools`` if present) - dict with ``input`` -> Responses API (+ ``instructions``/``tools``) - any other dict -> fall back to summing string values cf|yt|tr t|Stt|SNr) isinstancestrlen)values r!_charsz/estimate_request_context_tokens.._charsXs, = eS !u: 3u:r#messagesc\t|ts|Stfd|DS)Nc3.K|] }|ywN).0itemr+s r! zJestimate_request_context_tokens.._message_chars..bs5D6$<5)r'listsum)r,r+s r!_message_charsz7estimate_request_context_tokens.._message_chars_s)(D)(# #5H555r#toolsinput instructionsc3.K|] }|ywr/r0)r1r*r+s r!r3z2estimate_request_context_tokens..wsCU6%=Cr4)r*rreturnint)r,rr=r>)r'r5dictgetr6values) api_payloadr7r, total_charsr+s @r!estimate_request_context_tokensrDGs"6 +t$k*a//+t$??:. h %(2K+%vkoog&>?? !# # k !{w/089:123  !# #Ck.@.@.BCCqHH + ! ##r#ctt|ddxsd}tt|ddxsd}t|dddk(xs |dk(xrd|vS)N_base_url_lower_base_url_hostnameprovider openai-codex chatgpt.com/backend-api/codex)r(getattr)agentbase_url_lowerrs r!_is_openai_codex_backendrP|se(92>D"ENGE+?DJKz4(N:  . 7$6 r#c(|dkDry|dkDry|dkDryy)uMinimum wall-clock stale timeout for openai-codex by estimated context. Gateway/Telegram sessions routinely ship ~15–25k tokens of tools + instructions before the first user message. Subscription-backed Codex can legitimately spend several minutes in backend admission/prefill at that size; the generic 90s non-stream stale default aborts healthy calls. The floor engages above 10k estimated tokens so those gateway-scale payloads are covered; smaller requests keep the generic default. 順g@P @'g@r0) est_tokenss r! openai_codex_stale_timeout_floorrXs(GFF r#c t|tsy|jj}|sy|tvr|St j d|djtty)z;Return a normalized OpenRouter provider.sort value or None.Nz@Ignoring invalid OpenRouter provider.sort value %r (allowed: %s), ) r'r(striplower _OPENROUTER_PROVIDER_SORT_VALUESloggerwarningjoinsorted)raw_sort sort_values r!#_validated_openrouter_provider_sortrdsb h $!'')J 55 NNJ &9:; r#c<i}|jr|j|d<|jr|j|d<|jr|j|d<t|j}|r||d<|j rd|d<|j r|j |d<|S)zDBuild the validated provider-routing object shared by request paths.onlyignoreordersortTrequire_parametersdata_collection)providers_allowedproviders_ignoredproviders_orderrd provider_sortprovider_require_parametersprovider_data_collection)rN preferencesros r!_provider_preferences_for_agentrss"$K #55 F  % 7 7 H $44 G78K8KLM+ F ((,0 () %%).)G)G %& r#c ttj|t|S#tt f$r|cYSwxYwr/)floatosgetenvr( TypeError ValueError)namedefaults r! _env_floatr|s:RYYtS\233 z "s '*>>cjg}tj|r|j||)|r_tj|rJ|j|n8|r6tj|r!|jtd||z |z|rt ||krydt t |dS)zBDescribe the earliest enabled Codex watchdog on the call timeline.rVrG; auto-reconnect at s)mathisfiniteappendmaxminr>) stale_timeout ttfb_enabled ttfb_timeout last_event_ts call_start idle_enabled idle_timeoutelapsed deadliness r!_codex_wait_notice_recoveryrs I }}]#' DMM,7   \ * $-- 5S-*"<= LM I'1 !#c)n"5!6a 88r#cV tt|ddxsdS#t$rYywxYw)N_consecutive_stale_streamsr)r>rM ExceptionrNs r! _stale_streakrs375">BGaHH s  ((cJ t|dz|_y#t$rYywxYw)N)rrrrs r!_bump_stale_streakrs+ +8+?!+C(    s  ""c2 d|_y#t$rYywxYwr&)rrrs r!_reset_stale_streakrs! +,(    s  cftdd}t|}|dkDr||k\rtd|dyy)uRaise immediately when the consecutive-stale streak is past the give-up threshold — no network attempt, no stale-timeout wait.HERMES_STREAM_STALE_GIVEUPrz:Provider has been unresponsive (no response received) for u consecutive stale attempts — aborting this call to avoid an indefinite stall. Switch models or start a new session, then retry.N)rr RuntimeError)rN_giveup_streaks r!_check_stale_giveuprsO2A6GE"G{w') Hi# #  *{r#ct|j|j}||}n tdd}t |}|dkDr t |d}n|dkDr t |d}n|}ddlm}|jd xs|jd xsd }||}||jd rt|d }| t ||}|S) uStale-stream patience for a provider that is never a local endpoint. Mirrors the main streaming path's derivation — provider config → env base → context-size scaling → reasoning-model floor — minus the local-endpoint ``float('inf')``/900s disable branch, which cannot apply to Bedrock (its endpoint is always the AWS cloud). Factored so the Bedrock streaming watchdog shares the exact same patience budget as the OpenAI/Anthropic stale-stream detector below. HERMES_STREAM_STALE_TIMEOUTf@rRr@rSn@r!get_reasoning_stale_timeout_floormodelmodelIdrG) r rIrrrDragent.reasoning_timeoutsrr@_bedrock_reasoning_stale_floor) rN api_kwargs _cfg_stale_base _est_tokens_timeoutr _model_id_reasoning_floors r!_derive_stream_stale_timeoutr s,ENNEKKHJ7?1*=KWue$ v ue$Jw'J:>>)+DJI8CJNN9$=9*Y:OP#x!12 Or#c4ddlm}|rt|tsy|j j }dD]#}|j |s|t|d}n|g}d|vrF|j|jddd|j|jdddg}|D]P}tjdd|}tjd d|}|||fD]} | |vs|j| R|D]}||} | | cSy) uMap a Bedrock inference-profile id to its reasoning stale-timeout floor. Bedrock carries the model as a dotted, region-prefixed id such as ``us.anthropic.claude-opus-4-6-v1:0``, whereas :func:`get_reasoning_stale_timeout_floor` anchors its slug patterns at the start of a bare slug (``claude-opus-4``). Strip the region prefix (``us.``/``eu.``/``apac.``/...) and try two candidate slugs against the floor: * the segment after the provider namespace (``claude-opus-4-6-v1:0``) — matches Anthropic-style slugs whose floor key excludes the provider (``claude-opus-4``); and * the region-stripped id with the provider dot rewritten to a dash (``deepseek-r1-v1:0``) — matches provider-qualified floor keys (``deepseek-r1``). The floor's right-anchor (``$`` or ``-``/``.``/``_``) tolerates the trailing date-stamp / ``-v1:0`` version suffix, so no suffix stripping is needed. First non-None wins; returns None for unknown models. The floor table mixes version-separator conventions: some keys are keyed with a dashed version (``claude-opus-4``) while others embed a dotted version (``claude-sonnet-4.5``, ``claude-sonnet-4.6``). Bedrock always dashes the version (``claude-sonnet-4-5-v1:0``), so for every candidate slug we also try the alternate version-separator form — digit-dash-digit rewritten to digit-dot-digit and vice-versa — so a dashed Bedrock id matches a dotted floor key (and the reverse). The rewrite only touches version-number separators (a dash/dot flanked by digits), never other dashes in the slug, so ``claude-sonnet`` is left intact while ``4-5`` becomes ``4.5``. rrN) zglobal.zus.zeu.zapac.zap.zau.zjp.zca.zsa.zme.zaf..r-z(?<=\d)-(?=\d)z(?<=\d)\.(?=\d)) rrr'r(r[r\ startswithr)rrsplitreplaceresub) model_idrrzprefixbase_candidates candidatescanddashed_to_dotteddotted_to_dashedformfloors r!rr3s?@K :h4 >>  ! ! #D ??6 "F %D  fO d{t{{32156t||Ca89J(66"3S$?66"4c4@+-=> (D:%!!$' ( (1$7  L r#c |jdk(r'|d}|j||t|ddS|jdk(r|dd}|j|| S|jd k(rSd d lm}m}m}m}|jd d}|jdd||} | jdi|} || S|jdk(r0|jjjj di|S|d}|jjj di|S#t$r} || r||d} ~ wwxYw)umRun one non-streaming LLM request for the active api_mode and return it. Shared by the interrupt-worker path (``interruptible_api_call``) and the inline path (``direct_api_call``) so the per-api_mode dispatch — codex / anthropic / bedrock / MoA / OpenAI-compatible — lives in exactly one place. ``make_client(reason, kind=...)`` builds the per-request client for the codex / OpenAI-compatible (``kind="openai"``) and anthropic (``kind="anthropic_messages"``) branches; the worker path uses it to register the client with its stranger-thread abort machinery, the inline path uses it to capture the client for its own ``finally`` close. The bedrock / MoA branches manage their own clients and never call it. All interrupt, abort, cancellation, and close semantics stay in the callers — this helper only issues the request. codex_responsescodex_stream_request_codex_on_first_deltaN)clienton_first_deltaanthropic_messagesanthropic_messages_requestkind)rbedrock_converser)_get_bedrock_runtime_clientinvalidate_runtime_clientis_stale_connection_errornormalize_converse_response__bedrock_region__ us-east-1__bedrock_converse__moachat_completion_requestr0)api_mode_run_codex_streamrM_anthropic_messages_createagent.bedrock_adapterrrrrpopconverserrIrchat completionscreate) rNr make_clientrequest_clientrrrrregionr raw_response _bedrock_excs r!"_dispatch_nonstreaming_api_requestrtsp  ~~**$%;<&& !"5*A4H'   ~~--% (/C // >/RR ~~++    4kB-t4,V4 *6??8Z8L+<88 ~~4u||  ,,33AjAA !:;N 1>   * * 1 1 ?J ?? )6)&1   s+D22 E;E  Ecjt|dddk(xr"t|dddk(xrt|dddk7S)aWhether a cron OpenAI-wire request should skip the interrupt worker. Issue #62151 is specific to OpenRouter's chat-completions path inside the gateway cron thread stack. Keep native/Codex/Bedrock/MoA transports on their established workers: their cancellation and client ownership differ, and the report provides no evidence that those paths share the pre-HTTP wedge. platformNcronrchat_completionsrIr)rMrs r!should_use_direct_api_callrsG z4(F2 6 E:t ,0B B 6 E:t , 5r#ctjddditjd fd ddfd } t |}t ddr t d t|t d durd_5d}dd<dddj|d SS#1swY xYw#t$rt ddr t d dwxYw#t d durd_5d}dd<dddn #1swYnxYwj|d wwxYw)u.Run a non-streaming LLM call inline on the conversation thread. Used when ``should_use_direct_api_call`` is True. Skips the interrupt worker (whose only job is interactive-interrupt responsiveness, which this context does not have) so the nested-pool deadlock (#62151) cannot occur. Because the request runs in-flight normally, the per-request OpenAI client's own httpx timeout (provider ``request_timeout_seconds`` / ``HERMES_API_TIMEOUT``) bounds a genuinely hung provider — the same bound interactive calls already rely on. &waiting for non-streaming API responserNcj5d}dddj||yy#1swY xYw)z?Abort the inline request from cron's watchdog/interrupt thread.rNreason)_abort_request_openai_client)rrrNrequest_client_holderrequest_client_locks r!_abort_active_requestz.direct_api_call.._abort_active_requestsC  =28._make_clientsJ 44Fz4Z  5.4 !( + 5&;#  5 5s.7r_interrupt_requestedF!Agent interrupted during API callrrequest_completerrr(r=Noneopenai)rr(rr() r_touch_activity threadingLockrrMInterruptedErrorrr_close_request_openai_clientr)rNrrresponserrrrs`` @@@r!direct_api_callrs BC%t,#..*N  Z5 :<  50% 8"#FG GE" 514 8|j7d?%"d@X"dAS|r*tKdBt?|dCt?| dD|"d@<n'tKdBt?|dCt?| dE"d@<nt;d(d}|r|t-j,|z |kDrt-j,|z }t$jGdF||jd+d5|djIdGt?|dHjd+d5d9 dIj/d=t?|dJ|j7d?%"d@,"dA'tKdKt?|dLt?|dE"d@<n||kDrrt}d}t;d2d}tE|r |jd+3}t$jGdM||jd+d5|d|r4jIdNt?|dOjd+d5dP|n1jIdNt?|dOjd+d5dQ dRtMj/dSt?|dT|j7d?%"d@X"dAS|r*tKdUt?|dVt?|dD|"d@<n'tKdUt?|dVt?|dE"d@<nLjNr.d"d<t$jCdW dXtQdY|j5r"d@"d@"dA tS"dAS#t@$rt$jCd0d"1YwxYw#t@$rd}YgwxYw#t@$rYwxYw#t@$rYwxYw#t@$rd}YwxYw#t@$rY{wxYw#t@$r YtQdYwxYw)\a= Run the API call in a background thread so the main conversation loop can detect interrupts without waiting for the full HTTP round-trip. Each worker thread gets its own OpenAI client instance. Interrupts only close that worker-local client, so retries and other requests never inherit a closed transport. Includes a stale-call detector: if no response arrives within the configured timeout, the connection is killed and an error raised so the main retry loop can try again with backoff / credential rotation / provider fallback. Nrerror)r owner_tidr*rFrcz5|d<|d<tjd<ddd|S#1swY|SxYwNrr*r r get_identrrrrequest_client_kindrs r!_set_request_clientz3interruptible_api_call.._set_request_client&sS  G.4 !( ++/  (2;1D1D1F !+ .  G  G "0:c5jd}jd}|duxr|duxr|tjk7}|s dd<dd<dddyjdd}|dk(r*rj||yj ||yrj ||yj ||y#1swYwxYwNrr r*rrrr@rr_abort_request_anthropic_client_close_request_anthropic_clientrr rrr stranger_threadrrNrrrs r!_close_request_client_oncez:interruptible_api_call.._close_request_client_once0s! :266x@N-11+>Id*7T)7!4!4!66  #26%h/59%k2 :  ! "&&w9 ' '55nV5T55nV5T   . .~f . M  . .~f . M/ : : AC  Cc  tdfd d<dy#t$rJ}dr6tjdt |j Yd}~dy|d<Yd}~Wd}~wwxYw#dwxYw) Nct|dk(rj||Sj||S)Nrrrr) _create_request_anthropic_clientr)rrrrNrs r!z7interruptible_api_call.._call..`sT:M33::&:I  ;<<%*= ;r#rrr*uhNon-streaming worker caught %s after request cancellation — exiting without surfacing a network error.rr r)rrr^debugtype__name__)er_request_cancelledrrNrresults r!_callz%interruptible_api_call.._callVs ; "D "F: 4 ''9 : "'* AG$$  ''9 : F7O  ''9 :s2# A6.A1A9'A1,A91A66A99 Br!HERMES_CODEX_HARD_TIMEOUT_SECONDSgp@rrRrrS^@rUN@g(@!HERMES_CODEX_TTFB_TIMEOUT_SECONDS&HERMES_CODEX_TTFB_DISABLE_ABOVE_TOKENSg@HERMES_CODEX_TTFB_STRICTrG>1onyestruezScaling openai-codex no-byte TTFB watchdog from %.0fs to %.0fs for large request (context=~%s tokens >= %.0f). Set HERMES_CODEX_TTFB_STRICT=1 to keep the smaller cutoff.,HERMES_CODEX_TTFB_MAX_SECONDSz~Capping openai-codex no-byte TTFB timeout from %.0fs to %.0fs (context=~%s tokens). Set HERMES_CODEX_TTFB_MAX_SECONDS to tune.(HERMES_CODEX_EVENT_STALE_TIMEOUT_SECONDSrTtargetdaemon333333?timeoutrd_codex_stream_last_event_ts)rrrrrrrr⏳ waiting on r the provider — z:s with no response yet (provider may be slow or overloaded)zwait-notice construction failed)exc_info_codex_silent_hang_hintrzCodex stream produced no bytes within TTFB cutoff (%.0fs > %.0fs, model=%s). Backend accepted the connection but sent no stream events. Killing connection so the retry loop can reconnect.unknownu&⚠️ No first byte from provider in zs (codex stream, model: z). Reconnecting. z). Reconnecting.codex_ttfb_killu!⚠ no response from provider in s — reconnecting...zcodex stream killed after zs with no first byteg@r rz&Codex stream produced no bytes within zs (TTFB threshold: zs). zs)zCodex stream produced no SSE events for %.0fs after first byte (threshold %.0fs, model=%s, context=~%s tokens). Killing connection so the retry loop can reconnect.u'⚠️ Codex stream sent no events for zs after first byte (model: codex_stream_idle_killzs with no SSE eventsz(Codex stream produced no SSE events for zs after first byte (threshold: zjNon-streaming API call stale for %.0fs (threshold %.0fs). model=%s context=~%s tokens. Killing connection.%⚠️ No response from provider for zs (non-streaming, model: z). z). Aborting call.stale_call_killz&stale non-streaming call killed after rz'Non-streaming API call timed out after zs with no response (threshold: zBForce-closing httpx client due to interrupt (not a network error).interrupt_abortrrr(r)*rrrrr!_compute_non_stream_stale_timeoutrrPrDrXrr|rrvenvironr@r[r\r^infor=_codex_stream_last_progress_tstimerThreadstartis_aliver`rrM_emit_wait_noticer>rr"callabler__buffer_status TimeoutErrorrrrr)#rNrr(_stale_timeout_codex_watchdog_enabled_openai_codex_backend_est_tokens_for_codex_watchdog _codex_floor_codex_hard_timeout_codex_idle_timeout_default _ttfb_enabled _ttfb_timeout_ttfb_disable_above _ttfb_strict_large_request_ttfb_timeout _ttfb_cap_codex_idle_enabled_codex_idle_timeout _call_startt _poll_count_elapsed _recovery _silent_hint_hint_fn_last_codex_event_ts_event_stale_elapsed_est_ctxrr&rrrrr's#`` @@@@@@@r!interruptible_api_callrrs ""%(uj11 .F '+$?#H-#..*"5)3;$N$NL!;!;R<N"%%H&Q ! ! #^-@A%/&+# '& 0&+# '& 0&*#&*#,MBEJM ()QS[\zz~~&@"EKKMSSUZ  #a'.2EE*E ':: Q"/5a8'!< >F q=]Y6 KKS1!4  &M1$2#a#-1)/3,))+K BCd3AGGIK **, sq    !yy{[0H O7"0!.!.")+?tL>S'F7O '3@XP,,/ ,>+?rC'F7O  'u.KTR $0337JJ#'99;1E#E NN>%#w 21!4   9#>R:S9TU,,6NN7I,N+OP !   *+CD  ! !,S1E-F,GG[\  FF3F g&6*+=+E".>sCW?X>YZ4478K4L3MRQ#w  n $6zBH*.Lu&?FH!(#+*..2I#JL NNC.w 2xl   $$;CM?K..8nnWi.P-QQT#n& $$;CM?K..8nnWi.P-QR%&  ++<= u %  ! !8XqI  FF3F g&6*+=+E&2A#h-Q88;N8K7LD'.*'F7O '3A#h-Q88;N8K7LBP'F7O   % % +/ w ' LLT  *+<=##FG Gi **,jg"Woj%E" * } O > N O(!(#'L(.  d  ,!(#'L(2  R "#FG G s=A]"^ ^^++^;_ _" ^^ ^^ ^('^(+ ^87^8; _  _  __ _32_3c *|j}|jdk(r|j}|j|}t |dd}|r |j nd}t |dd}|d|_|j|j||||n |j|j|j|j|t |dd|jxsijddk(tt |dd  S|jd k(r]|j}t |d dxsd }t |dd} |j|j|||jxsd|| S|jdk(rY|j} t!|j"dxst!|j"d} |j$dk(xs|j&dk(xrd|j(v} |j$dvxs|j&dk(} |j+|}| r4 ddl}ddlm}m}|j5|}||\}}||\}}| j|j|||jt |dd|j|j=|j| | | | r|j?ndtt |dd ! S|j} |jA}|jC}t!|j(dxst!|j(d}d"|j(v}d#|j(v}t!|j"d$xs.t!|j"d%xst!|j"d&}t!|j(d'}|j$xsdjEjGd(k(} dd)l$m%}m&}||j|j"}||u}|s|nd} tO|}!d}" dd*l(m)}#m*}$|jxsdjGjWd+d,*tY*fd-|$Dr|#|j}"d}%|r.|jZxsd.t]t_j`d/}% dd0l1m2}&|&|j$}'|'rt |dd}(|(d|_|j+|}| j|j|||j"|j=|j|(|jf|j|jt |dd|'|jh|!xsd|jj|"|jm|%1St |dd}(|(d|_|j+|})| jdTid2|jd3|)d4|d5|j"d6|j=d7|jd8|(d9|jfd:|jd;|jdt |ddd<|jxsdjGd=|d>|d?|d@|dA|dB|dC|dD|dE|j$dFk(dG|jhdH|!xsddI|jjdJ|r |jnnddK|r |jpnddL|%dM| dN|dO|jmdP|r|j?nddQ|r|jsnddR|"dS|j$S#t6$r-}t8j;dt |dd|Yd}~d}~wwxYw#t6$rd }d} YPwxYw#t6$rYwxYw#t6$rd}'YwxYw)Uz9Build the keyword arguments dict for the active API mode.rcontext_compressorN_ephemeral_max_output_tokens_anthropic_base_urlspeedfast_oauth_1m_beta_disabledF) rr,r9 max_tokensreasoning_configis_oauth preserve_dotscontext_lengthbase_url fast_modedrop_context_1m_betar_bedrock_regionr_bedrock_guardrail_configi)rr,r9rzrguardrail_configrzmodels.github.aizgithubcopilot.comrJrKrL> xai-oauthxaizapi.x.air)strip_pattern_and_formatstrip_slash_enumu4%s⚠️ Failed to sanitize tool schemas for xAI: %s log_prefixrG session_id_codex_reasoning_replay_enabledT) rr,r9r{rrzr;request_overridesis_github_responsesis_codex_backendis_xai_responsesgithub_reasoning_extrareplay_encrypted_reasoning nousresearchzintegrate.api.nvidia.comz api.kimi.comz moonshot.aiz moonshot.cnztokenhub.tencentmaas.comlmstudio_fixed_temperature_for_modelOMIT_TEMPERATURE)_get_anthropic_max_output_ANTHROPIC_OUTPUT_LIMITSrrc3&K|]}|v ywr/r0)r1key _model_norms r!r3z#build_api_kwargs..usFcsk!Fhermes) sessionIdpromptIdget_provider_profile)rr,r9rr;rzephemeral_max_output_tokensmax_tokens_param_fnr{rrprovider_profileollama_num_ctxprovider_preferencesopenrouter_min_coding_scoreanthropic_max_outputsupports_reasoningqwen_session_metadatarr,r9rr;rzrrr{r model_lower is_openrouteris_nousis_qwen_portalis_github_models is_nvidia_nimis_kimi is_tokenhub is_lmstudiois_custom_providercustomrrrqwen_prepare_fnqwen_prepare_inplace_fnrfixed_temperatureomit_temperaturerrlmstudio_reasoning_optionsr provider_namer0):r9r_get_transport#_prepare_anthropic_messages_for_apirMr~ru build_kwargsrrzr{_is_anthropic_oauth_anthropic_preserve_dotsrr@boolrrrIrHrF&_prepare_messages_for_non_vision_modelcopytools.schema_sanitizerrrdeepcopyrr^r__resolved_api_call_timeout#_github_models_reasoning_extra_body_is_qwen_portal_is_openrouter_urlr[r\agent.auxiliary_clientrrrsagent.anthropic_adapterrrranyrr(uuiduuid4 providersr_max_tokens_param_ollama_num_ctxr_supports_reasoning_extra_body_qwen_prepare_chat_messages#_qwen_prepare_chat_messages_inplace"_lmstudio_reasoning_options_cached)+rN api_messages tools_for_api _transportrctx_len ephemeral_out_btr guardrail_ctrrr_msgs_for_codex_copyrr_exc_is_qwen_is_or_is_gh_is_nous _is_nvidia_is_kimi _is_tokenhub _is_lmstudiorr_ft _omit_temp _fixed_temp_prefs_ant_maxrr _qwen_metar_profile_ephemeral_out_msgs_for_chatrs+ @r!build_api_kwargsrsIKKM ~~--))+ "FF|T%!5t<,3'(('EtL  $15E .&&++'(5(A}uGWGW"33..88:"U$94@..4"99'BfL!%ge5NPU&V!W'   ~~++""$ 148GKE#>E ++!''/4&     ~~**""$ !%..2D E J$U^^5HI  NNn , ((M9B(E,A,AA !>>-AAkUE]E]akEkFF|T$  $!&} = #;M#J q#3M#B q++$"33ulD9''446#55 3--Re5#L#L#Nko'+@$G(   &    C$$&H  % % 'Fe335GH M !6!68K L !6!66H+u/D/DDJennn= @  ? @  ? ))>)>@Z[LNN(b//1779ZGLY*5;;G,, !+c -U 3FH   {{(b//199#sC F-EF F0=H J))5XDJJL) 2'7 (FM  %15E . CCLQ ++!^^446''(6 % 7 7"33#55ulD9% 00!'4(-(I(I!)$CCE",'   2U$BDIN!-1*AA,ON 3  # kk# # #  #  002 #  ## # %3# "33# //#  11# 5,5# [[&B--/# # #  #   !# "!## $%# &!'# (!)# *!>>X5+# ,,,-# .$^t/# 0%*$E$E1# 2>F9943# 4NV I I[_5# 6)7# 8&9# :$;# <!??A=# >OUuHHJZ^?# @R^5#K#K#McgA# B&C# DnnE# #U JE<4c f   2    " sO#3\!/]A]$-]4 ]  "]]  ]! ]!$ ]10]14 ^^c t|dd}|j|}t|}|s\tt|dd}t j d|tj }|rdjd|D}|xsd}|r0|jr$tjdt|d ||r6|jr*|js|js |j|tt|dd} t!| } |r t!|}t#| t$r!| r|j'| j)} t#| t$r| rd d lm} | | } d | ||d } t|dd} | 6t/|dr*t|ddxsi}t#|t0r d|vr|d} | t!| | d<n|r|j3r |xsd| d<d| vr|r|| d<t/|dr|j4r|j4}g}|D]x}t#|t0r|j7|%t/|dr|j7|j8Mt/|dsZ|j7|j;z|r|| d<t|dd}|r|| d<t|dd}|r|| d<t|dd}|r|| d<|rg}|D]}t|dd}t|dd}t#|t$r|j)s|j=|\}}|}t#|t$r|j)s|t#|t$r!|j)r|j)}nKt|dd}|r t|ddnd}|r t|ddnd}|j?||t|}|j)}t|dd}t#|t$r|j)s|j=|\}}|}|jA|t#|t$r|nd}||||jB|jDjF|jDjHdd } t|d!d}!|!!t/|!dr|!j;}!|!| d!<|j7| || d<| S#t$rYwxYw)"zBuild a normalized assistant message dict from an API response message. Handles reasoning extraction, reasoning_details, and optional tool_calls so both the tool-call path and the final-response path share one builder. tool_callsNcontentz(.*?)flags c3^K|]%}|js|j'ywr/)r[)r1bs r!r3z*build_assistant_message..s"Paggi1779"Ps--zCaptured reasoning (z chars): r)redact_sensitive_text assistant)roler reasoning finish_reasonreasoning_content model_extra reasoning_details__dict__ model_dumpanthropic_content_blockscodex_reasoning_itemscodex_message_itemsidcall_idfunctionrzrG arguments{}response_item_idrzr )r r rr#r  extra_content)%rM_extract_reasoningrrrfindallDOTALLr`verbose_loggingloggingr"r)reasoning_callbackstream_delta_callback_stream_callbackrrr'r(_strip_think_blocksr[ agent.redactrhasattrr?_needs_thinking_reasoning_padrrrr_split_responses_tool_id_deterministic_call_id"_derive_responses_function_call_idr#r rzr )"rNassistant_messagerassistant_tool_callsreasoning_text_from_structuredr think_blockscombined _raw_content _san_contentrmsgraw_reasoning_contentr raw_details preserveddordered_blocks codex_itemsr r tool_callraw_idr embedded_call_idr_fn_fn_name_fn_argsrembedded_response_item_idtc_dictextras" r!build_assistant_messager9s ##4lDI--.?@NN+ &w/@)T'RSzz"97"))T {{"Pl"PPH%-N%// ,S-@,A>JZ[\%22**53I3I ((8 (0A9d(STL' 5L-n=,$00>DDF ,$6,\: #&  C$$57JDQ$1BM)R/EK k4 (-@K-O$/0C$D !(#78M#N  %"E"E"G$2#8S  0#%.#1   "56;L;^;^ (99   1A!T"  #J'  ,L)  0  1 '0C# $.0JDQN*8 &'+-DdKK'2 #$ ""35JDQ%8 !" -= 'IYd3FiD9Ggs+7==?&+&D&DV&L# !*gs+7==?fc*v||~$llnG!)Z>C;>wsFB7BHBEwsK>4H#::8XsS]_GmmoG&y2DdK .4 2;D} %&ugRwr$((*+6GHB I#%Er#cBt|jdxsdjjt|jdxsdjt|jdxsdjj dfS)NrIrGrr/)r(r@r[r\rstrip)fbs r!_fallback_entry_keyrKs| BFF:  $"%++-335 BFF7O !r"((* BFF:  $"%++-44S9 r#c|jdxsdjj}|dk7ry ddlm}|dxsi}|jd}|jd }t|txrt|j}t|txrt|j} |s| sy y#t $r"}dt |jcYd}~Sd}~wwxYw) zGReturn a skip reason for fallback entries known to be unusable locally.rIrGnousNr)get_provider_auth_stateznous_auth_unreadable: access_token refresh_tokennous_token_missing) r@r[r\hermes_cli.authrNrr#r$r'r(r) rNrJ fb_providerrNstater access_value refresh_value has_access has_refreshs r!+_fallback_entry_unavailable_without_networkrYs66*%+224::|%|_?||_@|"|%|j|!0|_A| d k(r|$|%nd|_Bd |_Ci|_Dn||j||_>||_Ct |d1d }&|&s t |d2d }&|j||d3|&r d2t|&ini|_D|!!|!|jd4<|jd56|j| ||| 7\|_H|_I|jta|d8r|jrdd9lLmM}'t|j|t6r |j|nd}(|'|jX|jJ|(|jZt |d:d t |d;d <})|jj|jX|)|jJt |dd|jZ|j^= dd>lPmQ}*dd?lRmS}+|+|*xsi|jX|_Tt*jid@|jX|jt|| | |jdB| dC| dD|dC|dE| dC| |_Wt*jidF|| | t|y#tH$r#}t*j5d| | |Yd }~d }~wwxYw#tH$r#} t*j-d.| | | Yd } ~ /d } ~ wwxYw#tH$r+},t*j-dA|jX|,Yd },~,d },~,wwxYw#tH$rH}-| dGk(r|j3|t*jdH| |-|j/|cYd }-~-Sd }-~-wwxYw)IuSwitch to the next fallback model/provider in the chain. Called when the current model is failing after retries. Swaps the OpenAI client, model slug, and provider in-place so the retry loop can continue with the new backend. Advances through the chain on each call; returns False when exhausted. Uses the centralized provider router (resolve_provider_client) for auth resolution and client construction — no duplicated provider→key mappings. _fallback_activatedFrIrG<r_rate_limited_untilr_unavailable_fallback_keysNz/Fallback skip: %s previously marked unavailablerzMFallback skip: %s/%s is not locally usable (%s); suppressing for this sessionrrHz?Fallback skip: chain entry %s/%s matches current provider/modelz>Fallback skip: chain entry base_url %s matches current backend)resolve_provider_clientapi_keykey_env api_key_envz ollama.comOLLAMA_API_KEYT)r raw_codexexplicit_base_urlexplicit_api_keyz.Fallback to %s failed: provider not configured)normalize_model_for_providerz9Could not normalize fallback model %r for provider %r: %srrJr anthropicz /anthropiczapi.anthropic.comr)rIbedrockzbedrock-runtime.z amazonaws.comr_transport_cache_credential_poolznFallback to %s/%s: clearing primary credential pool (pool_provider=%s) to prevent cross-provider contamination) load_poolz4Fallback to %s/%s: attached fallback credential poolz7Fallback to %s/%s: could not attach credential pool: %s)build_anthropic_clientresolve_anthropic_token_is_oauth_tokenr:_custom_headersdefault_headers)r`rr;fallback_timeout_applyr)rIrrrrt)get_model_context_length_config_context_length_custom_providers)rr`rIconfig_context_lengthcustom_providers)rr~rr`rIr load_config)resolve_reasoning_configz*Fallback %s: reasoning_config resolved: %szGFailed to resolve reasoning_config for fallback %s; keeping current: %su5🔄 Primary model failed — switching to fallback: z via u!🔄 Switched to fallback model: u → u"Fallback activated: %s → %s (%s)rMz"Failed to activate fallback %s: %s)Zr rate_limitbillingupstream_rate_limitrrMr[r\_primary_runtimer@rQ monotonicr]_fallback_indexr)_fallback_chainr_FALLBACK_EXHAUSTED_COOLDOWN_SrKsetr^r^r"_try_activate_fallbackrYaddr_r(rIrr_rvrwrhermes_cli.model_normalizergrr_is_azure_openai_urlendswithr_is_direct_openai_url&_provider_model_requires_responses_apirrrIrtrrrjclearr[rOrkagent.credential_poolrlhas_credentialsrrrmrnror`_anthropic_api_keyrv_anthropic_clientrr_client_kwargsr?_replace_primary_openai_client_anthropic_prompt_cache_policy_use_prompt_caching_use_native_cache_layout_ensure_lmstudio_runtime_loadedrtagent.model_metadatarsr' update_modelhermes_cli.configryhermes_constantsrzr{rFrW_pending_fallback_noticerr ).rNrfallback_already_activecurrent_providerprimary_provider_existing_cooldownrJfb_key unavailablerSfb_modellocal_skip_reason current_modelcurrent_base_urlfb_base_url_for_dedupr_fb_base_url_hintfb_api_key_hint fb_key_env fb_client_resolved_fb_modelrg _norm_err fb_api_mode fb_base_url _fb_is_azure old_model old_provider_existing_pool_pool_providerrl fallback_poolr _fb_timeoutrmrnro effective_key fb_headersrs_fb_ctx_api_keyfb_context_lengthryrz_reasoning_errr%s. r!try_activate_fallbackrsm .++^-C-C^EgEghh#'wu6KU'S"T#E:r:@bGGIOOQ"339r>>zJPbWWY__a'-=BRVfBf(,(82(=E % E$9$9 :: %% & *~88.:P:PR`RtRtuu!(0Eq!I!NQ (+" #AA)E %   u44 5B Q  $F%!=tDKe +6(  FO++F3366*%+224::EEcJPPR&&8}+D M  ++F33  !%5 5  % L ! ++F33 M4BFF:.4";;=E66),299;Ct&&+Jrvvm/DJQQSJ"$))J";"A"A"C"Kt  56F U^m ii(89ATO(? x4.,).% %   NN@  OOF #//7 7  O3HkJH) ),,- 11+> . (+K ; &!!#&,,.77 E -1DD/K -K  ( ( 5+K  9 9  : ,K I % k * 5 56H I%k?C,KKK ~~ (,$ $$$ 5, -  " " ( ( *$(!!(:DA  %%nj"EKRRTZZ\N.K"? Q> *.& 5,d 3 ; ; )+ 6  ]%B%B%D-:E*KKN#X3;I . . p pVaepVpY..Q2I2KQrxAxIxIxOMOM)EM'4E $(3E %&<u88+'E #KVYdJd (FjoE %EL#%E &--EM$EL!,=tDJ$Y0A4H $,,'$=G%tJ'78B$E &2=$$Y/44h?H%i-%Ah6=Ai- h!g?9i-?hi- h3h.(i-.h33i-6 i*?!i% i-%i**i-- j>6=j93j>9j>c td|jdd}|jd|d |j}g}|D]}|j }|j ||dD]}|j |ddD]} |j | dt||D cgc]'} t| ts| jd s&| )c} D]} |j | d|r|j||j |j||jxsd } |jr | d z|jzj} | r d | dg|z}|j rF| rdnd} t#|j D](\}}|j%| |z|j *|j'|}|j)|}i} ddlm}m}|||j|j2nd}||u}|rdn|}d|j4v}|j6xsd jj9dk(xr|j;}|r|j=nd}|s4|j;r$|j>|j>|d<nddd|d<|rddl m!}||d<|jDdk(ru|jG|}|j dd|jI|}|jK}|jM|}|jNxsd j}n|j|d}|||d<|jP*|jS|jU|jP|||d<tW|} i}! ddl,m-}"|"|j6}#|#C|#j]t_|dd| xsd|j|j2|j> }!|!r|jS|!| rHd!|!vrD|j6xsd jj9d"k(s|jar| |d!<|jd#k(r|j6xsd jj9d"k(s|jarJ|jb>|jbd k7r/ te|jb}$|$d$|$cxkrd%kr nn d&|$d'g|d(<|r||d)<|jDd*k(r|jK}%|%jk|j|d|jP|j>|jl|jo+}&|jq|&}|%jM||jl,}'|'jNxsd j}ns|jsd-.jtjvjxd9i|}|jKjM|}'|'jNxsd j}|rVd/|vr5t{j|d0d |tzj~1j}|r|jd2|d|Sd3} |S|jDdk(ru|jG|}|j dd|jI|}(|jK})|)jM|(}*|*jNxsd j}n|jDd*k(r|jK}+|+jk|j|d|jl|jP|j>|jo4},|jq|,}(|+jM|(|jl,}-|-jNxsd j}n|j|d}|||d<|jP*|jS|jU|jP|||d<|r||d)<|jsd5.jtjvjxd9i|}|jKjM|}-|-jNxsd j}|rVd/|vr5t{j|d0d |tzj~1j}|r|jd2|d|Sd3} |Sd3} |Scc} w#t0$rd}d}YwxYw#t0$rYwxYw#tfthf$rd}$YJwxYw#t0$r>}.tjd6|.d7|jd8t|.}Yd}.~.|Sd}.~.wwxYw):zSRequest a summary when max iterations are reached. Returns the final response text.u$⚠️ Reached maximum iterations (z). Requesting summary...zYou've reached the maximum number of tool-calling iterations allowed. Please provide a final response summarizing what you've found and accomplished so far, without calling any more tools.user)rr)rr_thinking_prefillN) tool_namerr  timestamprrDrGrsystemrrrrrrTmedium)enabledeffort)nous_portal_tagstagsrr9)rr, temperaturereasoning_effortrr)rrrrr{rI openrouterzopenrouter/pareto-coderVg?z pareto-router)r min_coding_scoreplugins extra_bodyr)rr,r9rzr{r|r})strip_tool_prefixiteration_limit_summaryrzz.*?\s*rrz>I reached the iteration limit and couldn't generate a summary.)rr,r9r|rzr{r}iteration_limit_summary_retryz Failed to get summary response: z"I reached the maximum iterations (z!) but couldn't summarize. Error: r0)Bprintmax_iterationsr_should_sanitize_tool_callsr_copy_reasoning_content_for_apirrr'r(r#_sanitize_tool_calls_for_strict_apirr;ephemeral_system_promptr[prefill_messages enumerateinsert_sanitize_api_messages#_drop_thinking_only_and_merge_usersrrrrrrFrIr\r*_resolve_lmstudio_summary_reasoning_effortr{agent.portal_tagsrr_build_api_kwargsrrnormalize_responserrzupdaterrsrrbuild_extra_bodyrMrrrurxryrrrr_ensure_primary_openai_clientrrrrrrr^r_)/rNr,api_call_countsummary_request_needs_sanitizerr)api_msginternal_fieldschema_foreignk internal_keyeffective_system sys_offsetidxpfmsummary_extra_bodyr _OMIT_TEMP_raw_summary_temp_omit_summary_temperature_summary_temperaturer_is_lmstudio_summary_lm_reasoning_effort _portal_tags codex_kwargssummary_response_ct_sum_cnr_sumfinal_responsesummary_kwargsrprofile_extra_bodyrr_ps_tsum_ant_kw_summary_resultretry_response _ct_retry _cnr_retry_tretry_ant_kw2 _retry_resultr%s/ r!handle_max_iterationsros  01E1E0FF^ _` *  OOV@Ak~ ;;=  )ChhjG  1 1#w ?"U 2 ND1 2#m 2 ND1 2 #7 +,3 `qz!S7Iall[^N_ ` 0  L$/ 099'9U    (= )@!66<"  ( ( 06 9E)- $(L(L(N%%1272H2H";/ $&3";/  J)5 v & >>. . 22<@L   Wd +$66|D **,G112BCH&..4";;=N(N$/0D}-+%%e&=&=e>N>N&OP#/5I12$C5#I !#  :#7#G #/)9)J)J#*5,#E-A-IT#kk!&).)?)? *K*&""))*<=# :L(L%2,,.446,F++-1E":.  77^^)r00288:lJ//155A55; A ABC?sc'8S'8.CH5&y1"/A|,~~!55,,.,,5;;]a*/*:*:UMcMc(-(A(A-2-K-K-M-O$)#C#CG#L "'":":;K_d_x_x":"y"1"9"9"?R!F!F!H$A5#F#FNg#F#h#m#m#y#y$A$A$SDR$S "'"6"6"8"K"KL\"]"1"9"9"?R!F!F!H N*!#(@"n\^\e\e!f!l!l!n PQj g"bf a~~!22$66|D   $/!&!8!8!F!002 &99.I ","4"4":!A!A!C#77..0"//ekkL`d).)B)B+0+;+;eNdNd.3.L.L.N0P"'!A!A(!K ' : :>]b]v]v : w "/"7"7"=2!D!D!F#[[ ,"(34HN=1##/"))%*A*A%BRBR*ST'39MN#56%3EN<0$G5#F#FNm#F#n#s#s##$G$G$YJX$Y % 4 4 6 I IJZ [ "/"7"7"=2!D!D!F.%'VV,Db.`b`i`i%j%p%p%rN!OO[^$TU &fN  "b ]!a< +/ (J L  2":.CZ ~9!=>=e>R>R=SStuxyzu{t|}  ~sA:d++c*c*c*D d+!c/)F:d+$AdCd+dFd+=d+Id+ d+%d+*d+/ d<d+?dd+ d d+dd+d($d+'d((d++ e243e--e2c t|r&|jr3tjd|dnt j | d} ddl m }|}|r&|jr4tjd |dyt j|yy#t $r1}|jrtjd|d|Yd}~d}~wwxYw#t $r+ttjjd }YwxYw#t $r6}|jr tjd |d|Yd}~yYd}~yd}~wwxYw) aClean up VM and browser resources for a given task. Skips ``cleanup_vm`` when the active terminal environment is marked persistent (``persistent_filesystem=True``) so that long-lived sandbox containers survive between turns. The idle reaper in ``terminal_tool._cleanup_inactive_envs`` still tears them down once ``terminal.lifetime_seconds`` is exceeded. Non-persistent backends are torn down per-turn as before to prevent resource leakage (the original intent of this hook for the Morph backend, see commit fbd3a2fd). Skips ``cleanup_browser`` in headed mode so the browser window stays visible between turns. The inactivity reaper in ``browser_tool._cleanup_inactive_browser_sessions`` still handles idle sessions. z0Skipping per-turn cleanup_vm for persistent env z; idle reaper will handle it.zFailed to cleanup VM for task r?NFr)_is_headed_modeAGENT_BROWSER_HEADEDz5Skipping per-turn cleanup_browser for headed session z#Failed to cleanup browser for task )rrrr"r" cleanup_vmrr^r_tools.browser_toolrrrvrNr@cleanup_browser)rNtask_idr%headedrs r!cleanup_task_resourcesrksH L W %$$ FwiP23 E  W %Q B :$&F $$ KG9U23 E ! !' * % L  NN;G9BqcJ KL B"**..)?@AF B Q  NN@ A3O P P !QsZA B D C'DD C)'CC1DDDD E'EEdropped_tool_namescvt||d|}td|t}tt||g||xsdS)aBuild a partial-stream-stub response for mid-stream drop scenarios. Used when the SSE stream ends without a ``finish_reason`` after delivering content (text-only drops, tool-call-arg drops). The stub is tagged ``PARTIAL_STREAM_STUB_ID`` with ``FINISH_REASON_LENGTH`` so the conversation loop enters its continuation/retry path instead of silently accepting truncated output as a complete turn (#32086). Nrrrrrindexmessagerr rchoicesusage_dropped_tool_names)rr r )r full_contentfull_reasoning model_name usage_objr mock_message mock_choices r!_build_partial_stream_stubr!sT# ( L "*K  ! .6$  r#)rc 0&'()*+,-./0123456789:;<jr tdtrjSjdk(r _ jd_Sjdk(rddd:ddi5ddi4d t j i&jd d }t}t5fd ,&,4:fd }tj|d}|j|jr|jdjr tdt j &d z }||kDrtj!d|||jddj#dt%|djdddt' ddlm}||t j &d <tt1dt%|dt%|d:d<n|jrjr td :d:d:d! t3:d!Sddgd":tdddd#7d$d%i8tj49d$di.d%d&do789fd'/dp789fd( *ddi5ddi4d t j i6d3tj4;dt7ddd)3n| 3dd?l)m*}|jd@}| tQ3|3tj| d}|jt j }dA}|jr|jdt j }||z |k\r{|}t%|6d z }||k\rN33tMdBk7rdCt%3dD}ndE}jWdFjd@dGdH|dI|dJnjYdK|dLt j 6d z }|3kDrtO}tj!dM|3jd@d|dNj#dOt%|djd@ddP|dNdQ )dR*dRt'jdSk(rn j[dTUt j 6d <jWdVt%|dWjYdXt%|dYjr6d.d$<tj/dZ )d[*d[td\|jrjr td]:d4drt]d^dExsdEj_xsd}ta:jd_xsg}|rd`j|dda}tc|dakDr|dbtc|daz dcz }dd|de}|xsdE|z} je|tj!df|tc|xsdE:dtf}n-tj!dgtc|xsdE:dtf}tidh|ddi} d}! ddjl5m6}"m7}#|":dtqt]dkdExsdEtqt]d@dExsdEl}$|$jr|#jtk(}!titvt]d@dtid| |mgd|xsdn}%|!rd|%_<t3|%S:d:d! t3:d!S#d_wxYw#t,$r!} tj/d| Yd} ~ Id} ~ wwxYw#t,$rY!wxYw#t,$rYwxYw#t,$rYwxYw#t,$r Ytd\wxYw#t,$rYwxYw#t,$rd}!YwxYw)uuStreaming variant of _interruptible_api_call for real-time token delivery. Handles all three api_modes: - chat_completions: stream=True on OpenAI-compatible endpoints - anthropic_messages: client.messages.stream() via Anthropic SDK - codex_responses: delegates to _run_codex_stream (already streaming) Fires stream_delta_callback and _stream_callback for each text token. Tool-call turns suppress the callback — only text-only final responses stream to the consumer. Returns a SimpleNamespace that mimics the non-streaming response shape so the rest of the agent loop is unchanged. Falls back to _interruptible_api_call on provider errors indicating streaming is not supported. z+Agent interrupted before streaming API callrNrr doneFr1rirrcPdsrdd< yyy#t$rYywxYwNr#Trfirst_delta_firedrsr! _fire_firstz5interruptible_streaming_api_call.._fire_firsts@$V,,0!&)"$2@,!  %%c  ddlm}m}m}m}m}m}jdd}jdd||} |jdi}t#fd } fd } fd } ||j%r| nd| j&s j(r| ndfd fdd <y#t$r} || rad_ jdtjdt| j||j did <Yd} ~ y|| r||d} ~ wwxYw#t$r} | d<Yd} ~ yd} ~ wwxYw)Nr)rrr is_streaming_access_denied_errorrstream_converse_with_callbacksrrrTu ⚠ AWS IAM denied bedrock:InvokeModelWithResponseStream — falling back to non-streaming InvokeModel. Grant that action to restore streaming output. u`bedrock: converse_stream denied by IAM (%s) — using non-streaming converse() for this session.rc@j|dd<y)NTr1)_fire_stream_delta)textr)rNdeltas_were_sents r!_on_textzIinterruptible_streaming_api_call.._bedrock_call.._on_text4 s!M,,T2.2$U+r#c6j|yr/)_fire_tool_gen_started)rzr)rNs r!_on_toolzIinterruptible_streaming_api_call.._bedrock_call.._on_tool9 sM006r#c6j|yr/)_fire_reasoning_delta)r0r)rNs r! _on_reasoningzNinterruptible_streaming_api_call.._bedrock_call.._on_reasoning= sM//5r#cjSr/)rrsr!r!zIinterruptible_streaming_api_call.._bedrock_call..F s u/I/Ir#cLjdtjS)Nri) __setitem__rQ)_bedrock_last_eventsr!r!zIinterruptible_streaming_api_call.._bedrock_call..G s%8%D%DS$))+%Vr#) on_text_delta on_tool_starton_reasoning_deltaon_interrupt_checkon_eventr r0)rrrrr,rr-rconverse_streamr_disable_streaming _safe_printr^rOr#r$rr_has_stream_consumersrr)rrrr,rr-rrrrr2r5r8r%r<r)rNrr1r's r! _bedrock_callz7interruptible_streaming_api_call.._bedrock_call slF $$(1&99n $"#w $sI._set_request_client sQ  G.4 !( ++/  (1:1D1D1F !+ .  G   G  rc5jd}jd}|duxr|duxr|tjk7}|s dd<dd<dddyjdd}|dk(r*rj||yj ||yrj ||yj ||y#1swYwxYwrrrs r!rzDinterruptible_streaming_api_call.._close_request_client_once s ! :266x@N-11+>Id*7T)7!4!4!66  #26%h/59%k2 :  ! "&&w9 ' '55nV5T55nV5T   . .~f . M  . .~f . M- : :r)current cancelleddiscarded_chunksdiscarded_bytescj5dxxdz cc<tdcdddS#1swYyxYw)NrKr)r>)stream_attempt_lockstream_attempt_statesr!_start_stream_attemptz?interruptible_streaming_api_call.._start_stream_attempt s9  8  +q 0 ++I67 8 8 8s)2c5tjdxsd}|rdj|dddrtj d||yy#1swY$xYw)NrKrrLz&Marked stream attempt %s cancelled: %s)r>r@rr^r")rrKrPrQs r!_cancel_current_stream_attemptzHinterruptible_streaming_api_call.._cancel_current_stream_attempt sk  ?.229=BCG$[155g> ?  LL8    ? ?s 5AA%c5|tjdxsdk(xr|dv cdddS#1swYyxYw)NrKrrL)r>r@stream_attempt_idrPrQs r!_stream_attempt_is_activezCinterruptible_streaming_api_call.._stream_attempt_is_active sS  !S)=)A)A))L)QPQ%RRO%-A+-NN    s +9AcB5|dvcdddS#1swYyxYw)NrLr0rVs r!_stream_attempt_was_cancelledzGinterruptible_streaming_api_call.._stream_attempt_was_cancelled s-  J$(<[(II J J Jsc4 tt|}5dxxdz cc<dxx|z cc<d}d}ddddk(rtj d||ytj d||y#t$rd}YswxYw#1swYQxYw)NrrMrrNz[Discarding chunk from superseded stream attempt %s (discarded_chunks=%s discarded_bytes=%s)zUDiscarded stale stream chunk from attempt %s (discarded_chunks=%s discarded_bytes=%s))r)reprrr^r_r")rWchunk chunk_bytesrMrNrPrQs r!_discard_stale_stream_chunkzEinterruptible_streaming_api_call.._discard_stale_stream_chunk s d5k*K! F !3 4 9 4 !2 3{ B 334FG 23DEO  F q NN;!    LL;!   ! K  F FsA=%B= B  B BcPdsrdd< yyy#t$rYywxYwr%r&r'sr!_fire_first_deltaz;interruptible_streaming_api_call.._fire_first_delta s? (^(, f %  .<(  r*c  ddl}t:j:j}||n t dd}||}nt dd}|dk(rE:j r9t :j r$|}tjd:j |n2|dk(r-9+9tdk7r9|kDr9}tjd || t|d nd }i;d |j|||| d}t:j sdd i|d<6:jd|}tj=d<:jd:j!}|>d<|j"j$j&dFi|} t):} t+| drtj-d:jxsd:jxsdd :_| j0} t3| t4t6fr| r| dnd} t9| dd} | }t9| ddxs t9| dd}t3|t:r|r5:j=|t9| dd}t3|t:r|r5:j?|| S:jAt9| dd:jCt9| dd:jE|t9| dd:jGt9| ddg}i}tI}i}i}d}d}d}g}d}| D]}tK:| s)tjMd;jOd dntj=d<:jd! tQ|jOd"dd#z|d"<|jOd$=d|d$< tQ|jOd%dtStU|z|d%<:jXrn7|s 4|||j0sJt+|d r|jr |j}t+|d&r|jZr |jZ}G|j0dj\}t+|d r|jr |j}t9|ddxs t9|dd}|r)|j_|5:j=||r|j`r|j_|j`|s(5:j?|j`d S|duxr|xr| }/|/r7tjMd?t||&d(j|xsd||S|xsd@}0|(rdA}0d(j|xsd}1t||&|'|1B}2td|2|0C}3tdDt;tjz||3g|ES#tV$rY5wxYw#tV$rYEwxYw#tV$rYwxYw#tj$rt|*|+},|,d9k7r|,}*nd }(YwxYwcc} w)Gz#Stream a chat completions response.rNHERMES_API_TIMEOUTg @HERMES_STREAM_READ_TIMEOUTr*uDLocal provider detected (%s) — stream read timeout raised to %.0fsinfuVCloud reasoning stream — read timeout raised to %.0fs to match stale-stream detectorr+>@T)connectreadwritepool)streamr; include_usagestream_optionschat_completion_stream_requestrriz)waiting for provider response (streaming)rHrz}Streaming request returned a final response object instead of an iterator; switching %s/%s to non-streaming for this session.rErrrrrrzxStreaming attempt superseded by a newer stream; stopping consumption to preserve the single-writer invariant (model=%s).rreceiving stream responsechunksrfirst_chunk_atbytesrr1rGr>)r{r r)r r#r rr rzr rrrrGzstream attempt z was supersededF?rr#)r r#rr zlProvider returned an empty stream with no finish_reason (possible upstream error or malformed SSE response).zStream ended with no finish_reason while a tool call's arguments were still incomplete (tools=%s); treating as a mid-tool-call stream drop, not an output-length truncation.rzkStream ended with no finish_reason after delivering text with no tool calls; treating as a mid-stream drop.stoplengthrrzstream-)r rrrr0)MhttpxrrIrrrrr^r"rurTimeoutrrrQr_stream_diag_initrrrrrrOrCrr'r5tuplerMr(r7r/_capture_rate_limits_capture_credits_stream_diag_capture_response_check_openrouter_cache_statusrrr_r@r>r)r\rrrdeltarrr_record_streamed_assistant_textrrr rr rzr rr?rrr4rRemoteProtocolErrorr`rar[jsonloadsJSONDecodeErrorrrr r!rr)@rW_httpx_provider_timeout_cfg _base_timeout_stream_read_timeout _conn_cap stream_kwargsr_diagrk _writer_tokenr first_choicerr#r content_partstool_calls_acctool_gen_notified_last_id_at_idx_active_slot_by_idxrrrreasoning_partsrr]r~tc_deltaraw_idxdelta_idnew_slotr_tc_identry_new_idr8rzrmock_tool_callshas_truncated_tool_argstcr rrepaired_tool_args_dropped_no_finish_dropped_names_text_only_dropped_no_finisheffective_finish_reasonrrr r_rarrXrZ_stream_stale_timeoutrNrr1last_chunk_timerr's@ r!_call_chat_completionsz@interruptible_streaming_api_call.._call_chat_completions' s' !=U^^U[[ Y%0 "/8  ! ,#8 #,-I5#Q $u,DUV[VdVdDe'4$ ZNN$8 %-)5)U5\9),@@(=$ 23G 1F0QC t,W[     ~~!)# &  )8/>.EM* +,  / /7( 0   $yy{ IJ'')(-f%7$$0077H-H ,E2 69 % KKR+) (y   (,E $ nnG)3GdE])KPW71:]aLlIt "%eii!&<"="Ah99-.6.=c.BE*+ %(7A)>%?#d5kBR%RE'N )),->?+,=uE==5'*u{{!&J5'*u{{ % IMM!$**Eug&5;;"[[ %U,?Fk'RWYdfjJkN&&~6!#++N;$$U]]3%%',,U]];.2$U+0033EMMB==emmL )) % 0 0FBH080JhnnPQG'{{0bH&997>+G4 #6$(@@#&~r#BQ#F7?+G43;0-g6C.0!)%fc2%([F"(,B$.13"(E-1 /s+ +3/E{{."*++%gs3&)'lG"*1E$K((#,,119A8I8I8N8NE*-f5#,,66!*-k:h>O>O>Y>YY:#HotDE}=)I9CHDXDXZ^9_!5!5eg l lm| }("5,7$)$4$4$6E16o. ,V4D+< <)--c2)+44T:34;;DAMFBP}}Q-- % a 0 > > ug&5;;!KK Id (L )): ;,,!"3!4OD  ww}-5 "'  On- #C(zN;7 zN629c !2; 9-  &&$xF"$&&"9, ^F3"+ (- H  !!#""G 2(?'X=TXCX$ '".1 $Z08?C?N NNN   .l(0DI#1#9T   T ! # #"" % ( NNE .l(0DI  #0"96 "&. #19T& &,  & 1 3tzz|,, M   ]!  f%L //;$?y)#T#t+(0I7;3;zsZ:h)=3h 6h9i i9 h&"h)%h&&h)) h65h69 ii )i65i6c 6d}d}tjd<j}|d<ddlm}|t dd|j j d$i5} j|t |d d t}|D]}t|s)tjd jd d nd}tjd<jd t|jdddz|d<|jdd|d< t|jddt!t#|z|d<j$rnt |dd }|dk(rPt |dd } | st | dd dk(sd}t | dd } | s(j'| B|dk(sIt |dd } | sZt | dd } | dk(r4t | dd} | s}|rj)| dd<| dk(st | dd}|sj+|j$r d d d y |j-}|s'|t |d!d st |d"d  t1d#|cd d d S#t$rYGwxYw#t$rYxwxYw#t$rYwxYw#t.$r|s t1d d wxYw#1swYy xYw)%aVStream an Anthropic Messages API response. Fires delta callbacks for real-time token delivery, but returns the native Anthropic Message object from get_final_message() so the rest of the agent loop (validation, tool extraction, etc.) works unchanged. Uses ``request_client`` (a per-request Anthropic client registered with the stranger-thread abort machinery) rather than the shared ``_anthropic_client``, so the stale/interrupt watchdog can abort this stream's socket without closing the shared client mid-flight (#67142). FrirHr)sanitize_anthropic_kwargsrrG)rrNzAnthropic streaming attempt superseded by a newer stream; stopping consumption to preserve the single-writer invariant (model=%s).rrETrorprrqrrr#content_block_start content_blocktool_userzcontent_block_deltar~ text_deltar0r1thinking_deltathinkingzeProvider returned an empty stream with no events (possible upstream error or malformed event stream).r stop_reasonzjProvider returned an empty stream with no stop_reason (possible upstream error or malformed event stream).r0)rQrxrrrMr,rkr|rrrr^r_r@rr>r)r\rr4r/r7get_final_messageAssertionErrorr )r has_tool_usesaw_stream_eventrrrkrevent event_typeblockrr~ delta_typer0 thinking_text_final_messagerarNrr1rrs r!_call_anthropicz9interruptible_streaming_api_call.._call_anthropic sx ! $yy{'')(-f% F! 75,#C ,^ $ $ + + 9j 9u "V  3376:t<06M= K0}ENN>#w :  #' (,yy{$%%&AB &)%))Ha*@&AA&EE(Oyy!12:2A#2F./),UYYw-B)Cc$u+FV)Vg --$UFD9 !66#E?DAE!=!K'+ $+E64$@ $-/!88C#88#E7D9E%,UFD%A %5#*5&"#=D#L 1 3 % 8 8 >:> 0 7'+;;,3E:r,JM, 1 3 % ; ;M J{= KL))ku "u "x !'!9!9!;$& 4@ tDL'K"ku "u "  B% d" '*O    }u "u "s)L+KA0L9:K#43K'/LL*L=LL/!LL$L<L (L?K3*L K LKL K K#K  K## K0,L/K00L3L  LLc  ddl}tdd} t|dzD]r}} jrdt d j dk(r& j d d }|$d <n |$d <d y d y#t$r}d r7tjdt|jYd}~d yt||j|j|jf}t||j |j"t$f} j'|}t|t(} !dryt+$j-d} d} |sP|sNddlm} t|| r._call.. s?"(.%+.@$@?"rz9Streaming failed after partial delivery, not retrying: %sr u9 ⚠ Connection dropped mid tool-call; reconnecting… r#TrH)r attempt max_attempts mid_tool_callrHstream_mid_tool_retry_cleanup"stream_mid_tool_retry_pool_cleanupc3&K|]}|v ywr/r0)r1r_err_lower_sses r!r3zBinterruptible_streaming_api_call.._call..X s3$*!'. 83rstream_retry_cleanupstream_retry_pool_cleanup exhausted)rr rrrrHu5❌ Provider returned malformed streaming data after uM attempts. The provider may be experiencing issues — try again in a moment.u5❌ Provider returned an empty response stream after u(❌ Connection to provider failed after rkz not supportedinvokemodelwithresponsestream)r,u ⚠ AWS IAM denied bedrock:InvokeModelWithResponseStream. Switching to non-streaming. Grant that action to restore streaming output. u ⚠ Streaming is not supported for this model/provider. Switching to non-streaming. To avoid this delay, set display.streaming: false in config.yaml z$Streaming failed before delivery: %s))rvrrangerrrr rr^r"r#r$r' ReadTimeoutConnectTimeout PoolTimeout ConnectErrorrConnectionError_is_provider_stream_parse_errorr rr@rrrMr(r\rr_r/_reset_stream_delivery_tracking_emit_stream_dropr_log_stream_retryrWrr,rCrDrO)%r_max_stream_retries_stream_attemptrWrr% _is_timeout _is_conn_err_is_stream_parse_err_is_empty_stream_partial_tool_in_flight_is_sse_conn_err_preview _APIError_SSE_PREVIEW_PHRASES _is_transient_can_silent_retry_is_sse_conn_err_SSE_CONN_PHRASES_exhausted_msg _err_lower_is_stream_unsupported_is_bedrock_stream_deniedr,rrrrrTrr&rrRrNr1r(rr's% @@r!r(z/interruptible_streaming_api_call.._call s %&=qAD B#()>-AA% % D D+O!E!"$-% $% (-$&|@%a3GA}VZ<[-0V\\^N 1-033.?30, $'+/++-@@!33&'(7!(;-@1-D.3%:%>%>v%F 4;;QR67MN %~~1EE!)$)$H$H/J%I%&(1!)$(!)$//!,"#$7!$;) /: =/5:1 6 ?: M !A C625N7;E4!--$=!V!3  B'(F7O ''@ AS aD    F7O  &'@ A  ''@ As7R AB" RR" R,.RR(D!R RH*)R* H63R5H66R:I  R IRIAR4KR KRKRRB-R NR N)&R(N))R,R2CRRRR R;$R6)R>6R;;R>> SrrrTrxrNlocal_stream_stale_timeout!HERMES_LOCAL_STREAM_STALE_TIMEOUTuBLocal provider detected (%s) — stale stream timeout set to %.0fsrRrrSrrrrfrer~rrGr>r?r@zRs with no output yet (provider may be slow or overloaded, or the model is thinkingrAzwaiting for stream response (zs, no chunks yet)uqStream stale for %.0fs (threshold %.0fs) — no chunks received. model=%s context=~%s tokens. Killing connection.r3rIz , context: ~z tokens). Reconnecting...stale_stream_killrstale_stream_pool_cleanupru ⚠ no output from provider for rGzstale stream detected after zs, reconnectingzLForce-closing streaming httpx client due to interrupt (not a network error).stream_interrupt_abortz+Agent interrupted during streaming API callz9Agent interrupted during streaming API call (post-worker) _current_streamed_assistant_textrGrZz, +z moreu$ ⚠ Stream stalled mid tool-call (zH); the action was not executed. Ask me to retry if you want to continue.z[Partial stream dropped tool call(s) %s after %s chars of text; surfaced warning to user: %szPartial stream delivered before error; returning length-truncated stub with %s chars of recovered content so the loop can continue from where the stream died: %srr)classify_api_errorr rI)rIrrrrLrr=r>)rWr>r=r)rWr>r=r)rWr>)=rrr_interruptible_api_callrrrQr@rrrrRrSrTr`r^r_rWr>rrrrr"rXrrrr rIrrrrrryr'r?rurDrrrrUrrrMr[r5r)r/r ragent.error_classifierrr r(rcontent_policy_blockedr _content_filter_terminated)=rNrrr_bedrock_stale_timeoutrFri_stale_elapsedr _inval_excr(r_stream_stale_timeout_base_local_defaultry_cfg _agent_cfg_vrrr_last_heartbeat_HEARTBEAT_INTERVAL_hb_now _waiting_secsrlrq _partial_text_partial_names _name_str_warn_stub_finish_reason _stub_msgrrr _cls_stubr<rrrTrr_r)rar&rrRrXrZrr1r(rrrrr'rPrQs=``` @@@@@@@@@@@@@@@@@@@@@@@r! interruptible_streaming_api_callrsx  !!LMM"%(,,Z88 ~~** '5# /00<*.E ' ~~++"T2#UO!5> #DIIK0%..)={K!=eZ!P E" G $G $R   M$ ?  jjl FF3F ))&'RSS "YY[+>s+CCN 66C"$:#Z^^Iy%I  $$8^9L8MN)~~iCDNT #5)O-o>,099;#C($E* #/?EF#w kjjl|  % %"#\] ] '? &/ ! *  )  &j!!R HF '+TM#H-#..*"5)3;NN: u~DIIK(O!#..*U 8 J6P P P d]"]"~IBIBX ,ENNEKKHJ%/"%./Le%T""U*u~~BSTYTbTbBc  5=D.8t.D'*$J*d+^^$@Ab3,/%*2YN!**M~ ^ P NN1 6jA  $'(BE$J ! 6 !$'(BE$J !$> ! O >?M 33 *5-u="6s;P7Q6RRS TI "I''%jnnWn&M%Ne$o&CCL+QP%%3M?BSTs';; 1 16zBH NNC 5w 2xl    7N8K7LM%>>'9=>?%aL)"#   ./BC*+>? u %~~!5588@[8\ $(99;OC  # #23~3F2GH"#   ! !.s>/B.C?S   % % +/ w ' LL)  ./GH++CD##PQ Q] **,h !!Z[[ g" E "A2FL"eg  "&**-A"B"HbIN IInRa&89 ~&*3s>':Q'>&?u!EEI!{#?@ "/!4" = ,,U3<"C (;$#H#HH+ $)eWi8(Y>Q$2$:dE*370  &LWoj%E" * m0+/E '^!LLCZ`$   @  &!: "#PQ Q J!V 3-2* 3s%c5d'A2d.%d>ee7e76Af5 c> d+ d&&d+. d;:d;> e  e  ee e43e47 ff ff)rrrr9rrrr)rBrr=r>)r=r)rWr>r=ru)rbrr= Optional[str])r=zDict[str, Any])rzr(r{rur=ru)rrurrrrurzOptional[float]rrurrrrurrur=r(r)r=r)rr?r=ru)robjectr=z'float | None')rr?)rr5r=r?)rr(r=r?)rr(rIr(r=r)rJr?r=ztuple[str, str, str])rJr?r=rr/)rz'FailoverReason | None'r=r)r,r5rr>r=r()r r(r=r)R__doc__ __future__rrrrrvrrrQrtypesrtypingrrrhermes_cli.timeoutsrr rr r rr agent.errorsr agent.turn_contextragent.gemini_native_adapterrrragent.message_contentragent.message_sanitizationrragent.stream_single_writerrrtools.terminal_toolrutilsrrrr getLoggerr$r^r]rr"rDrPrXrdrsr|rrrrrrrrrrrrrr9rFrKrYrrrr!r__all__r0r#r!r s #   !&&XI1)5A26U1NN   8 $#E "%2$j &"&999 9 # 9  9999 9H    #L>B<@~ 5ZpZ|@HgV%:*j4\ xx-Qd@QU{B2 r#