*"hjxGdZddlmZddlZddlZddlZddlmZddlm Z ddl m Z m Z ejeZdad Zd Zd Zd Zd Zd Zdd Zdd ZddZddZddZ ddZdZdZdZddZ ddZ!d dZ"d!dZ# d"dZ$y)#a Session Summarization: for each session, build a lossless structured trajectory (programmatic) and a trajectory-aware analytical summary (LLM). Attaches to each session dict: - ``_trajectory``: structured text preserving the exact step-by-step path - ``_summary``: LLM-generated analysis focusing on causal chains and insights - ``_skills_referenced``, ``_avg_prm``, ``_has_tool_errors``: metadata ) annotationsN)Any)AsyncLLMClient)compact_tool_callscompact_tool_observationsii,ct|xsdjjdd}t||kr|S|d|dzS)Nr   u…)strstripreplacelen)textlimitss *0bKxx 34:-(.BJ$&L 0 a 155#8./L>* +0: a 155#8  # #An$5q 9:+-M @ a k*0b1EAEE)R0-@G  $ $UB / 6 6w ? @ E,,-5"d# %/z0BD%Irvvj!r488F#0y1TXXk2. >bffTl(b)   W % uu[!55r2#AEE)R$8:JK DLJxj;-@T]^i]jRki 46FGAEE)R0"5 -cU3GS ?2 )'3G(G4=0 &D!$q'+G tD64&'34?5BO=FG[H[=\79`jkmos`t  !r&&vr2L%**,@ t  $ @&&%1#'>? @@ LL!$% 9~++ yY2E!E FFVWX Ls ,N3'N3c|jdg}|sytd|D}t|djdxsdt}|r t ||St ||S)aBuild a structured trajectory preserving the step-by-step path. If the session contains aggregated rollouts (turns carry ``_rollout_idx``), the trajectory is organised per-rollout with a header showing ORM score and success flag. The user prompt is shown once at the top and omitted from subsequent steps to avoid redundancy. Each step shows: skills used, tool calls with outcomes, agent response snippet, and PRM / ORM score where available. turnsz(empty session)c3BK|]}|jdduyw) _rollout_idxN)r-).0ts r z+build_session_trajectory..sHQquu^,D8Hsr prompt_textr )r-anyr _PROMPT_MAX_build_rollout_trajectory_build_flat_trajectory)sessionrQ has_rollouts first_prompts rbuild_session_trajectoryr_rsi KK $E  H%HHL%(,,}5;kJL( == !% 66rc g}t|dD]&\}}|jt||||dk((dj|S)z.Single-rollout (or non-aggregated) trajectory. show_promptr ) enumerater2 _format_stepjoin)rQr^blocksirUs rr[r[sMF%#N1 l1aAFLMN 99V rc i}|D]5}|jdd}|j|gj|7g}|r%|jd||jdt|j D]}||}|djd}|djd} |d|nd} | d | nd} d || g} | r| j| |jd d j | d t |dD]#\} }|jt|| |d%|jddj |S)z=Multi-rollout aggregated trajectory with per-rollout headers.rSrzTask: r _rollout_score_rollout_successzORM=zORM=n/azsuccess=zRollout u ═══ r)u ═══raFrbr )r-r0r2sortedkeysrfrdre)rQr^rolloutsrUidxrg rollout_idx rollout_turnsormsuccessorm_strsuc_str header_partsstep_is rrZrZsq')H /eeNA&C$++A./F |n-. bhmmo.  - A""#34"&&'9:"%/D,y*1*=HWI&2";-0':     ( 5::l#;" " >)+K &'(B~/1 O,%%*+C14 -.eeM*0b Ze*UV:a+>lB'CRLP*K &%% 128b Zi.UV:a+>lB'CRLP.K) *55*+1r -5K) * l 3q A (*K % &quu^'< J *,K ' &quu-@'AQ O /1K+ , UU= ! 'R )+K &K(_/)dkk,3!%j$G ++k "C  WW_5ggh''',/ WW_5'',/-    NQ* .s 8K.!8K3ct}g}d}|jdgD]2}|jdxsgD]c}t|tr |jddj nt |xsdj }|sS|j |e|jdxsgD]c}t|tr |jddj nt |xsdj }|sS|j |e|jd}||j||jd s1d }5||d <||d <|r!tt|t|z d nd|d<||d<y)aExtract skill references and compute aggregate metrics for a session. Attaches the following keys directly to the session dict: - ``_skills_referenced``: set of skill names explicitly read or modified by any interaction. Prompt-time injection alone is not treated as evidence that the session actually used that skill. - ``_prm_scores``: list of all non-None PRM scores - ``_avg_prm``: mean PRM (or None if no scores) - ``_has_tool_errors``: True if any interaction had tool errors FrQrzr{r r|r~NrT_skills_referenced _prm_scoresr,_avg_prm_has_tool_errors) setr-r.r/rraddr2roundsumr)r\r prm_scoreshas_tool_errorsr8itemr!rs r_extract_session_metadatar]swuF JO GR( #HH]+1r !D9CD$9O488L"-335UXY]YcacUdUjUjUlD 4  !HH./52 !D9CD$9O488L"-335UXY]YcacUdUjUjUlD 4  !hh{# ?   c " 88M ""O #%+G !'GMIS%J#j/ A1EY]GJ"1G rcKt|}dtddtj|ddg} |j |ddd {S7#t $r0}t jd |jd |Yd }~y d }~wwxYww) z7Summarize an entire session via LLM (trajectory-aware).system)roleruserF) ensure_asciiig?) max_tokens temperatureNz/[Summarizer] LLM call failed for session %s: %srr ) r_SUMMARIZE_SESSION_SYSTEMjsondumpschat Exceptionloggerwarningr-)llmr\rmessagesrAs rsummarize_sessionrs$W-G&?@DJJwU$KLHXXh6sXKKKK  = KK %   s@/B A A A B A B &B?B B  B c>t|xsdjay)z3Set the debug dump directory used by summarization.r N)rr_SUMMARIZER_DEBUG_DIR)paths rset_summarizer_debug_dirrs  O113rc ^K|sgS|D]}t|t||d<tj|Dcgc]}t ||c}ddid{}g}t ||D]S\}}t |tr(tjd|jd|d}||d<|j|Ut}|r;d dl }|j|d z } | jdd |D]}|jdd j!d d} | | dz j#|jddd| | dz j#|jdddt%|jdxsg|jd|jd|jdd} | | dz j#t'j(| dddtj+d| tj+dt-||Scc}w7ӭw)aNPreprocess and summarize all sessions in parallel. For each session: 1. Extract metadata (``_skills_referenced``, ``_avg_prm``, etc.) 2. Build programmatic ``_trajectory`` (lossless) 3. Generate ``_summary`` via LLM (trajectory-aware analysis) Returns the list of summary strings (same order as *sessions*). _trajectoryreturn_exceptionsTNz)[Summarizer] exception for session %s: %srr _summaryr summarizer)parentsexist_okr"/_z_trajectory.txtzutf-8)encodingz _summary.txtrrrr)rrrrz _meta.jsonrF)indentrz,[DebugDump] wrote summarizer artifacts to %sz#[Summarizer] summarized %d sessions)rr_asynciogatherrzipr. BaseExceptionrrr-r2rpathlibPathmkdirr write_textrlrrinfor) rsessionsr\r summariesresultsummary debug_dirrddirsidmetas rsummarize_sessions_parallelrs@  C!'*!9'!B Cnn-5 6 C # 6I F)4  g} - NN; L)  G%  g &I||I&5 4$ / G++lI6>>sCHC se?+ + 7 7 M2.  8 se<( ( 4 4 J+  5  '-W[[9M-N-TRT&U#KK 3$+KK0B$C&{{=9 D se:& & 2 2 4>  3 ! (  BDI KK5s6{C M_ 7s8H-H% H-H*GH-)rrrintreturnr)r8r/r list[str])r\r/rr)rQ list[dict]r^rrr) r8r/rrr^rrcboolrr)r\r/rzdict[str, Any])r\r/rNone)rrr\r/rr)rrrr)rrrrrr)%__doc__ __future__rrrloggingtypingrcore.llm_clientr core.utilsrr getLogger__name__rrrYrr4r5r1r3rrOr_r[rZrerrrrrrrrrrrs# ,F   8 $     7 EP74@1 111  1  1p6!"Jd!2R$4 D DDDr