`gjXdZddlmZddlZddlZddlZddlmZmZm Z m Z ddl m Z ddl mZmZmZej"eZdZdZd Zej.d ej0Zdd Zdd ZGd de Zy)uxAI Web Search — plugin form. Routes ``web_search`` tool calls through xAI's agentic Web Search tool (server-side ``web_search`` on the Responses API). Grok runs the actual searching and page-browsing server-side; we ask it to return the top results as structured JSON so we can hand back the same ``{title, url, description, position}`` rows every other Hermes web provider produces. Reference: https://docs.x.ai/developers/tools/web-search Config keys this provider responds to:: web: search_backend: "xai" # explicit per-capability backend: "xai" # shared fallback Optional knobs (under ``web.xai`` in ``config.yaml``):: web: xai: model: "grok-build-0.1" # reasoning model required by web_search allowed_domains: ["x.ai"] # max 5 — mutually exclusive with excluded_domains excluded_domains: ["bad.com"] # max 5 — mutually exclusive with allowed_domains timeout: 90 # seconds (default 90) Auth: reuses :func:`tools.xai_http.resolve_xai_http_credentials`, which prefers Hermes-managed xAI Grok OAuth (via ``hermes auth``) and falls back to ``XAI_API_KEY`` (resolved through ``~/.hermes/.env``, then ``os.environ``). ) annotationsN)AnyDictListOptional)WebSearchProvider)has_xai_credentialshermes_xai_user_agentresolve_xai_http_credentialszgrok-build-0.1Zz \{[\s\S]*\}c. ddlm}|}t|tr|j dnd}t|tr|j dnd}t|tr|SiS#t $r"}t jd|icYd}~Sd}~wwxYw)z7Read ``web.xai`` from config.yaml (returns {} on miss).r) load_configwebNxaiz!Could not load web.xai config: %s)hermes_cli.configr isinstancedictget Exceptionloggerdebug)rcfg web_section xai_sectionexcs K/root/.hermes/venv/lib/python3.12/site-packages/plugins/web/xai/provider.py_load_xai_web_configr@s{ 1m(23(=cggen4 0:;0Mkooe,SW (d;{CC  8#> s$A$A)'A)) B2B BBct|tsgSg}|D]V}t|tr/|jr|j |jt |t k\sU|S|S)zzExecute a Grok-backed web search. Returns ``{"success": True, "data": {"web": [{title, url, description, position}, ...]}}`` on success, ``{"success": False, "error": str}`` on failure. r)is_interruptedF Interrupted)successerrorapi_keybase_urlzhttps://api.x.ai/v1/z_No xAI credentials found. Run `hermes auth` to sign in with xAI Grok OAuth, or set XAI_API_KEY.r dmodeltimeoutallowed_domainsexcluded_domainszZweb.xai.allowed_domains and web.xai.excluded_domains cannot both be set (xAI restriction).type web_searchfiltersuser)rolecontentno_inline_citations)rFinputtoolsincludezBearer zapplication/json) Authorizationz Content-Typez User-AgentNz4httpx is not installed (required for xAI web search)z0xAI web search via %s: '%s' (limit=%d, model=%s)providerz xai-oauthz /responses)headersjsonrGizQxAI web search got 401 on first attempt; forcing OAuth refresh and retrying once.T) force_refresh api_key_hintrTz1xAI web search OAuth refresh after 401 failed: %si,zxAI web search HTTP %d: %szxAI web search returned HTTP z: z xAI web search request error: %szCould not reach xAI: z#xAI web search produced no responsezxAI web search bad JSON: %sz/Could not parse xAI Responses API reply as JSONr?messagecodez unknown errorz*xAI web search returned error envelope: %szxAI returned an error: limitr)r>data)%tools.interruptr<rr r!rr"rstripint TypeError ValueErrormaxminrr DEFAULT_MODELfloatDEFAULT_TIMEOUTr) _build_promptr httpx ImportErrorrinforangepostraise_for_statusHTTPStatusErrorresponse status_codewarningtext RequestErrorrXr_extract_results)r0queryr^r<credsr@rBrrFrGallowedexcludedweb_search_toolpromptpayloadrWrk is_oauth_pathrespattemptrstatus refreshed refreshed_key refresh_excbodyr_ api_errorerr_msg web_resultss rsearchzXAIWebSearchProvider.searchsG   6#(=AA -.eii *0b1779uyy,E0EFLLNUUVYZ :  JEAs5#'"$$.swww/?$E = . &CGGI?@G&cgg.?&@A&sww/A'BC x!< ,2<*@ *;W)EOI & * eUE :.+= Qx. RG- Rzzj +# # " %%'. R` <$/TU U 99;D*4D$)?DHHW%T i & i(#==(#"  NNG Q$1H /RS S++D+>  $eR[9 9%)=>>g   *:& E :& &%G &R  O  D((! 58\\5M11STS=W\mKK5$@*.)0% ),IMM),D,J(K(Q(Q(S (]g-E&3G9@ 7JGO4$%O' 69ll6N3<<,,Tc2TVD D;VTJ$ J  sK  KK5,L.(L%!R* KKK21K25L LL"!L"%R'5AQ+;A O  Q+ O5O0+Q+0O55Q+;'P#"Q+# P1.Q+0P112Q+#R'+R'=R"R'"R'* S3S SScd|d|S)a7Compose the prompt that asks Grok to act as a search engine. We deliberately ask for a JSON object (not bare array) so we can match it cheaply with ``_JSON_BLOCK_RE``; we explicitly forbid prose, markdown fences, and inline-citation links to keep the payload parseable. u<Use the web_search tool to find current information for the query below, then respond with ONLY a single JSON object — no prose, no markdown fences, no inline citation links — matching this exact schema: {"results": [{"title": "string", "url": "string", "description": "1-2 sentence summary"}]} Return at most zy results, ordered by relevance, with absolute https:// URLs. If no usable results exist, return {"results": []}. Query: r.)rxr^s rrjz"XAIWebSearchProvider._build_promptVs$  $W%W  r*c |j|\}}|D]}|j||}|s|cS|r)dj|}|j|||}|r|S|j dxsg} t | t rRt| d|D cgc]8\} } t | tr#| jrdt| d| dzd:c} } SgScc} } w)u<Pull a ``[{title, url, description, position}, ...]`` list out of a Responses-API reply. Strategy: 1. Walk ``output[*].content[*].text`` for ``output_text`` blocks and try to parse the first JSON object that has a ``results`` list. 2. If the JSON path fails, fall back to the message annotations (``url_citation`` entries) — every annotation carries a URL and a ``title`` (citation number); we pair those URLs with surrounding text from the message body as a best-effort description. r] citationsNrArDtitleurl descriptionposition) _collect_output_text_try_parse_json_resultsjoin_results_from_annotationsrrr enumerater!r") cls response_datar^ text_blocksrblockparsed joined_textannotation_resultsrius rrwz%XAIWebSearchProvider._extract_resultsks&$'#;#;M#J [! E00e0DF   ))K0K!$!>!>["?" "))"%%k28b i &&i&78 Aqa%!'')  q6#% !A     s=Ccpg}g}|jd}t|ts||fS|D]}t|tr|jddk7r)|jd}t|tsK|D]}t|tr|jddk7r(|jd}t|tr!|j r|j ||jd}t|ts|D]%} t| ts|j | '||fS)zEReturn (text_blocks, annotations) extracted from ``response.output``.outputrJr[rO output_textrur)rrr rr!r"r#) rrrrr(rOchunkruchunk_annotationsanns rrz)XAIWebSearchProvider._collect_output_texts$ "$ ,. ""8,&$' + + 4DdD)TXXf-=-Jhhy)Ggt, 4!%.%))F2C}2Tyy(dC(TZZ\&&t,$)IIm$<!/604%c40.K..s34 4  4"K''r*c |g}tj|}|r4|jd|k7r |j|jd|D] } t j |}t|ts+|jd}t|tsMg}|d|D]}t|tst|jddj} | s@|jt|jddj| t|jddjt|dzd |s |cSy#tj tf$rY,wxYw) aRParse a JSON object with a ``results`` array out of ``text``. Returns the normalized result list on success, ``None`` when the block has no valid JSON object or no ``results`` key. Tolerates leading/trailing prose because reasoning models sometimes prefix a short narration even when told not to. rresultsNrrArrrDr)_JSON_BLOCK_RErgroupr#rXloadsJSONDecodeErrorrdrrrr r!r"r$) rur^ candidatesmatch candidaterr normalizedrowrs rrz,XAIWebSearchProvider._try_parse_json_resultsseV %%d+ U[[^t+   ekk!n -# "I I.fd+jj+Ggt,/1Jv !#t,#''%,-335!!!$SWWWb%9!:!@!@!B"'*377="+E'F'L'L'N%( Oa$7   "!!; "<7((*5  sE!!E>=E>c t}g}|D]0}|jddk7rt|jddj}|r||vrI|j |d}|jd}|jd} t |t rpt | t r`d|cxkr| cxkrt|krFnnCtd|dz } || |j}t|dkDr|d d j}|jd||t|d zd t||k\s0|S|S) a Best-effort fallback when JSON parsing fails. Uses each ``url_citation`` annotation's ``url`` (the citation title is just the integer label, so we don't surface it) and slices ~200 characters of surrounding text as the description. rJ url_citationrrA start_index end_indexri8NrDr) setrr!r"addrrbr$rer#) rrr^seenrrrrstartend window_starts rrz.XAIWebSearchProvider._results_from_annotationss>(* Cwwv.0cggeR()//1C#+ HHSMKGGM*E''+&C%%*S#*>1CgPSCgWZ[fWgCg"1eck2 ),u=CCE {#c)"-de"4":":"rs@#  ,,7   8 $  NBLL9  $P ,P r*