`gjpUdZddlmZddlZddlZddlZddlZddlZddlZddl m Z ddl m Z m Z mZmZmZddlZddlmZmZmZej,eZdZdZd ZeZd Zd Zd Zd Z dZ!dZ"hdZ#dd hZ$dZ%ddddddgddddddgddZ&de'd<d d!hZ(dFd"Z)dGd#Z*dHd$Z+dId%Z,dJd&Z-dKd'Z. dLd(Z/dJd)Z0 dMd*Z1 dNd+Z2d,d-ed. dOd/Z3 dPd0Z4d1d2 dQd3Z5 dRd4Z6Gd5d6eZ7dSd7Z8 dTd8Z9dd9 dUd:Z:ddd; dVd<Z; dWd=Z< dTd>Z= dXd?Z> dUd@Z? dVdAZ@dYdBZAddC dZdDZBd[dEZCy)\uRxAI Grok-Imagine video generation backend. Surface: text-to-video, image-to-video, and reference-to-video through the unified video provider. xAI edit/extend are exposed through separate tools. Originally salvaged from PR #10600 by @Jaaneek; reshaped into the :class:`VideoGenProvider` plugin interface and trimmed to the generate-only surface. Authentication: xAI Grok OAuth tokens (preferred — billed against the user's SuperGrok or X Premium+ subscription) or ``XAI_API_KEY``. Both routes are resolved through ``tools.xai_http.resolve_xai_http_credentials`` so a single login covers chat + TTS + image gen + video gen + transcription. When xAI storage is enabled, the primary ``video`` / ``public_url`` fields are the stored files-cdn HTTPS link. Pass that public MP4 URL as ``video_url`` for edit/extend; it is sent to xAI as ``video.url``. ) annotationsN)Path)AnyDictListOptionalTuple)VideoGenProvidererror_responsesuccess_responsezhttps://api.x.ai/v1grok-imagine-videogrok-imagine-video-1.516:9720p>1:12:33:23:44:39:16r480pzGrok Imagine Videoz~60-240sz.Text-to-video; legacy image-to-video fallback.z:see https://docs.x.ai/developers/models/grok-imagine-videotextimage)displayspeed strengthsprice modalitieszGrok Imagine Video 1.5z Latest xAI image-to-video model.z(see https://docs.x.ai/developers/pricing)r rzDict[str, Dict[str, Any]]_MODELSzgrok-imagine-video-1.5-previewz!grok-imagine-video-1.5-2026-05-30c ddlm}|xsi}t |j dxstjddj}t |j dxstjd xstjjd }||fS#t$r"}tj d|i}Yd}~d}~wwxYw) u/Return ``(api_key, base_url)`` from the shared xAI credential resolver. Order: runtime provider (xai-oauth pool entry) → singleton ``auth.json`` OAuth tokens → ``XAI_API_KEY`` env var. ``api_key`` is empty when no credential source is available; callers must check before using it. r)resolve_xai_http_credentialsz"xAI credential resolver failed: %sNapi_key XAI_API_KEYbase_url XAI_BASE_URL/) tools.xai_httpr& ExceptionloggerdebugstrgetosgetenvstripDEFAULT_XAI_BASE_URLrstrip)r&credsexcr'r*s Q/root/.hermes/venv/lib/python3.12/site-packages/plugins/video_gen/xai/__init__.py_resolve_xai_credentialsr;Ys?,.4" %))I&F"))M2*FGMMOG * 99^ $  egffSk  H   93?sB-- C6CCc< ddlm}|S#t$rYywxYw)Nrhermes_xai_user_agentzhermes-agent/video_gen)r-r>r.r=s r:_xai_user_agentr?qs%(8$&& ('(s  c$d|dtdS)NzBearer zapplication/json) Authorizationz Content-Typez User-Agent)r?)r's r: _xai_headersrBzs"7),*%' cz ddlm}||y#t$r }tj d|Yd}~yd}~wwxYw)ahRefuse to read a local media path that Hermes' read deny-list blocks. Thin wrapper over the shared ``agent.file_safety.raise_if_read_blocked`` chokepoint so xAI video inputs enforce the same credential-store guard as the image providers. Fails open if the guard machinery is unavailable (defense-in-depth, per the denylist's own framing). r)raise_if_read_blockedz*xAI media input read guard unavailable: %sN)agent.file_safetyrEr.r/r0)refrEr9s r:_raise_if_blocked_local_inputrHs8;#  A3Gs :5:c|xsdj}|sy|j}|jdr|St|j }|j s|St |tj|jdxsd}|jds|Stj|jjd}d|d|S) z7Return a URL/data URI accepted by xAI for image inputs.r)http://https://z data:image/rzapplication/octet-streamzimage/asciidata:;base64,r5lower startswithr expanduseris_filerH mimetypes guess_typenamebase64 b64encode read_bytesdecodevaluerGrQpathmimeencodeds r:_image_ref_to_xai_urlras ;B   C  IIKE >? 9   !D <<> !#&    *1 - K1KD ??8 $ t0188AG 4& **rCcjt|}|sy|j}|jdrd|iSy)NrJurl)rarQrR)r]rGrQs r:_image_ref_to_xai_inputrds9  &C  IIKE >?s| rCcvt|jdtr|jdni}|xsi}|jd}t|tr|j nd}|jd}t|tr|j nd}|xs|xsd}|r |r||k7r|nd}|||fS)aReturn ``(public_video_url, temporary_url, stored_public_url)``. ``public_video_url`` is the stored files-cdn HTTPS MP4 (``public_url``) when storage is enabled; otherwise xAI's temporary ``video.url``. Pass this value as ``video_url`` for edit/extend chaining. file_output public_urlNrcr)) isinstancer2dictr1r5)videorf stored_public temporarypublic_video_url temporary_outs r:_xai_video_output_urlsros/9=9QSW.X%))M*^`K#KOOL1M-7 s-KM'')QUM % I%/ 3%? !TI$7 7R 9 +E   ]M 99rCc|xsdj}|sy|j}|jdr|St|j }|j s|St |tj|jdxsd}|jds|Stj|jjd}d|d|S) z7Return a URL/data URI accepted by xAI for video inputs.r))rKrLz data:video/rz video/mp4zvideo/rMrNrOrPr\s r:_video_ref_to_xai_urlrqs ;B   C  IIKE >? 9   !D <<> !#&    *1 - <D ??8 $ t0188AG 4& **rCcK|xsdj}|syt|j}|jrt |}|rd|iSdS|j }|j dsyd|iSw)zHBuild xAI ``video`` input using a public HTTPS URL (``url`` field only).r)Nrc)rKrL)r5rrSrTrqrQrR)r]r'r*rGr^data_refrQs r:_video_input_from_public_urlrts~ ;B   C  9   !D ||~(-$,x 6$6 IIKE   3 4 3<sA:A<cg}|xsgD]9}|xsdj}|st|}|sy|j|;|r|dfSddfS)Nr))Nzwreference_image_urls must be public HTTPS URLs or data URIs (e.g. the `image`/`public_url` from a prior Imagine result))r5rdappend)reference_image_urlsrefsrccleaned normalizeds r:_normalize_reference_imagesr{sn"$D#)r  9"##% ,W5  J  DT ))dT ))rCF)has_reference_images max_secondsdefaultc@||n|}|dkrd}||kDr|}|r|dkDrd}|S)N )durationr}r~rr]s r:_clamp_durationr s<!,H'E qy {  LrCc|xsdj}|r|r|S|dk(rtS|tk(s|tvrtS|xstS)a+Select xAI's text/video model without treating config as a prompt override. ``grok-imagine-video-1.5`` currently rejects text-only video generation, but it is the desired image-to-video backend. Explicit tool ``model=`` still wins for users who intentionally request another model. r)r)r5DEFAULT_IMAGE_TO_VIDEO_MODEL _IMAGE_TO_VIDEO_COMPAT_MODEL_IDSDEFAULT_TEXT_TO_VIDEO_MODEL)modelmodalityexplicit_model requesteds r:_resolve_model_for_modalityrsR"##%I)7++00IAa4a**  333rC generations)endpointc &K|j|d|it|dttji|dd{}|j |j }|jd}|s td|S7Dw)zAPOST to one of xAI's async video endpoints and return request_id./videos/zx-idempotency-key<)headersjsontimeoutN request_idz-xAI video response did not include request_id) postrBr1uuiduuid4raise_for_statusrr2 RuntimeError)clientpayloadr'r*rresponsebodyrs r:_submitr2s[[ *HXJ'Q<(Q*=s4::errorfailedexpired cancelledr)r2rBrrrQasynciosleep) rrr'r*timeout_seconds poll_intervalelapsed last_statusrrs r:_pollrIsGK O #j - )$   !!#}}xx)/R668 & $d3 3 E E)48 8mmM***= ! O #$ (K)@ AA#  +s(/B?B;A2B?$B=%B?4B?=B?c eZdZdZed dZed dZd dZddZddZ ddZ ddZ d d d d e e d d d d dd Zy )XAIVideoGenProviderzxAI Grok Imagine video backend.cy)Nxairselfs r:rWzXAIVideoGenProvider.nameqrCcy)NxAIrrs r: display_namez XAIVideoGenProvider.display_nameurrCc2t\}}t|SNr;bool)rr'_s r: is_availablez XAIVideoGenProvider.is_availableys-/ G}rCcdtjDcgc] \}}d|i| c}}Scc}}w)Nid)r$items)rmidmetas r: list_modelszXAIVideoGenProvider.list_models}s*5<]]_E Ts#d#EEEs,ctSr) DEFAULT_MODELrs r: default_modelz!XAIVideoGenProvider.default_modelsrCcj ddlm}|d}d}|r|d|z }dd|gd d S#t$rd}Y!wxYw) Nr)xai_storage_notice_text video_genr)zgrok-imagine-video for text/reference; grok-imagine-video-1.5 for image-to-video; edit/extend: pass the stored public HTTPS MP4 (`video` / `public_url` from a prior Imagine result); uses xAI Grok OAuth or XAI_API_KEYz. zxAI Grok Imaginepaidxai_grok)rWbadgetagenv_vars post_setup)r-rr.)rrstorage_noticers r:get_setup_schemaz$XAIVideoGenProvider.get_setup_schemasd >4[AN    R'( (C&$    N s $ 22c XddgttttddddtdS)Nrrr|rF)r# aspect_ratios resolutions max_duration min_durationsupports_audiosupports_negative_promptmax_reference_images)sortedVALID_ASPECT_RATIOSVALID_RESOLUTIONSMAX_REFERENCE_IMAGESrs r: capabilitiesz XAIVideoGenProvider.capabilitiess5!7+#$78!"34#(-$8  rCN) r image_urlrwr aspect_ratio resolutionnegative_promptaudioseedc Xt||t| jd|||||S)N_model_override_explicitpromptrrrrwrrr)run_xai_video_generationrr2) rrrrrwrrrrrrkwargss r:generatezXAIVideoGenProvider.generates8( +E FG!5%!  rCreturnr1rr)rzList[Dict[str, Any]])r Optional[str])rDict[str, Any])rr1rrrrrwOptional[List[str]]r Optional[int]rr1rr1rrrzOptional[bool]rrrrrr)__name__ __module__ __qualname____doc__propertyrWrrrrrrDEFAULT_ASPECT_RATIODEFAULT_RESOLUTIONrrrCr:rrns) F <  $#'48"&0,)- $"    !  2      '      rCrc2t\}}t|Srr)r'rs r:has_xai_video_credentialsrs)+JGQ =rCc Dtt||||||||d|||S)Nr generationoperation_labelrrr)_run_xai_video_coroutine_generate_xai_video_asyncrs r:rrs? $!)!5%! %! rC)rcBtt|||d||tS)Nr video_urlreditr)r_edit_xai_video_asyncrrs r:run_xai_video_editr s) $VyN)  rC)rrcDtt||||d||tS)Nrrrrextendr)r_extend_xai_video_asyncrr s r:run_xai_video_extendrs3 $  !)  rCc 6 tj} |j||jS#|jwxYw#t$rB}t j d||dtd|d|dd|xst||cYd}~Sd}~wwxYw) Nz#xAI video %s unexpected failure: %sT)exc_infoz xAI video z failed: api_errorr)r error_typeproviderrrr) rnew_event_looprun_until_completecloser.r/warningr r)cororrrrloopr9s r:rrs %%' **40 JJLDJJL   "(=%     s1A 8A A  A B7B BBc |Kt\}} |s t|S|xsdj}d} |xsdjrt|} | st ddd|S|xst j} |xst jj} t|\} }|rt |dd|S|st ddd|S| r)t| tkDrt d td d d|S| r| rt d d d|S| tvrt } | tvrt } | rdn| rdnd}t|||}| r+|tk7r"|rt dtd|dd||St}t|t!| }|||| | d}| r| |d<| r| |d<t#|| d||||| |d|  d{S7w)Nr)zlimage_url must be a public HTTPS URL or data URI (e.g. the `image`/`public_url` from a prior Imagine result)invalid_image_urlrrrrrinvalid_reference_image_urlsz+prompt is required for xAI video generationmissing_promptz&reference_image_urls supports at most z images on xAItoo_many_referencesz  %"#KOOI$>?!  ",E,  &4E" # "3E,  %2E/ "  2+%!,S!1E#J 2 88G !']E'N"((7#5~%YYz*6h  BCZB[[\]      '2  $")))4 = 88I  = 26(! < &?  M ) %( ) $$ F **4C0  !+CLL,D,D+ESSVX&$      )    sL%I LI$ L K<I*!I'"I*&K<K6K< LK9C,LC L I!L I!!L'I**K3=K.JK. J&#K.%J&&0K.K3K< L'K*(L.K33K<9L<LL L Lc6|jty)uFPlugin entry point — wire ``XAIVideoGenProvider`` into the registry.N)register_video_gen_providerr)ctxs r:registerres##$7$9:rC)rzTuple[str, str]r)r'r1rzDict[str, str])rGr1rNone)r]r1rr1)r]r1rOptional[Dict[str, str]])rjrrz(Tuple[str, Optional[str], Optional[str]])r]r1r'r1r*r1rrg)rwrrz4Tuple[Optional[List[Dict[str, str]]], Optional[str]]) rrr}rr~intrrhrrh)rrrr1rrrr1) rhttpx.AsyncClientrrr'r1r*r1rr1rr1)rrirr1r'r1r*r1rrhrrhrrr)rr1rrrrrrrwrrrrr1rr1rr)rr1rr1rrrr) rr1rr1rrrrrr) rr1rrrr1rr1rr)rr1rr1rrrr1r)r1rrhrr)rr1rr)r'r1r*r1rr1rrrr1r(r1rr1rr1rrhr)r1rrrr)rrf)Dr __future__rrrXloggingrUr3rpathlibrtypingrrrrr rWagent.video_gen_providerr r r getLoggerrr/r6rrrr;rrr[r\r=rrrr$__annotations__rr;r?rBrHrardrorqrtr{rrrrrrrr rrrr7r rr*r,rerrCr:rqs'$#  33    8 $-27+  !IV$ (EMw' ,7;i & "$%'$ 0(  +.: :-:0+.    .*-*9**"'#      "4 44 4  48"         .B BB B  B  BBBJW *W t       . B        &#       *          4m m m m  m . mmmmm`> >>  >  >  >>>B               , 0!%H HH H  H  HHHHHHHH`;rC