Sj dZddlmZmZmZmZmZmZddlm Z m Z m Z m Z m Z mZddlmZmZddlmZmZmZmZedZded e d e fd Zd eed eed eeedffdZd e d e fdZd e d eeeffdZy)z, Search functionality for Firecrawl v2 API. )DictAnyUnionListTypeVarType) SearchRequest SearchDataDocumentSearchResultWebSearchResultNewsSearchResultImages)normalize_document_input_map_search_result_keys) HttpClienthandle_response_errorvalidate_scrape_optionsprepare_scrape_optionsTclientrequestreturnc$t|} |jd|}|jdk7r t|d|j }|j ds t|d|j dixsi}t }d|vrt|dt|_ d|vrt|dt|_ d|vrt|dt|_ |S#t$r)}t|d rtt!|d d|d }~wwxYw) a Search for documents. Args: client: HTTP client instance request: Search request Returns: SearchData with search results grouped by source type Raises: FirecrawlError: If the search operation fails z /v2/searchsearchsuccessdatawebnewsimagesresponseN)_prepare_search_requestpost status_coderjsongetr _transform_arrayr rrr rr! Exceptionhasattrgetattr)rr request_datar" response_datarouterrs N/root/.hermes/venv/lib/python3.12/site-packages/firecrawl/v2/methods/search.pyrr s"+73L;;|\:   3 & !(H 5    + !(H 5  ,2l D=&tE{ODCG T>'V 6FGCH t )$x.:LMCJ  3 # !'#z":H E sCC D&$D  Darr result_typer c g}|D]}|rt|trd|vsd|vsd|vsd|vsd|vs d|vsd|vsd|vr$|jtdit |Yd }|t k(rd }n|t k(rd }n |tk(rd }|r$t||}|j|di||j|di||j|| |S)a Transforms an array of items into a list of result_type or Document. If the item dict contains any of the special keys, it is treated as a Document. Otherwise, it is treated as result_type. If the item is not a dict, it is wrapped as result_type with url=item. markdownhtmlrawHtmllinks screenshotchangeTrackingsummaryr&Nr!r r)url) isinstancedictappendr rrrr r)r1r2resultsitemresult_type_namenormalized_items r0r(r(5s+-G2 JtT*d"$T!4$ D(T!$xI*B4*HIJ#' "44'/$ $44'-$ O3',$#&=dDT&UONN;#A#ABNN;#6#67 NN;40 192: Nc|jr|jjs td|j4|jdkr td|jdkDr td|j4|jdkr td|jdkDr td|j qhd }|j D]^}t |tr||vstd |d |t|d s6|j|vsEtd |jd ||jqhd }|jD]^}t |tr||vstd|d |t|d s6|j|vsEtd|jd ||jKt |jtr&t|jjdk(r td|jKt |jtr&t|jjdk(r td|jt|j|S)z Validate and normalize search request. Args: request: Search request to validate Returns: Validated request Raises: ValueError: If request is invalid zQuery cannot be emptyrzLimit must be positivedzLimit cannot exceed 100zTimeout must be positiveiz*Timeout cannot exceed 300000ms (5 minutes)>rr r!zInvalid source type: z. Valid types: type>pdfgithubresearchzInvalid category type: z#Location must be a non-empty stringztbs must be a non-empty string)querystrip ValueErrorlimittimeoutsourcesr=strr*rG categorieslocationlentbsscrape_optionsr)r valid_sourcessourcevalid_categoriescategorys r0_validate_search_requestr[\s[ == 3 3 5011}} ==A 56 6 ==3 67 7" ??a 78 8 ??V #IJ J"1 oo jF&#&.$'xjXhWi%jkk6*==(88$'>x}}o_]m\n%opp  q#'**C0C8H8H8N8N8P4QUV4VBC C{{'++s+s7;;3D3D3F/G1/L=> >) 6 67 NrDct|}|jdd}d|vr|j|j|d<d|vr|j|j|d<|j!|j|d<|j dd|j .t|j }|r||d<|j d dt|d d}| t|j}|r||d <|S) z Prepare a search request payload. Args: request: Search request Returns: Request payload dictionary T) exclude_noneby_aliasrNNrOignoreInvalidURLsignore_invalid_urls scrapeOptionsrV integration) r[ model_dumprNrOr`poprVrr+rQrL)rvalidated_requestr scrape_dataintegration_valueintegration_strs r0r#r#s19  ' 'TD ' IDd066B)//W !2!:!:!F+33Y ,,8$5$I$I ! &-''3,->-M-MN $/D ! !4( 1=$G$/0668 "1D  KrDN)__doc__typingrrrrrrtypesr r r r rrutils.normalizerrutilsrrrrrrr(r[rQr#r<rDr0rns98nnOff CL' ' ''R%$s)%$q'%d5JCW>X%NCmC CL)])tCH~)rD