Sj ddlmZmZmZmZmZmZddlmZm Z m Z m Z m Z m Z ddlmZddlmZddlmZddlmZmZedZd ed ed e fd Zd eedeed eeee ffdZd ed efdZd ed eeeffdZy))DictAnyUnionListTypeVarType) SearchRequest SearchDataDocumentSearchResultWebSearchResultNewsSearchResultImages)AsyncHttpClient)handle_response_error)normalize_document_input)validate_scrape_optionsprepare_scrape_optionsTclientrequestreturnc@Kt|} |jd|d{}|jdk7r t|d|j }|j ds t|d|j dixsi}t }d|vrt|dt|_ d|vrt|dt|_ d |vrt|d t|_ |S7#t$r)}t|d rtt!|d d|d}~wwxYww) a  Async search for documents. Args: client: Async HTTP client instance request: Search request Returns: SearchData with search results grouped by source type Raises: FirecrawlError: If the search operation fails z /v2/searchNsearchsuccessdatawebnewsimagesresponse)_prepare_search_requestpost status_coderjsongetr _transform_arrayr rrrrr Exceptionhasattrgetattr)rr request_datar! response_datarouterrs R/root/.hermes/venv/lib/python3.12/site-packages/firecrawl/v2/methods/aio/search.pyrrs "+73L\<@@   3 & !(H 5    + !(H 5  ,2l D=&tE{ODCG T>'V 6FGCH t )$x.:LMCJ A  3 # !'#z":H E s9 DC)C'CC)&D'C)) D2$DDDarr result_typec $g}|D]}|rlt|tr\d|vsd|vsd|vsd|vsd|vs d|vsd|vsd|vr$|jtd it |Y|j|d i|q|j|| |S) a Transforms an array of items into a list of result_type or Document. If the item dict contains any of the special keys, it is treated as a Document. Otherwise, it is treated as result_type. If the item is not a dict, it is wrapped as result_type with url=item. markdownhtmlrawHtmllinks screenshotchangeTrackingsummaryr%)url) isinstancedictappendr r)r0r1resultsitems r/r'r'8s)+G2 JtT*d"$T!4$ D(T!$xI*B4*HIJ{2T23 NN;40 1!2" Nc|jr|jjs td|j4|jdkr td|jdkDr td|j4|jdkr td|jdkDr td|j qhd }|j D]^}t |tr||vstd |d |t|d s6|j|vsEtd |jd ||jKt |jtr&t|jjdk(r td |jKt |jtr&t|jjdk(r td|jt|j|S)z Validate and normalize search request. Args: request: Search request to validate Returns: Validated request Raises: ValueError: If request is invalid zQuery cannot be emptyrzLimit must be positivedzLimit cannot exceed 100zTimeout must be positiveiz*Timeout cannot exceed 300000ms (5 minutes)>rrr zInvalid source type: z. Valid types: typez#Location must be a non-empty stringztbs must be a non-empty string)querystrip ValueErrorlimittimeoutsourcesr<strr)rDlocationlentbsscrape_optionsr)r valid_sourcessources r/_validate_search_requestrRSs == 3 3 5011}} ==A 56 6 ==3 67 7" ??a 78 8 ??V #IJ J"1 oo jF&#&.$' >) 6 67 NrAc(t|}|jdd}d|vr|j|j|d<d|vr|j|j|d<|j!|j|d<|j dd|j .t|j }|r||d<|j d dt|d dx}?t|jr&t|jj|d <|S) z Prepare a search request payload. Args: request: Search request Returns: Request payload dictionary T) exclude_noneby_aliasrHNrIignoreInvalidURLsignore_invalid_urls scrapeOptionsrO integration) rR model_dumprHrIrWpoprOrr*rKrFrY)rvalidated_requestr scrape_datavs r/r"r"s19  ' 'TD ' IDd066B)//W !2!:!:!F+33Y,,8$5$I$I ! &-''3,->-M-MN $/D ! !4( & t <<IcRSflln!"3"?"?@FFH] KrAN)typingrrrrrrtypesr r r r rrutils.http_client_asyncrutils.error_handlerrutils.normalizerutils.validationrrrrr'rRrKr"r;rAr/res88787O CL% % %%N$s)$q'd5HCU>V61m1 1f]tCH~rA