Sj dZddlmZmZmZddlmZmZddlm Z ddl m Z m Z m Z mZdded eed eeeffd Zdd e ded eed efd Zy)z. Scraping functionality for Firecrawl v2 API. )OptionalDictAny) ScrapeOptionsDocument)normalize_document_input) HttpClienthandle_response_errorprepare_scrape_optionsvalidate_scrape_optionsNurloptionsreturnc|r|js tdd|ji}|+t|}|t|}|r|j ||S)z Prepare a scrape request payload for v2 API. Args: url: URL to scrape options: ScrapeOptions (snake_case) to convert and include Returns: Request payload dictionary with camelCase fields zURL cannot be emptyr)strip ValueErrorr r update)rr request_data validatedoptss N/root/.hermes/venv/lib/python3.12/site-packages/firecrawl/v2/methods/scrape.py_prepare_scrape_requestr sb ciik.//$)399;#7L+G4  ))4D##D) clientc6t||}|jd|}|js t|d|j }|j dst |j dd|j di}t|}tdi|S)aJ Scrape a single URL and return the document. The v2 API returns: { success: boolean, data: Document } We surface just the Document to callers. Args: client: HTTP client instance url: URL to scrape options: Scraping options (snake_case) Returns: Document z /v2/scrapescrapesuccesserrorzUnknown error occurreddata) rpostokr jsonget Exceptionr r)rrrpayloadresponsebody document_data normalizeds rrr$s&c73G{{<1H ;;h1 ==?D 88I *BCDDHHVR(M)-8J  !j !!r)N)__doc__typingrrrtypesrrutils.normalizer utilsr r r r strrrr!rrr2sq'&+6ffx /FRVWZ\_W_R`2":"C"(=2I"U]"r