\\n
\\n '), Document(metadata={}, page_content='\\n Wireless Noise Cancelling Headphones
\\nExperience immersive sound with active noise cancellation and long battery life.
\\n $299.99\\n \\nTop 5 AI Tools to Try in 2025
\\nArtificial intelligence continues to evolve. Here are five tools you should explore in 2025:
\\n- \\n
- LangChain \\n
- AutoGen \\n
- OpenDevin \\n
- FastRAG \\n
- GPTScript \\n
Top 5 AI Tools to Try in 2025
\\nArtificial intelligence continues to evolve. Here are five tools you should explore in 2025:
\\n- \\n
- LangChain \\n
- AutoGen \\n
- OpenDevin \\n
- FastRAG \\n
- GPTScript \\n
\\n
\\n ')]\n",
- "User Review: Amazing Performance!
\\nI’ve been using this laptop for a few months and it’s blazing fast. Great for deep learning workloads!
\\n \\n – Sarah M.\\n\\n
\\n '), Document(metadata={'relevance_score': -15.2265625}, page_content='\\n Wireless Noise Cancelling Headphones
\\nExperience immersive sound with active noise cancellation and long battery life.
\\n $299.99\\n \\nTop 5 AI Tools to Try in 2025
\\nArtificial intelligence continues to evolve. Here are five tools you should explore in 2025:
\\n- \\n
- LangChain \\n
- AutoGen \\n
- OpenDevin \\n
- FastRAG \\n
- GPTScript \\n
Top 5 AI Tools to Try in 2025
\\nArtificial intelligence continues to evolve. Here are five tools you should explore in 2025:
\\n- \\n
- LangChain \\n
- AutoGen \\n
- OpenDevin \\n
- FastRAG \\n
- GPTScript \\n
\\n
\\n ')]\n",
- "Ayeeeee\n",
- "Docs Value: [Document(metadata={'relevance_score': -11.25, 'softmax_score': 0.9546922134634852, 'minmax_score': 1.0}, page_content='\\n User Review: Amazing Performance!
\\nI’ve been using this laptop for a few months and it’s blazing fast. Great for deep learning workloads!
\\n \\n – Sarah M.\\n\\n
\\n '), Document(metadata={'relevance_score': -15.2265625, 'softmax_score': 0.017900461577508887, 'minmax_score': 0.13728813559322034}, page_content='\\n Wireless Noise Cancelling Headphones
\\nExperience immersive sound with active noise cancellation and long battery life.
\\n $299.99\\n \\nTop 5 AI Tools to Try in 2025
\\nArtificial intelligence continues to evolve. Here are five tools you should explore in 2025:
\\n- \\n
- LangChain \\n
- AutoGen \\n
- OpenDevin \\n
- FastRAG \\n
- GPTScript \\n
Top 5 AI Tools to Try in 2025
\\nArtificial intelligence continues to evolve. Here are five tools you should explore in 2025:
\\n- \\n
- LangChain \\n
- AutoGen \\n
- OpenDevin \\n
- FastRAG \\n
- GPTScript \\n
\\n
\\n ')]\n",
- "Final [Document(metadata={'relevance_score': -11.25, 'softmax_score': 0.9546922134634852, 'minmax_score': 1.0}, page_content='\\n User Review: Amazing Performance!
\\nI’ve been using this laptop for a few months and it’s blazing fast. Great for deep learning workloads!
\\n \\n – Sarah M.\\n\\n
\\n '), Document(metadata={'relevance_score': -15.2265625, 'softmax_score': 0.017900461577508887, 'minmax_score': 0.13728813559322034}, page_content='\\n Wireless Noise Cancelling Headphones
\\nExperience immersive sound with active noise cancellation and long battery life.
\\n $299.99\\n \\nTop 5 AI Tools to Try in 2025
\\nArtificial intelligence continues to evolve. Here are five tools you should explore in 2025:
\\n- \\n
- LangChain \\n
- AutoGen \\n
- OpenDevin \\n
- FastRAG \\n
- GPTScript \\n
Top 5 AI Tools to Try in 2025
\\nArtificial intelligence continues to evolve. Here are five tools you should explore in 2025:
\\n- \\n
- LangChain \\n
- AutoGen \\n
- OpenDevin \\n
- FastRAG \\n
- GPTScript \\n
\\n
\\n ')]\n"
- ]
- }
- ],
- "source": [
- "output = reranker.rerank(query=classification_prompt_template,passages=html_chunks, threshold=0)"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": null,
- "id": "b77015f3",
- "metadata": {},
- "outputs": [
- {
- "name": "stdout",
- "output_type": "stream",
- "text": [
- "page_content='\n",
- " User Review: Amazing Performance!
\\nI’ve been using this laptop for a few months and it’s blazing fast. Great for deep learning workloads!
\\n \\n – Sarah M.\\n\n",
- "
\n",
- " ' metadata={'relevance_score': -11.25, 'softmax_score': 0.9546922134634852, 'minmax_score': 1.0}\n",
- "--------------------------------------------------------------------------------\n",
- "page_content='\n",
- " Wireless Noise Cancelling Headphones
\n", - "Experience immersive sound with active noise cancellation and long battery life.
\n", - " $299.99\n", - " \n", - "Top 5 AI Tools to Try in 2025
\n", - "Artificial intelligence continues to evolve. Here are five tools you should explore in 2025:
\n", - "- \n",
- "
- LangChain \n", - "
- AutoGen \n", - "
- OpenDevin \n", - "
- FastRAG \n", - "
- GPTScript \n", - "
Top 5 AI Tools to Try in 2025
\n", - "Artificial intelligence continues to evolve. Here are five tools you should explore in 2025:
\n", - "- \n",
- "
- LangChain \n", - "
- AutoGen \n", - "
- OpenDevin \n", - "
- FastRAG \n", - "
- GPTScript \n", - "
\n",
- "
\n",
- " ' metadata={'relevance_score': -15.859375, 'softmax_score': 0.009506863381497203, 'minmax_score': 0.0}\n",
- "--------------------------------------------------------------------------------\n"
- ]
- }
- ],
- "source": [
- "for o in output:\n",
- " print(o)\n",
- " print('-'*80)"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 14,
- "id": "bb3fa1b0",
- "metadata": {},
- "outputs": [
- {
- "data": {
- "text/plain": [
- "4"
- ]
- },
- "execution_count": 14,
- "metadata": {},
- "output_type": "execute_result"
- }
- ],
- "source": [
- "len(output)"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 15,
- "id": "c1c43f7c",
- "metadata": {},
- "outputs": [],
- "source": [
- "# ai.extract(chunks=[\"the price is $1000\", \"the title is 'NVIDIA H100 SXM'\"])"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 17,
- "id": "9c78eec9",
- "metadata": {},
- "outputs": [],
- "source": [
- "pipe = Pipeline(preprocessor=pre, ai_extractor=ai, postprocessor=post)"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 18,
- "id": "0b324a01",
- "metadata": {},
- "outputs": [],
- "source": [
- "from pydantic import BaseModel, Field, constr, condecimal\n",
- "\n",
- "class ProductModel(BaseModel):\n",
- " productTitle: constr(min_length=1, max_length=200) = Field(\n",
- " ...,\n",
- " title=\"Product Title\",\n",
- " description=\"The full title of the product\"\n",
- " )\n",
- " price: condecimal(gt=0, decimal_places=2) = Field(\n",
- " ...,\n",
- " title=\"Product Price\",\n",
- " description=\"Unit price (must be > 0, two decimal places).\"\n",
- " )\n",
- " manufacturer: constr(min_length=1, max_length=1000) = Field(\n",
- " ...,\n",
- " title=\"Manufacturer\",\n",
- " description=\"Name of the product manufacturer.\"\n",
- " )\n",
- "\n",
- " "
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 19,
- "id": "92a5fc23",
- "metadata": {},
- "outputs": [],
- "source": [
- "config = {\n",
- " 'keep_tags': True,\n",
- "}"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 20,
- "id": "d2cfb033",
- "metadata": {},
- "outputs": [],
- "source": [
- "# url = \"https://www.amazon.com/Instant-Pot-Multi-Use-Programmable-Pressure/dp/B00FLYWNYQ?_encoding=UTF8&content-id=amzn1.sym.2f889ce0-246f-467a-a086-d9a721167240&dib=eyJ2IjoiMSJ9.2EzBddTDEktLY8ckTsraM_cZ6pzKuNkA6y_gLR0-Uz1ekttQU6tuQEcjb8PThy0PfhvxLqeYWh3N7pQrGgRxAWzapVklC_aU6xBzD-3Wwqx3qyQRHsmOhPRsSpeCOIIZqS3SKDowZEPYrGnCbRMt5vxnsYMW-fD-zBbgeoeGYmbsN2U6_HNhLjrpePKCbQPmnZBJ9UhgYE4fE3DVuYm8xlJe9l5GixDLVFtZUq4m5FE.Ol-jiuu9P6mQie0yXLJj-Ht5-TXmIXuRPije85p_YVo&dib_tag=se&keywords=cooker&pd_rd_r=2cede598-f3ae-49ca-8a46-e5945a9c2631&pd_rd_w=2HLSC&pd_rd_wg=ZyUUn&qid=1749508157&sr=8-3\"\n",
- "schema = ProductModel # pydantic class\n",
- "\n",
- "\n",
- "# read html file \n",
- "with open(r'C:\\Users\\abdfa\\Desktop\\UNI STUFFING\\GRADUATION PROJECT\\Group Work\\Experimental\\data\\tmp\\SWDE-Camera\\files\\camera-amazon(1767)\\0000.htm', 'r', encoding='utf-8') as file:\n",
- " content = file.read()\n",
- "\n",
- "# with open(r'C:\\Users\\abdfa\\Desktop\\UNI STUFFING\\GRADUATION PROJECT\\Group Work\\MCP_WEB2JSON\\Amazon.com_ Instant Pot Duo 7-in-1 Electric Pressure Cooker, Slow Cooker, Rice Cooker, Steamer, Sauté, Yogurt Maker, Warmer & Sterilizer, Includes App With Over 800 Recipes, Stainless Steel, 6 Quart.htm', 'r', encoding='utf-8') as file:\n",
- "# content = file.read()\n"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 18,
- "id": "f07e1aca",
- "metadata": {},
- "outputs": [],
- "source": [
- "# import os\n",
- "\n",
- "# content = \"\"\"\n",
- "# \n",
- "# \"\"\"\n",
- "\n",
- "# from web2json.ai_extractor import HFRerankerClient, LLMClassifierExtractor, NvidiaLLMClient\n",
- "\n",
- "# hf_reranker = HFRerankerClient()\n",
- "# llm_client = NvidiaLLMClient(config={\"api_key\": os.environ.get('NVIDIA_API_KEY')})\n",
- "# extractor = LLMClassifierExtractor(\n",
- "# reranker=hf_reranker,\n",
- "# llm_client=llm_client,\n",
- "# prompt_template=\"Extract from: {content} using schema: {schema}\",\n",
- "# classifier_prompt=\"What is the price?\"\n",
- "# )\n",
- "\n",
- "# # Run using HuggingFace reranker\n",
- "# result = extractor.extract(content=content, schema=schema, hf=True)\n"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 21,
- "id": "79cf2321",
- "metadata": {},
- "outputs": [],
- "source": [
- "# pipe.run(content=url,is_url=True, schema=schema, hf=False)"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 22,
- "id": "d5f9ae67",
- "metadata": {},
- "outputs": [
- {
- "data": {
- "text/plain": [
- "'\\ufeffUser Review: Amazing Performance!
\n", - "I’ve been using this laptop for a few months and it’s blazing fast. Great for deep learning workloads!
\n", - " \n", - " – Sarah M.\n", - "\\n \\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n \\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n \\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n \\n \\n \\n \\n\\n\\n\\n \\n \\n\\n \\n \\n \\n\\n \\n \\n \\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n \\n \\n \\n \\n \\n\\n\\n \\n\\n\\n \\n\\n \\n\\n\\n\\n\\n\\n\\n
\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n \\n\\n \\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n \\n\\n\\n\\n\\n
\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n
\\n\\n \\n
\\n\\n\\n\\n\\n\\n\\n
\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n
\\n\\n\\n\\n \\n \\n \\n \\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n'"
- ]
- },
- "execution_count": 22,
- "metadata": {},
- "output_type": "execute_result"
- }
- ],
- "source": [
- "content"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": null,
- "id": "371f7a17",
- "metadata": {},
- "outputs": [
- {
- "data": {
- "text/plain": [
- "tensor([0., 0., 1.])"
- ]
- },
- "execution_count": 5,
- "metadata": {},
- "output_type": "execute_result"
- }
- ],
- "source": [
- "import torch \n",
- "\n",
- "softmax_scores = [0.6 , 0.3 , 0.06 , 0.01]\n",
- "softmax_scores = torch.tensor(softmax_scores)\n",
- "softmax_scores = softmax_scores / softmax_scores.sum()\n",
- "\n",
- "# Normalize to [0, 1]\n",
- "softmax_scores = (softmax_scores - softmax_scores.min()) / (softmax_scores.max() - softmax_scores.min())\n",
- "softmax_scores"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 25,
- "id": "393134a1",
- "metadata": {},
- "outputs": [
- {
- "name": "stderr",
- "output_type": "stream",
- "text": [
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: expression(this.scrollHeight > 183?\"184px\": \"auto\") [260:7: height]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [445:3: cursor]\n",
- "ERROR\tSelector: Unexpected IDENT. [461:2: html]\n",
- "ERROR\tSelectorList: Invalid Selector: *html div.mbcTradeIn\n",
- "WARNING\tProperty: Unknown Property name. [489:9: -moz-border-radius-topright]\n",
- "WARNING\tProperty: Unknown Property name. [490:9: -moz-border-radius-bottomright]\n",
- "WARNING\tProperty: Unknown Property name. [491:9: -webkit-border-top-right-radius]\n",
- "WARNING\tProperty: Unknown Property name. [492:9: -webkit-border-bottom-right-radius]\n",
- "WARNING\tProperty: Unknown Property name. [506:9: -moz-box-shadow]\n",
- "WARNING\tProperty: Unknown Property name. [516:9: text-size]\n",
- "ERROR\tPropertyValue: No match: ('CHAR', ':', 518, 15)\n",
- "ERROR\tPropertyValue: Unknown syntax or no value: center\n",
- " cursor: pointer\n",
- "ERROR\tCSSStyleDeclaration: Syntax Error in Property: text-align: center\n",
- " cursor: pointer\n",
- "WARNING\tProperty: Unknown Property name. [577:9: -moz-border-radius-topright]\n",
- "WARNING\tProperty: Unknown Property name. [578:9: -moz-border-radius-bottomright]\n",
- "WARNING\tProperty: Unknown Property name. [579:9: -webkit-border-top-right-radius]\n",
- "WARNING\tProperty: Unknown Property name. [580:9: -webkit-border-bottom-right-radius]\n",
- "WARNING\tProperty: Unknown Property name. [606:9: filter]\n",
- "WARNING\tProperty: Unknown Property name. [615:9: filter]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: 999999 [639:3: color]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: 999999 [646:3: color]\n",
- "WARNING\tProperty: Unknown Property name. [685:3: _background-image]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [954:2: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: -moz-inline-box [1169:5: display]\n",
- "ERROR\tPropertyValue: Missing token for production Choice(ColorValue, Dimension, URIValue, Value, variable, MSValue, CSSCalc, function): ('CHAR', '?', 1787, 57)\n",
- "ERROR\tPropertyValue: Unknown syntax or no value: expression((document.body.clientWidth < 936) ? \"895px\" : \"100%\" )\n",
- "ERROR\tCSSStyleDeclaration: Syntax Error in Property: width: expression((document.body.clientWidth < 936) ? \"895px\" : \"100%\" )\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [1972:2: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: block\t [2082:16: display]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [106:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [116:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [126:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [136:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [146:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [156:5: cursor]\n",
- "WARNING\tProperty: Unknown Property name. [160:5: hight]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [162:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [166:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: -moz-inline-box [173:5: display]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: -moz-inline-box [190:28: display]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: 0 5 [237:2: background-position]\n"
- ]
- },
- {
- "name": "stdout",
- "output_type": "stream",
- "text": [
- "2\n"
- ]
- },
- {
- "name": "stderr",
- "output_type": "stream",
- "text": [
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: expression(this.scrollHeight > 183?\"184px\": \"auto\") [260:7: height]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [445:3: cursor]\n",
- "ERROR\tSelector: Unexpected IDENT. [461:2: html]\n",
- "ERROR\tSelectorList: Invalid Selector: *html div.mbcTradeIn\n",
- "WARNING\tProperty: Unknown Property name. [489:9: -moz-border-radius-topright]\n",
- "WARNING\tProperty: Unknown Property name. [490:9: -moz-border-radius-bottomright]\n",
- "WARNING\tProperty: Unknown Property name. [491:9: -webkit-border-top-right-radius]\n",
- "WARNING\tProperty: Unknown Property name. [492:9: -webkit-border-bottom-right-radius]\n",
- "WARNING\tProperty: Unknown Property name. [506:9: -moz-box-shadow]\n",
- "WARNING\tProperty: Unknown Property name. [516:9: text-size]\n",
- "ERROR\tPropertyValue: No match: ('CHAR', ':', 518, 15)\n",
- "ERROR\tPropertyValue: Unknown syntax or no value: center\n",
- " cursor: pointer\n",
- "ERROR\tCSSStyleDeclaration: Syntax Error in Property: text-align: center\n",
- " cursor: pointer\n",
- "WARNING\tProperty: Unknown Property name. [577:9: -moz-border-radius-topright]\n",
- "WARNING\tProperty: Unknown Property name. [578:9: -moz-border-radius-bottomright]\n",
- "WARNING\tProperty: Unknown Property name. [579:9: -webkit-border-top-right-radius]\n",
- "WARNING\tProperty: Unknown Property name. [580:9: -webkit-border-bottom-right-radius]\n",
- "WARNING\tProperty: Unknown Property name. [606:9: filter]\n",
- "WARNING\tProperty: Unknown Property name. [615:9: filter]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: 999999 [639:3: color]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: 999999 [646:3: color]\n",
- "WARNING\tProperty: Unknown Property name. [685:3: _background-image]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [954:2: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: -moz-inline-box [1169:5: display]\n",
- "ERROR\tPropertyValue: Missing token for production Choice(ColorValue, Dimension, URIValue, Value, variable, MSValue, CSSCalc, function): ('CHAR', '?', 1787, 57)\n",
- "ERROR\tPropertyValue: Unknown syntax or no value: expression((document.body.clientWidth < 936) ? \"895px\" : \"100%\" )\n",
- "ERROR\tCSSStyleDeclaration: Syntax Error in Property: width: expression((document.body.clientWidth < 936) ? \"895px\" : \"100%\" )\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [1972:2: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: block\t [2082:16: display]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [106:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [116:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [126:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [136:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [146:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [156:5: cursor]\n",
- "WARNING\tProperty: Unknown Property name. [160:5: hight]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [162:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS3 Basic User Interface Module\" property: hand [166:5: cursor]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: -moz-inline-box [173:5: display]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: -moz-inline-box [190:28: display]\n",
- "ERROR\tProperty: Invalid value for \"CSS Level 2.1\" property: 0 5 [237:2: background-position]\n"
- ]
- }
- ],
- "source": [
- "chunks = ai.chunk_content(content=content)"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 26,
- "id": "a51a598a",
- "metadata": {},
- "outputs": [
- {
- "data": {
- "text/plain": [
- "41"
- ]
- },
- "execution_count": 26,
- "metadata": {},
- "output_type": "execute_result"
- }
- ],
- "source": [
- "len(chunks)"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 29,
- "id": "fa31e2ff",
- "metadata": {},
- "outputs": [
- {
- "data": {
- "text/plain": [
- "['![\"\"/](\"http://g-ecx.images-amazon.com/images/G/01/gno/images/orangeBlue/navPackedSprites-US-16._V212310439_.png\"){kind=icon}
\\n![\"\"/](\"http://g-ecx.images-amazon.com/images/G/01/x-locale/common/transparent-pixel._V192234675_.gif\"){kind=tracking}
\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n \\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n
\\n\\n\\n
\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n \\n \\n\\n\\n\\n\\n\\n
\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n \\n\\n \\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n \\n\\n\\n\\n\\n
\\n‹ \\n\\n\\n\\n\\n\\nReturn to Product Overview\\n\\n
\\n\\n\\n\\n\\n\\n \\n \\n \\n \\n \\n \\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n \\n\\n\\n\\n\\n\\n\\n
\\n
\\n\\n\\n\\n\\n
\\n
\\n \\n\\n\\n\\n\\n\\n\\nProduct Features and Technical Details
\\n \\n\\n \\n\\nColor: Silver
\\n\\n\\n\\n \\n \\n \\n
\\n \\n Product Features\\n
\\n\\n
\\n \\n - \\n \\n
- 28mm wide-angle lens; 4x optical zoom and Optical Image Stabilizer \\n
- Smart AUTO mode intelligently selects from 18 predefined settings \\n
- 12.1-megapixel resolution allows you to print large size images with clarity and detail \\n
- Clear 2.7-inch PureColor System LCD \\n
- Shoot in Low Light mode for dimly-lit situations \\n \\n
\\n \\n
\\n Technical Details\\n
\\n \\n \\n
\\n \\n \\n - \\n
- Brand Name: Canon \\n
- Model: SD1300IS Silver \\n
- Optical Sensor Resolution: 12.1 MP \\n
- Optical Sensor Technology: CCD \\n
- Optical zoom: 4 x \\n
- Maximum Aperture Range: F/2.8-5.9 \\n
- Minimum focal length: 5 millimeters \\n
- Maximum focal length: 20 millimeters \\n
- Lens Type: Zoom lens \\n
- Optical Sensor Size: 1/2.3\" \\n
- Included Flash Type: Built-in flash \\n
- Display Size: 2.700 inches \\n
- Light Sensitivity: ISO 100, ISO 800, ISO 400, ISO 200, ISO 80, ISO auto, ISO 1600 \\n
- Image types: JPEG \\n
- Shooting Modes: Frame movie mode \\n
- Exposure Control Type: Beach, Kids & pets, Snow, Portrait mode, Slow shutter, Night mode, Fireworks, Low light, Snap shot, Underwater, Indoor, Foliage \\n
- Viewfinder Type: None \\n
- Width: 3.6 inches \\n
- Height: 2.2 inches \\n
- Weight: 4.9 pounds \\n\\n
\\n‹ \\n\\n\\n\\n\\n\\nReturn to Product Overview\\n\\n
\\n\\n\\n\\n\\n\\n\\n\\n\\n
\\n\\n
\\n\\n| \\n \\n \\n\\n \\n \\n \\n \\n \\n \\n \\nAlert Me \\n \\n \\n \\n\\n \\n\\n Color: Silver \\n\\n\\n\\n \\n |
![\"Sign](\"http://g-ecx.images-amazon.com/images/G/01/event-notification/buttons/sign-up-med-gold._V192575610_.gif\" "\\"Sign")
\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n
\\n
\\n ![](\"http://g-ecx.images-amazon.com/images/G/01/x-locale/communities/reputation/suggestionbox._V192249929_.gif\")
\\n
\\n\\n \\n \\n
\\n \\n\\n\\n\\n\\n\\n\\n
\\n\\n\\n\\n\\n\\n\\n\\n
\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n
\\n \\n \\n \\n \\n \\n \\n \\n \\n\\n\\n\\n\\n\\n\\n
\\n\\n
\\n\\n\\nYour Recent History
(What\\'s this?)| \\n \\n \\n After viewing product detail pages or search results, look here to find an easy way to navigate back to pages you are interested in. \\n | \\n
| \\n \\n › \\n View and edit your browsing history\\n \\n |
\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n
\\n \\n
\\n
\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n \\n\\n\\n\\n
| \\n |||||||
| \\n \\n \\n \\n \\n \\n ![\"amazon.com\"](\"http://g-ecx.images-amazon.com/images/G/01/gno/images/general/navAmazonLogoFooter._V192570482_.gif\") \\n | \\n
',\n",
- " '
',\n",
- " '
',\n",
- " '
',\n",
- " '
',\n",
- " '
',\n",
- " '
',\n",
- " '
',\n",
- " '
',\n",
- " '
\\n
\\n
\\n\\n
\\n\\x8b\\xa0\\nReturn to Product Overview\\n
Product Features and Technical Details
Color: Silver
\\n Product Features\\n
\\n
- \\n
- 28mm wide-angle lens; 4x optical zoom and Optical Image Stabilizer \\n
- Smart AUTO mode intelligently selects from 18 predefined settings \\n
- 12.1-megapixel resolution allows you to print large size images with clarity and detail \\n
- Clear 2.7-inch PureColor System LCD \\n
- Shoot in Low Light mode for dimly-lit situations \\n
\\n Technical Details\\n
\\n
- \\n
- Brand Name: Canon \\n
- Model: SD1300IS Silver \\n
- Optical Sensor Resolution: 12.1 MP \\n
- Optical Sensor Technology: CCD \\n
- Optical zoom: 4 x \\n
- Maximum Aperture Range: F/2.8-5.9 \\n
- Minimum focal length: 5 millimeters \\n
- Maximum focal length: 20 millimeters \\n
- Lens Type: Zoom lens \\n
- Optical Sensor Size: 1/2.3\" \\n
- Included Flash Type: Built-in flash \\n
- Display Size: 2.700 inches \\n
- Light Sensitivity: ISO 100, ISO 800, ISO 400, ISO 200, ISO 80, ISO auto, ISO 1600 \\n
- Image types: JPEG \\n
- Shooting Modes: Frame movie mode \\n
- Exposure Control Type: Beach, Kids & pets, Snow, Portrait mode, Slow shutter, Night mode, Fireworks, Low light, Snap shot, Underwater, Indoor, Foliage \\n
- Viewfinder Type: None \\n
- Width: 3.6 inches \\n
- Height: 2.2 inches \\n
- Weight: 4.9 pounds \\n
\\n
\\n
\\n\\n\\n\\n\\n\\n\\n\\n\\n
\\n\\n
\\nYour Recent History
\\xa0(What\\'s this?)| \\n \\n \\nAfter viewing product detail pages or search results, look here to find an easy way to navigate back to pages you are interested in. \\n | \\n
| \\n \\n › \\nView and edit your browsing history\\n \\n |
\\n
\\n | \\n
',\n",
- " '
']"
- ]
- },
- "execution_count": 29,
- "metadata": {},
- "output_type": "execute_result"
- }
- ],
- "source": [
- "chunks"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": 39,
- "id": "0fc45d52",
- "metadata": {},
- "outputs": [
- {
- "name": "stdout",
- "output_type": "stream",
- "text": [
- "Bonjour\n",
- "
'), Document(metadata={}, page_content='
'), Document(metadata={}, page_content='
'), Document(metadata={}, page_content='
'), Document(metadata={}, page_content='
'), Document(metadata={}, page_content='
'), Document(metadata={}, page_content='
'), Document(metadata={}, page_content='
'), Document(metadata={}, page_content='
'), Document(metadata={}, page_content='
\\n
\\n
\\n\\n
\\n\\x8b\\xa0\\nReturn to Product Overview\\n
Product Features and Technical Details
Color: Silver
\\n Product Features\\n
\\n
- \\n
- 28mm wide-angle lens; 4x optical zoom and Optical Image Stabilizer \\n
- Smart AUTO mode intelligently selects from 18 predefined settings \\n
- 12.1-megapixel resolution allows you to print large size images with clarity and detail \\n
- Clear 2.7-inch PureColor System LCD \\n
- Shoot in Low Light mode for dimly-lit situations \\n
\\n Technical Details\\n
\\n
- \\n
- Brand Name: Canon \\n
- Model: SD1300IS Silver \\n
- Optical Sensor Resolution: 12.1 MP \\n
- Optical Sensor Technology: CCD \\n
- Optical zoom: 4 x \\n
- Maximum Aperture Range: F/2.8-5.9 \\n
- Minimum focal length: 5 millimeters \\n
- Maximum focal length: 20 millimeters \\n
- Lens Type: Zoom lens \\n
- Optical Sensor Size: 1/2.3\" \\n
- Included Flash Type: Built-in flash \\n
- Display Size: 2.700 inches \\n
- Light Sensitivity: ISO 100, ISO 800, ISO 400, ISO 200, ISO 80, ISO auto, ISO 1600 \\n
- Image types: JPEG \\n
- Shooting Modes: Frame movie mode \\n
- Exposure Control Type: Beach, Kids & pets, Snow, Portrait mode, Slow shutter, Night mode, Fireworks, Low light, Snap shot, Underwater, Indoor, Foliage \\n
- Viewfinder Type: None \\n
- Width: 3.6 inches \\n
- Height: 2.2 inches \\n
- Weight: 4.9 pounds \\n
\\n
\\n
\\n\\n\\n\\n\\n\\n\\n\\n\\n
\\n\\n
\\nYour Recent History
\\xa0(What\\'s this?)| \\n \\n \\nAfter viewing product detail pages or search results, look here to find an easy way to navigate back to pages you are interested in. \\n | \\n
| \\n \\n › \\nView and edit your browsing history\\n \\n |
\\n
\\n | \\n
'), Document(metadata={}, page_content='
')]\n",
- "
'),\n",
- " Document(metadata={'relevance_score': -18.78125, 'softmax_score': 0.09947021388210707, 'minmax_score': 0.0}, page_content='
')]"
- ]
- },
- "execution_count": 31,
- "metadata": {},
- "output_type": "execute_result"
- }
- ],
- "source": [
- "output"
- ]
- },
- {
- "cell_type": "code",
- "execution_count": null,
- "id": "1a9e2c78",
- "metadata": {},
- "outputs": [],
- "source": []
- }
- ],
- "metadata": {
- "kernelspec": {
- "display_name": "Python 3",
- "language": "python",
- "name": "python3"
- },
- "language_info": {
- "codemirror_mode": {
- "name": "ipython",
- "version": 3
- },
- "file_extension": ".py",
- "mimetype": "text/x-python",
- "name": "python",
- "nbconvert_exporter": "python",
- "pygments_lexer": "ipython3",
- "version": "3.11.9"
- }
- },
- "nbformat": 4,
- "nbformat_minor": 5
-}