{"cells": [{"attachments": {}, "cell_type": "markdown", "id": "fa593487", "metadata": {}, "source": ["\"在\n"]}, {"attachments": {}, "cell_type": "markdown", "id": "034e355d-83a0-4bd2-877e-0f493c5f713d", "metadata": {}, "source": ["# OpenAI代理工具描述过长的解决方法\n", "在这个演示中，我们将演示一种解决方案，用于定义一个OpenAI工具，其描述超过OpenAI当前的1024个字符的限制。\n", "为简单起见，我们将在`QueryPlanTool`笔记本示例的基础上进行演示。\n"]}, {"attachments": {}, "cell_type": "markdown", "id": "dc72e6f9", "metadata": {}, "source": ["如果您在colab上打开这个笔记本，您可能需要安装LlamaIndex 🦙。\n"]}, {"cell_type": "code", "execution_count": null, "id": "32a42109", "metadata": {}, "outputs": [], "source": ["%pip install llama-index-agent-openai\n", "%pip install llama-index-llms-openai"]}, {"cell_type": "code", "execution_count": null, "id": "4df080d3", "metadata": {}, "outputs": [], "source": ["!pip install llama-index"]}, {"cell_type": "code", "execution_count": null, "id": "c225e522-1ebd-436f-9c47-8738eb513880", "metadata": {}, "outputs": [], "source": ["%load_ext autoreload\n", "%autoreload 2"]}, {"cell_type": "code", "execution_count": null, "id": "1c1e705a-36f2-4272-8f98-7f3785e76e8c", "metadata": {}, "outputs": [], "source": ["from llama_index.core import SimpleDirectoryReader, VectorStoreIndex\n", "from llama_index.llms.openai import OpenAI"]}, {"cell_type": "code", "execution_count": null, "id": "35364259-f1c3-4df0-b8c9-79e0afca7436", "metadata": {}, "outputs": [], "source": ["llm = OpenAI(temperature=0, model=\"gpt-4\")"]}, {"attachments": {}, "cell_type": "markdown", "id": "26f545cd", "metadata": {}, "source": ["## 下载数据\n"]}, {"cell_type": "code", "execution_count": null, "id": "e6385d12", "metadata": {}, "outputs": [{"name": "stdout", "output_type": "stream", "text": ["--2024-05-23 13:36:24-- https://raw.githubusercontent.com/run-llama/llama_index/main/docs/docs/examples/data/10q/uber_10q_march_2022.pdf\n", "Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.108.133, 185.199.110.133, 185.199.109.133, ...\n", "Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.108.133|:443... connected.\n", "HTTP request sent, awaiting response... 200 OK\n", "Length: 1260185 (1.2M) [application/octet-stream]\n", "Saving to: ‘data/10q/uber_10q_march_2022.pdf’\n", "\n", "data/10q/uber_10q_m 100%[===================>] 1.20M --.-KB/s in 0.04s \n", "\n", "2024-05-23 13:36:24 (29.0 MB/s) - ‘data/10q/uber_10q_march_2022.pdf’ saved [1260185/1260185]\n", "\n", "--2024-05-23 13:36:24-- https://raw.githubusercontent.com/run-llama/llama_index/main/docs/docs/examples/data/10q/uber_10q_june_2022.pdf\n", "Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.108.133, 185.199.110.133, 185.199.109.133, ...\n", "Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.108.133|:443... connected.\n", "HTTP request sent, awaiting response... 200 OK\n", "Length: 1238483 (1.2M) [application/octet-stream]\n", "Saving to: ‘data/10q/uber_10q_june_2022.pdf’\n", "\n", "data/10q/uber_10q_j 100%[===================>] 1.18M --.-KB/s in 0.04s \n", "\n", "2024-05-23 13:36:24 (26.4 MB/s) - ‘data/10q/uber_10q_june_2022.pdf’ saved [1238483/1238483]\n", "\n", "--2024-05-23 13:36:24-- https://raw.githubusercontent.com/run-llama/llama_index/main/docs/docs/examples/data/10q/uber_10q_sept_2022.pdf\n", "Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.108.133, 185.199.110.133, 185.199.109.133, ...\n", "Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.108.133|:443... connected.\n", "HTTP request sent, awaiting response... 200 OK\n", "Length: 1178622 (1.1M) [application/octet-stream]\n", "Saving to: ‘data/10q/uber_10q_sept_2022.pdf’\n", "\n", "data/10q/uber_10q_s 100%[===================>] 1.12M --.-KB/s in 0.05s \n", "\n", "2024-05-23 13:36:25 (22.7 MB/s) - ‘data/10q/uber_10q_sept_2022.pdf’ saved [1178622/1178622]\n", "\n"]}], "source": ["!mkdir -p 'data/10q/'\n", "!wget 'https://raw.githubusercontent.com/run-llama/llama_index/main/docs/docs/examples/data/10q/uber_10q_march_2022.pdf' -O 'data/10q/uber_10q_march_2022.pdf'\n", "!wget 'https://raw.githubusercontent.com/run-llama/llama_index/main/docs/docs/examples/data/10q/uber_10q_june_2022.pdf' -O 'data/10q/uber_10q_june_2022.pdf'\n", "!wget 'https://raw.githubusercontent.com/run-llama/llama_index/main/docs/docs/examples/data/10q/uber_10q_sept_2022.pdf' -O 'data/10q/uber_10q_sept_2022.pdf'"]}, {"attachments": {}, "cell_type": "markdown", "id": "e7113434-0e41-46b6-a74e-284ce211fd38", "metadata": {}, "source": ["## 加载数据\n"]}, {"cell_type": "code", "execution_count": null, "id": "d036819a-754e-460b-8734-8af7071287e5", "metadata": {}, "outputs": [], "source": ["march_2022 = SimpleDirectoryReader(\n", " input_files=[\"./data/10q/uber_10q_march_2022.pdf\"]\n", ").load_data()\n", "june_2022 = SimpleDirectoryReader(\n", " input_files=[\"./data/10q/uber_10q_june_2022.pdf\"]\n", ").load_data()\n", "sept_2022 = SimpleDirectoryReader(\n", " input_files=[\"./data/10q/uber_10q_sept_2022.pdf\"]\n", ").load_data()"]}, {"attachments": {}, "cell_type": "markdown", "id": "fd541b68-c67f-4cbf-b579-5437d48e5b8f", "metadata": {}, "source": ["## 构建索引\n", "\n", "我们在每个文档（3月、6月、9月）上构建一个向量索引/查询引擎。\n"]}, {"cell_type": "code", "execution_count": null, "id": "4e6c3178-6aab-4fdc-99f6-c820661e7a73", "metadata": {}, "outputs": [], "source": ["march_index = VectorStoreIndex.from_documents(march_2022)\n", "june_index = VectorStoreIndex.from_documents(june_2022)\n", "sept_index = VectorStoreIndex.from_documents(sept_2022)"]}, {"cell_type": "code", "execution_count": null, "id": "3af29f86-9a18-4b8e-af38-8ddc24b550e8", "metadata": {}, "outputs": [], "source": ["march_engine = march_index.as_query_engine(similarity_top_k=3, llm=llm)\n", "june_engine = june_index.as_query_engine(similarity_top_k=3, llm=llm)\n", "sept_engine = sept_index.as_query_engine(similarity_top_k=3, llm=llm)"]}, {"attachments": {}, "cell_type": "markdown", "id": "2d6471ed-5645-4bb0-b8db-1b964ff7cd23", "metadata": {}, "source": ["## 定义过长的查询计划\n", "\n", "虽然一个 `QueryPlanTool` 可能由许多 `QueryEngineTools` 组成，但是当进行 OpenAI API 调用时，一个单独的 OpenAI 工具最终是由 `QueryPlanTool` 创建的。这个工具的描述以查询计划方法的一般说明开始，然后是每个组成部分 `QueryEngineTool` 的描述。\n", "\n", "目前，每个 OpenAI 工具描述的最大长度为1024个字符。当你向你的 `QueryPlanTool` 添加更多的 `QueryEngineTools` 时，可能会超出这个限制。如果超出了限制，当 LlamaIndex 尝试构建 OpenAI 工具时，将会引发错误。\n", "\n", "让我们通过一个夸张的例子来演示这种情况，我们将给每个查询引擎工具一个非常冗长和多余的描述。\n"]}, {"cell_type": "code", "execution_count": null, "id": "ce32fa42", "metadata": {}, "outputs": [], "source": ["description_10q_general = \"\"\"\\", "Form 10-Q是美国证券交易委员会要求公开交易公司提交的季度报告，概述了公司当季的财务表现。", "报告包括未经审计的财务报表（损益表、资产负债表和现金流量表）和管理层讨论与分析（MD&A），", "管理层在其中解释重大变化和未来预期。10-Q还披露重大法律诉讼、风险因素更新，", "以及有关公司内部控制的信息。其主要目的是让投资者了解公司的财务状况和运营情况，", "从而做出明智的投资决策。\"\"\"", "", "description_10q_specific = (", " \"这份10-Q提供了Uber截至季度末的财务数据\"", ")"]}, {"cell_type": "code", "execution_count": null, "id": "316db046", "metadata": {}, "outputs": [], "source": ["from llama_index.core.tools import QueryEngineTool\n", "from llama_index.core.tools import QueryPlanTool\n", "from llama_index.core import get_response_synthesizer"]}, {"cell_type": "code", "execution_count": null, "id": "a89972cc-f7b8-4ebd-9c39-935e8a3671ba", "metadata": {}, "outputs": [{"name": "stdout", "output_type": "stream", "text": ["730\n", "725\n", "726\n"]}], "source": ["query_tool_sept = QueryEngineTool.from_defaults(\n", " query_engine=sept_engine,\n", " name=\"sept_2022\",\n", " description=f\"{description_10q_general} {description_10q_specific} September 2022\",\n", ")\n", "query_tool_june = QueryEngineTool.from_defaults(\n", " query_engine=june_engine,\n", " name=\"june_2022\",\n", " description=f\"{description_10q_general} {description_10q_specific} June 2022\",\n", ")\n", "query_tool_march = QueryEngineTool.from_defaults(\n", " query_engine=march_engine,\n", " name=\"march_2022\",\n", " description=f\"{description_10q_general} {description_10q_specific} March 2022\",\n", ")\n", "\n", "print(len(query_tool_sept.metadata.description))\n", "print(len(query_tool_june.metadata.description))\n", "print(len(query_tool_march.metadata.description))"]}, {"cell_type": "markdown", "id": "1557d64c", "metadata": {}, "source": ["从上面的打印语句中，我们可以看到当将这些工具组合成`QueryPlanTool`时，很容易超过1024的最大字符限制。\n"]}, {"cell_type": "code", "execution_count": null, "id": "8ae6d0bd-bd85-4f99-8363-96e203156933", "metadata": {}, "outputs": [], "source": ["query_engine_tools = [query_tool_sept, query_tool_june, query_tool_march]\n", "\n", "response_synthesizer = get_response_synthesizer()\n", "query_plan_tool = QueryPlanTool.from_defaults(\n", " query_engine_tools=query_engine_tools,\n", " response_synthesizer=response_synthesizer,\n", ")"]}, {"cell_type": "code", "execution_count": null, "id": "320e8bde-6afc-4896-94bf-7a186f94fa49", "metadata": {}, "outputs": [{"ename": "ValueError", "evalue": "Tool description exceeds maximum length of 1024 characters. Please shorten your description or move it to the prompt.", "output_type": "error", "traceback": ["\u001b[0;31m---------------------------------------------------------------------------\u001b[0m", "\u001b[0;31mValueError\u001b[0m Traceback (most recent call last)", "Cell \u001b[0;32mIn[12], line 1\u001b[0m\n\u001b[0;32m----> 1\u001b[0m openai_tool \u001b[38;5;241m=\u001b[39m \u001b[43mquery_plan_tool\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mmetadata\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mto_openai_tool\u001b[49m\u001b[43m(\u001b[49m\u001b[43m)\u001b[49m\n", "File \u001b[0;32m~/Code/run-llama/llama_index/llama-index-core/llama_index/core/tools/types.py:74\u001b[0m, in \u001b[0;36mToolMetadata.to_openai_tool\u001b[0;34m(self)\u001b[0m\n\u001b[1;32m 72\u001b[0m \u001b[38;5;250m\u001b[39m\u001b[38;5;124;03m\"\"\"To OpenAI tool.\"\"\"\u001b[39;00m\n\u001b[1;32m 73\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m \u001b[38;5;28mlen\u001b[39m(\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mdescription) \u001b[38;5;241m>\u001b[39m \u001b[38;5;241m1024\u001b[39m:\n\u001b[0;32m---> 74\u001b[0m \u001b[38;5;28;01mraise\u001b[39;00m \u001b[38;5;167;01mValueError\u001b[39;00m(\n\u001b[1;32m 75\u001b[0m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mTool description exceeds maximum length of 1024 characters. \u001b[39m\u001b[38;5;124m\"\u001b[39m\n\u001b[1;32m 76\u001b[0m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mPlease shorten your description or move it to the prompt.\u001b[39m\u001b[38;5;124m\"\u001b[39m\n\u001b[1;32m 77\u001b[0m )\n\u001b[1;32m 78\u001b[0m \u001b[38;5;28;01mreturn\u001b[39;00m {\n\u001b[1;32m 79\u001b[0m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mtype\u001b[39m\u001b[38;5;124m\"\u001b[39m: \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mfunction\u001b[39m\u001b[38;5;124m\"\u001b[39m,\n\u001b[1;32m 80\u001b[0m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mfunction\u001b[39m\u001b[38;5;124m\"\u001b[39m: {\n\u001b[0;32m (...)\u001b[0m\n\u001b[1;32m 84\u001b[0m },\n\u001b[1;32m 85\u001b[0m }\n", "\u001b[0;31mValueError\u001b[0m: Tool description exceeds maximum length of 1024 characters. Please shorten your description or move it to the prompt."]}], "source": ["openai_tool = query_plan_tool.metadata.to_openai_tool()"]}, {"cell_type": "markdown", "id": "0dba5958", "metadata": {}, "source": ["## 将工具描述移动到提示符\n", "\n", "显而易见的解决方案是缩短工具描述本身，然而，如果有足够多的工具，最终仍然会超过字符限制。\n", "\n", "更具可扩展性的解决方案是将工具描述移动到提示符。这解决了字符限制的问题，因为如果没有查询引擎工具的描述，查询计划描述将保持固定大小。当然，所选的LLM强加的令牌限制仍将限制工具描述，但这些限制远远大于1024个字符的限制。\n"]}, {"cell_type": "markdown", "id": "f96da5d3", "metadata": {}, "source": ["将这些工具描述移动到提示中涉及两个步骤。首先，我们必须修改`QueryPlanTool`的元数据属性，以省略`QueryEngineTool`的描述，并对默认的查询规划说明进行轻微修改（告诉LLM在提示中查找工具名称和描述）。\n"]}, {"cell_type": "code", "execution_count": null, "id": "90a3f429", "metadata": {}, "outputs": [{"data": {"text/plain": ["ToolMetadata(description='This is a query plan tool that takes in a list of tools and executes a query plan over these tools to answer a query. The query plan is a DAG of query nodes.\\n\\nGiven a list of tool names and the query plan schema, you can choose to generate a query plan to answer a question.\\n\\nThe tool names and descriptions will be given alongside the query.\\n', name='query_plan_tool', fn_schema=, return_direct=False)"]}, "execution_count": null, "metadata": {}, "output_type": "execute_result"}], "source": ["from llama_index.core.tools.types import ToolMetadata", "", "introductory_tool_description_prefix = \"\"\"\\", "这是一个查询计划工具，它接收一个工具列表并执行这些工具的查询计划以回答查询。查询计划是查询节点的有向无环图（DAG）。", "", "给定工具名称列表和查询计划模式，您可以选择生成一个查询计划来回答问题。", "", "工具名称和描述将与查询一起给出。", "\"\"\"", "", "# 修改元数据以仅包括一般查询计划说明", "new_metadata = ToolMetadata(", " introductory_tool_description_prefix,", " query_plan_tool.metadata.name,", " query_plan_tool.metadata.fn_schema,", ")", "query_plan_tool.metadata = new_metadata", "query_plan_tool.metadata"]}, {"cell_type": "markdown", "id": "7d8d906e", "metadata": {}, "source": ["第二，我们必须将工具名称和描述与提出的查询连接起来。\n"]}, {"cell_type": "code", "execution_count": null, "id": "6466d4bf-59bd-4916-bf28-c1eb71a0a650", "metadata": {}, "outputs": [], "source": ["from llama_index.agent.openai import OpenAIAgent\n", "from llama_index.llms.openai import OpenAI\n", "\n", "agent = OpenAIAgent.from_tools(\n", " [query_plan_tool],\n", " max_function_calls=10,\n", " llm=OpenAI(temperature=0, model=\"gpt-4-0613\"),\n", " verbose=True,\n", ")\n", "\n", "query = \"What were the risk factors in sept 2022?\""]}, {"cell_type": "code", "execution_count": null, "id": "51cb85a5-8539-4218-b337-521ba77771a3", "metadata": {}, "outputs": [{"data": {"text/plain": ["\"Tool Name: sept_2022\\nTool Description: A Form 10-Q is a quarterly report required by the SEC for publicly traded companies,\\nproviding an overview of the company's financial performance for the quarter.\\nIt includes unaudited financial statements (income statement, balance sheet,\\nand cash flow statement) and the Management's Discussion and Analysis (MD&A),\\nwhere management explains significant changes and future expectations.\\nThe 10-Q also discloses significant legal proceedings, updates on risk factors,\\nand information on the company's internal controls. Its primary purpose is to keep\\ninvestors informed about the company's financial status and operations,\\nenabling informed investment decisions. This 10-Q provides Uber quarterly financials ending September 2022 \\n\\nTool Name: june_2022\\nTool Description: A Form 10-Q is a quarterly report required by the SEC for publicly traded companies,\\nproviding an overview of the company's financial performance for the quarter.\\nIt includes unaudited financial statements (income statement, balance sheet,\\nand cash flow statement) and the Management's Discussion and Analysis (MD&A),\\nwhere management explains significant changes and future expectations.\\nThe 10-Q also discloses significant legal proceedings, updates on risk factors,\\nand information on the company's internal controls. Its primary purpose is to keep\\ninvestors informed about the company's financial status and operations,\\nenabling informed investment decisions. This 10-Q provides Uber quarterly financials ending June 2022 \\n\\nTool Name: march_2022\\nTool Description: A Form 10-Q is a quarterly report required by the SEC for publicly traded companies,\\nproviding an overview of the company's financial performance for the quarter.\\nIt includes unaudited financial statements (income statement, balance sheet,\\nand cash flow statement) and the Management's Discussion and Analysis (MD&A),\\nwhere management explains significant changes and future expectations.\\nThe 10-Q also discloses significant legal proceedings, updates on risk factors,\\nand information on the company's internal controls. Its primary purpose is to keep\\ninvestors informed about the company's financial status and operations,\\nenabling informed investment decisions. This 10-Q provides Uber quarterly financials ending March 2022 \\n\\nQuery: What were the risk factors in sept 2022?\""]}, "execution_count": null, "metadata": {}, "output_type": "execute_result"}], "source": ["# 重构连接的查询引擎工具描述", "tools_description = \"\\n\\n\".join(", " [", " f\"工具名称：{tool.metadata.name}\\n\"", " + f\"工具描述：{tool.metadata.description} \"", " for tool in query_engine_tools", " ]", ")", "", "# 连接工具描述和查询", "query_planned_query = f\"{tools_description}\\n\\n查询：{query}\"", "query_planned_query"]}, {"cell_type": "code", "execution_count": null, "id": "e916d809", "metadata": {}, "outputs": [{"name": "stdout", "output_type": "stream", "text": ["Added user message to memory: Tool Name: sept_2022\n", "Tool Description: A Form 10-Q is a quarterly report required by the SEC for publicly traded companies,\n", "providing an overview of the company's financial performance for the quarter.\n", "It includes unaudited financial statements (income statement, balance sheet,\n", "and cash flow statement) and the Management's Discussion and Analysis (MD&A),\n", "where management explains significant changes and future expectations.\n", "The 10-Q also discloses significant legal proceedings, updates on risk factors,\n", "and information on the company's internal controls. Its primary purpose is to keep\n", "investors informed about the company's financial status and operations,\n", "enabling informed investment decisions. This 10-Q provides Uber quarterly financials ending September 2022 \n", "\n", "Tool Name: june_2022\n", "Tool Description: A Form 10-Q is a quarterly report required by the SEC for publicly traded companies,\n", "providing an overview of the company's financial performance for the quarter.\n", "It includes unaudited financial statements (income statement, balance sheet,\n", "and cash flow statement) and the Management's Discussion and Analysis (MD&A),\n", "where management explains significant changes and future expectations.\n", "The 10-Q also discloses significant legal proceedings, updates on risk factors,\n", "and information on the company's internal controls. Its primary purpose is to keep\n", "investors informed about the company's financial status and operations,\n", "enabling informed investment decisions. This 10-Q provides Uber quarterly financials ending June 2022 \n", "\n", "Tool Name: march_2022\n", "Tool Description: A Form 10-Q is a quarterly report required by the SEC for publicly traded companies,\n", "providing an overview of the company's financial performance for the quarter.\n", "It includes unaudited financial statements (income statement, balance sheet,\n", "and cash flow statement) and the Management's Discussion and Analysis (MD&A),\n", "where management explains significant changes and future expectations.\n", "The 10-Q also discloses significant legal proceedings, updates on risk factors,\n", "and information on the company's internal controls. Its primary purpose is to keep\n", "investors informed about the company's financial status and operations,\n", "enabling informed investment decisions. This 10-Q provides Uber quarterly financials ending March 2022 \n", "\n", "Query: What were the risk factors in sept 2022?\n", "=== Calling Function ===\n", "Calling function: query_plan_tool with args: {\n", "\"nodes\": [\n", " {\n", " \"id\": 1,\n", " \"query_str\": \"What were the risk factors in sept 2022?\",\n", " \"tool_name\": \"sept_2022\",\n", " \"dependencies\": []\n", " }\n", "]\n", "}\n", "\u001b[1;3;34mExecuting node {\"id\": 1, \"query_str\": \"What were the risk factors in sept 2022?\", \"tool_name\": \"sept_2022\", \"dependencies\": []}\n", "\u001b[0m\u001b[1;3;38;5;200mSelected Tool: ToolMetadata(description=\"A Form 10-Q is a quarterly report required by the SEC for publicly traded companies,\\nproviding an overview of the company's financial performance for the quarter.\\nIt includes unaudited financial statements (income statement, balance sheet,\\nand cash flow statement) and the Management's Discussion and Analysis (MD&A),\\nwhere management explains significant changes and future expectations.\\nThe 10-Q also discloses significant legal proceedings, updates on risk factors,\\nand information on the company's internal controls. Its primary purpose is to keep\\ninvestors informed about the company's financial status and operations,\\nenabling informed investment decisions. This 10-Q provides Uber quarterly financials ending September 2022\", name='sept_2022', fn_schema=, return_direct=False)\n", "\u001b[0m\u001b[1;3;34mExecuted query, got response.\n", "Query: What were the risk factors in sept 2022?\n", "Response: The risk factors in September 2022 included failure to meet regulatory requirements related to climate change or to meet stated climate change commitments, which could impact costs, operations, brand, and reputation. The ongoing COVID-19 pandemic and responses to it were also a risk, as they had an adverse impact on business and operations, including reducing the demand for Mobility offerings globally and affecting travel behavior and demand. Catastrophic events such as disease, weather events, war, or terrorist attacks could also adversely impact the business, financial condition, and results of operation. Other risks included errors, bugs, or vulnerabilities in the platform's code or systems, inappropriate or controversial data practices, and the growing use of artificial intelligence. Climate change related physical and transition risks, such as market shifts toward electric vehicles and lower carbon business models, and risks related to extreme weather events or natural disasters, were also a concern.\n", "\u001b[0mGot output: The risk factors in September 2022 included failure to meet regulatory requirements related to climate change or to meet stated climate change commitments, which could impact costs, operations, brand, and reputation. The ongoing COVID-19 pandemic and responses to it were also a risk, as they had an adverse impact on business and operations, including reducing the demand for Mobility offerings globally and affecting travel behavior and demand. Catastrophic events such as disease, weather events, war, or terrorist attacks could also adversely impact the business, financial condition, and results of operation. Other risks included errors, bugs, or vulnerabilities in the platform's code or systems, inappropriate or controversial data practices, and the growing use of artificial intelligence. Climate change related physical and transition risks, such as market shifts toward electric vehicles and lower carbon business models, and risks related to extreme weather events or natural disasters, were also a concern.\n", "========================\n", "\n"]}, {"data": {"text/plain": ["Response(response=\"The risk factors for Uber in September 2022 included:\\n\\n1. Failure to meet regulatory requirements related to climate change or to meet stated climate change commitments, which could impact costs, operations, brand, and reputation.\\n2. The ongoing COVID-19 pandemic and responses to it were also a risk, as they had an adverse impact on business and operations, including reducing the demand for Mobility offerings globally and affecting travel behavior and demand.\\n3. Catastrophic events such as disease, weather events, war, or terrorist attacks could also adversely impact the business, financial condition, and results of operation.\\n4. Other risks included errors, bugs, or vulnerabilities in the platform's code or systems, inappropriate or controversial data practices, and the growing use of artificial intelligence.\\n5. Climate change related physical and transition risks, such as market shifts toward electric vehicles and lower carbon business models, and risks related to extreme weather events or natural disasters, were also a concern.\", source_nodes=[NodeWithScore(node=TextNode(id_='a92c1e5e-6285-4225-8c87-b9dbd2b07d89', embedding=None, metadata={'page_label': '74', 'file_name': 'uber_10q_sept_2022.pdf', 'file_path': 'data/10q/uber_10q_sept_2022.pdf', 'file_type': 'application/pdf', 'file_size': 1178622, 'creation_date': '2024-05-23', 'last_modified_date': '2024-05-23'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={: RelatedNodeInfo(node_id='b5e99044-59e9-439a-9e53-802a517b287d', node_type=, metadata={'page_label': '74', 'file_name': 'uber_10q_sept_2022.pdf', 'file_path': 'data/10q/uber_10q_sept_2022.pdf', 'file_type': 'application/pdf', 'file_size': 1178622, 'creation_date': '2024-05-23', 'last_modified_date': '2024-05-23'}, hash='edddd9bda362411ae2e4d36144b5049c8b2ce5ec26047fa7c04003a9265aa87d'), : RelatedNodeInfo(node_id='04ae9351-0136-491a-8756-41dc2b8071a1', node_type=, metadata={'page_label': '74', 'file_name': 'uber_10q_sept_2022.pdf', 'file_path': 'data/10q/uber_10q_sept_2022.pdf', 'file_type': 'application/pdf', 'file_size': 1178622, 'creation_date': '2024-05-23', 'last_modified_date': '2024-05-23'}, hash='bdc5ab49a54e18f73a2687096148f9e567a053ea2d3bd3c051956fb359078f5e')}, text='Any failure to\\nmeet regulatory requirements related to climate change, or to meet our stated climate change commitments on the timeframe we committed to, or at all, could have\\nan adverse impact on our costs and ability to operate, as well as harm our brand, reputation, and consequently, our business.\\nGeneral Economic Risks\\nOutbreaks of contagious disease, such as the COVID-19 pandemic and the impact of actions to mitigate the such disease or pandemic, have adversely impacted\\nand could continue to adversely impact our business, financial condition and results of operations.\\nOccurrence of a catastrophic event, including but not limited to disease, a weather event, war, or terrorist attack, could adversely impact our business, financial\\ncondition and results of operation. We also face risks related to health epidemics, outbreaks of contagious disease, and other adverse health developments. For\\nexample, the ongoing COVID-19 pandemic and responses to it have had, and may continue to have, an adverse impact on our business and operations, including,\\nfor example, by reducing the demand for our Mobility offerings globally, and affecting travel behavior and demand. Even as COVID-related restrictions have been\\nlifted and many regions around the world are making progress in their recovery from the pandemic, we have experienced and may continue to experience Driver\\nsupply constraints, and we are observing that consumer demand for Mobility is recovering faster than driver availability, as such supply constraints have been and\\nmay continue to be impacted by concerns regarding the COVID-19 pandemic. Furthermore, to support social distancing, we temporarily suspended our shared\\nrides offering globally, and recently re-launched our shared rides offering in certain regions.\\n73', start_char_idx=4469, end_char_idx=6258, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=0.8039095664957979), NodeWithScore(node=TextNode(id_='04ae9351-0136-491a-8756-41dc2b8071a1', embedding=None, metadata={'page_label': '74', 'file_name': 'uber_10q_sept_2022.pdf', 'file_path': 'data/10q/uber_10q_sept_2022.pdf', 'file_type': 'application/pdf', 'file_size': 1178622, 'creation_date': '2024-05-23', 'last_modified_date': '2024-05-23'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={: RelatedNodeInfo(node_id='b5e99044-59e9-439a-9e53-802a517b287d', node_type=, metadata={'page_label': '74', 'file_name': 'uber_10q_sept_2022.pdf', 'file_path': 'data/10q/uber_10q_sept_2022.pdf', 'file_type': 'application/pdf', 'file_size': 1178622, 'creation_date': '2024-05-23', 'last_modified_date': '2024-05-23'}, hash='edddd9bda362411ae2e4d36144b5049c8b2ce5ec26047fa7c04003a9265aa87d'), : RelatedNodeInfo(node_id='a92c1e5e-6285-4225-8c87-b9dbd2b07d89', node_type=, metadata={}, hash='4862564636269739d75565c6c9dc166659cf52e29ec337fe9b85802beeb2ce7d')}, text='platform to platform users. In addition, our release of new software in the past has inadvertently caused, and may in the future cause, interruptions in the\\navailability or functionality of our platform. Any errors, bugs, or vulnerabilities discovered in our code or systems after release could result in an interruption in the\\navailability of our platform or a negative experience for Drivers, consumers, merchants, Shippers, and Carriers, and could also result in negative publicity and\\nunfavorable media coverage, damage to our reputation, loss of platform users, loss of revenue or liability for damages, regulatory inquiries, or other proceedings,\\nany of which could adversely affect our business and financial results. In addition, our growing use of artificial intelligence (“AI”) (including machine learning) in\\nour offerings presents additional risks. AI algorithms or automated processing of data may be flawed and datasets may be insufficient or contain biased information.\\nInappropriate or controversial data practices by us or others could impair the acceptance of AI solutions or subject us to lawsuits and regulatory investigations.\\nThese deficiencies could undermine the decisions, predictions or analysis AI applications produce, or lead to unintentional bias and discrimination, subjecting us to\\ncompetitive harm, legal liability, and brand or reputational harm.\\nWe are subject to climate change risks, including physical and transitional risks, and if we are unable to manage such risks, our business may be adversely\\nimpacted.\\nWe face climate change related physical and transition risks, which include the risk of market shifts toward electric vehicles (“EVs”) and lower carbon\\nbusiness models and risks related to extreme weather events or natural disasters. Climate-related events, including the increasing frequency, severity and duration\\nof extreme weather events and their impact on critical infrastructure in the United States and elsewhere, have the potential to disrupt our business, our third-party\\nsuppliers, and the business of merchants, Shippers, Carriers and Drivers using our platform, and may cause us to experience higher losses and additional costs to\\nmaintain or resume operations. Additionally, we are subject to emerging climate policies such as a regulation adopted in California in May 2021 requiring 90% of\\nvehicle miles traveled by rideshare fleets in California to have been in zero emission vehicles by 2030, with interim targets beginning in 2023. In addition, Drivers\\nmay be subject to climate-related policies that indirectly impact our business, such as the Congestion Charge Zone and Ultra Low Emission Zone schemes adopted\\nin London that impose fees on drivers in fossil-fueled vehicles, which may impact our ability to attract and maintain Drivers on our platform, and to the extent we\\nexperience Driver supply constraints in a given market, we may need to increase Driver incentives.\\nWe have made climate related commitments that require us to invest significant effort, resources, and management time and circumstances may arise,\\nincluding those beyond our control, that may require us to revise the contemplated timeframes for implementing these commitments.\\nWe have made climate related commitments, including our commitment to 100% renewable electricity for our U.S. offices by 2025, our commitment to net\\nzero climate emissions from corporate operations by 2030, and our commitment to be a net zero company by 2040. In addition, our Supplier Code of Conduct sets\\nenvironmental standards for our supply chain, and we recognize that there are inherent climate-related risks wherever business is conducted. Progressing towards\\nour climate commitments requires us to invest significant effort, resources, and management time, and circumstances may arise, including those beyond our\\ncontrol, that may require us to revise our timelines and/or climate commitments. For example, the COVID-19 pandemic has negatively impacted our ability to\\ndedicate resources to make the progress on our climate commitments that we initially anticipated. In addition, our ability to meet our climate commitments is\\ndependent on external factors such as rapidly changing regulations, policies and related interpretation, advances in technology such as battery storage, as well the\\navailability, cost and accessibility of EVs to Drivers, and the availability of EV charging infrastructure that can be efficiently accessed by Drivers. Any failure to\\nmeet regulatory requirements related to climate change, or to meet our stated climate change commitments on the timeframe we committed to, or at all, could have\\nan adverse impact on our costs and ability to operate, as well as harm our brand, reputation, and consequently, our business.\\nGeneral Economic Risks\\nOutbreaks of contagious disease, such as the COVID-19 pandemic and the impact of actions to mitigate the such disease or pandemic, have adversely impacted\\nand could continue to adversely impact our business, financial condition and results of operations.\\nOccurrence of a catastrophic event, including but not limited to disease, a weather event, war, or terrorist attack, could adversely impact our business, financial\\ncondition and results of operation.', start_char_idx=0, end_char_idx=5248, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=0.7967699969539317), NodeWithScore(node=TextNode(id_='474572f4-866f-4efa-aa5f-f898d4ba831a', embedding=None, metadata={'page_label': '13', 'file_name': 'uber_10q_sept_2022.pdf', 'file_path': 'data/10q/uber_10q_sept_2022.pdf', 'file_type': 'application/pdf', 'file_size': 1178622, 'creation_date': '2024-05-23', 'last_modified_date': '2024-05-23'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={: RelatedNodeInfo(node_id='2ecd357c-acd3-4398-a0ae-223bf9980f34', node_type=, metadata={'page_label': '13', 'file_name': 'uber_10q_sept_2022.pdf', 'file_path': 'data/10q/uber_10q_sept_2022.pdf', 'file_type': 'application/pdf', 'file_size': 1178622, 'creation_date': '2024-05-23', 'last_modified_date': '2024-05-23'}, hash='8da53f7e83f88f63304dfcf8186b0ce111a5e161a317d243451266b863e9f2af'), : RelatedNodeInfo(node_id='e2e88da4-92e0-4185-96c6-010a35d94287', node_type=, metadata={'page_label': '13', 'file_name': 'uber_10q_sept_2022.pdf', 'file_path': 'data/10q/uber_10q_sept_2022.pdf', 'file_type': 'application/pdf', 'file_size': 1178622, 'creation_date': '2024-05-23', 'last_modified_date': '2024-05-23'}, hash='373d1a92181565c8fb2ae2831069e904f4f4d2a9fdc70486b91f102cdac9d442')}, text='Estimates are based on historical experience, where\\napplicable, and other assumptions which management believes are reasonable under the circumstances. Additionally, we considered the impacts of the coronavirus\\npandemic (“COVID-19”) on the assumptions and inputs (including market data) supporting certain of these estimates, assumptions and judgments. On an ongoing\\nbasis, management evaluates estimates, including, but not limited to: fair values of investments and other financial instruments (including the measurement of\\ncredit or impairment losses); useful lives of amortizable long-lived assets; fair value of acquired intangible assets and related impairment assessments; impairment\\nof goodwill; stock-based compensation; income taxes and non-income tax reserves; certain deferred tax assets and tax liabilities; insurance reserves; and other\\ncontingent liabilities. These estimates are inherently subject to judgment and actual results could differ from those estimates.\\nCertain Significant Risks and Uncertainties - COVID-19\\nCOVID-19 restrictions have had an adverse impact on our business and operations by reducing, in particular, the global demand for Mobility offerings. It is\\nnot possible to predict COVID-19’s cumulative and ultimate impact on our future business operations, results of operations, financial position, liquidity, and cash\\nflows. The extent of the impact of COVID-19 on our business and financial results will depend largely on future developments, including: outbreaks or variants of\\nthe virus, both globally and within the United\\n12', start_char_idx=4007, end_char_idx=5573, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n'), score=0.7911034852964277)], metadata=None)"]}, "execution_count": null, "metadata": {}, "output_type": "execute_result"}], "source": ["response = agent.query(query_planned_query)\n", "response"]}], "metadata": {"kernelspec": {"display_name": "venv", "language": "python", "name": "python3"}, "language_info": {"codemirror_mode": {"name": "ipython", "version": 3}, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3"}}, "nbformat": 4, "nbformat_minor": 5}