{"id":1334,"date":"2023-12-12T20:50:57","date_gmt":"2023-12-13T04:50:57","guid":{"rendered":"https:\/\/ligai.cn\/blog\/?p=1334"},"modified":"2023-12-12T20:50:57","modified_gmt":"2023-12-13T04:50:57","slug":"%e6%8a%80%e6%9c%af%e5%88%86%e4%ba%ab-chatgpt-api-%e8%b0%83%e7%94%a8%e6%80%bb%e8%b6%85%e6%97%b6%ef%bc%9f%e8%a7%a3%e5%86%b3%e6%96%b9%e6%a1%88%e5%9c%a8%e8%bf%99","status":"publish","type":"post","link":"https:\/\/ligai.cn\/blog\/sharing\/1334.html","title":{"rendered":"\u6280\u672f\u5206\u4eab | ChatGPT API \u8c03\u7528\u603b\u8d85\u65f6\uff1f\u89e3\u51b3\u65b9\u6848\u5728\u8fd9"},"content":{"rendered":"\n<h2>\u95ee\u9898\u91cd\u73b0<\/h2>\n\n\n\n<p>\u5728\u8c03\u7528 ChatGPT API \u5e76\u4f7f\u7528\u6d41\u5f0f\u8f93\u51fa\u65f6\uff0c\u6211\u4eec\u7ecf\u5e38\u4f1a\u9047\u5230\u7f51\u7edc\u95ee\u9898\u5bfc\u81f4\u7684\u8d85\u65f6\u60c5\u51b5\u3002<strong>\u6709\u8da3\u7684\u662f\uff0c\u7b14\u8005\u53d1\u73b0\u5728\u672c\u5730\u8c03\u8bd5\u9047\u5230\u7684\u8d85\u65f6\uff0c\u4f1a\u5728 10 \u5206\u949f\u540e\u81ea\u52a8\u6062\u590d<\/strong>\uff08\u4e3a\u4ec0\u4e48\u662f 10 \u5206\u949f\uff1f\u6211\u4eec\u7559\u5230\u540e\u9762\u89e3\u91ca\uff09\uff0c\u4f46\u662f\u5728\u670d\u52a1\u5668\u4e0a\u7b49\u5f85\u4e00\u4f1a\u513f\u5374\u4f1a\u5931\u8d25\uff0c\u62a5\u51fa\u8d85\u65f6\u5f02\u5e38\uff08\u9519\u8bef\u4ee3\u7801 502\uff09\u3002<\/p>\n\n\n\n<p>\u7b14\u8005\u8ba4\u4e3a\uff0c\u672c\u5730\u80fd\u6062\u590d\u7684\u539f\u56e0\u53ef\u80fd\u662f\u81ea\u52a8\u91cd\u8bd5\uff0c\u53ea\u662f\u91cd\u8bd5\u7684\u65f6\u95f4\u6709\u70b9\u4e45\uff08ChatGPT API \u6ca1\u6709\u91cd\u8bd5\u529f\u80fd\uff0c\u8fd9\u662f\u9879\u76ee\u52a0\u5165\u7684\uff09\u3002\u670d\u52a1\u5668\u8fd4\u56de\u300c502\u300d\u662f\u56e0\u4e3a\u5185\u5bb9\u4ece\u540e\u53f0\u8fd4\u56de\u5230\u524d\u7aef\u9700\u8981\u7ecf\u8fc7\u7f51\u5173\u5c42\uff0c\u800c\u7f51\u5173\u5c42\u8d85\u65f6\u6821\u9a8c\u7684\u65f6\u95f4\u6bd4\u81ea\u52a8\u91cd\u8bd5\u7684\u65f6\u95f4\uff0810 \u5206\u949f\uff09\u66f4\u77ed\uff0c\u6240\u4ee5\u6491\u4e0d\u5230\u91cd\u8bd5\u5c31\u4f1a\u62a5\u8d85\u65f6\u5f02\u5e38\u3002<\/p>\n\n\n\n<p>\u57fa\u4e8e\u4ee5\u4e0a\u573a\u666f\uff0c\u672c\u6587\u7740\u624b\u89e3\u51b3 ChatGPT API \u8c03\u7528\u8d85\u65f6\u95ee\u9898\u3002<\/p>\n\n\n\n<h2>\u4f18\u5316\u8bc9\u6c42<\/h2>\n\n\n\n<ul><li>\u4e0d\u5411\u7528\u6237\u5c55\u793a\u8d85\u65f6\u7684\u62a5\u9519\u4fe1\u606f\u3002<\/li><li>\u7f29\u77ed\u8d85\u65f6\u540e\u91cd\u8bd5\u7684\u65f6\u95f4\u95f4\u9694\u3002<\/li><\/ul>\n\n\n\n<h2>\u89e3\u51b3\u601d\u8def<\/h2>\n\n\n\n<p>\u7b14\u8005\u8003\u8651\u4e86\u4e24\u79cd\u65b9\u6848\u3002<\/p>\n\n\n\n<p><strong>\u4e00\u662f\u5f7b\u5e95\u89e3\u51b3\u7f51\u7edc\u95ee\u9898\uff0c\u4f46\u96be\u5ea6\u6709\u70b9\u5927\u3002<\/strong> \u8fd9\u5c5e\u4e8e OpenAI \u670d\u52a1\u5668\u95ee\u9898\uff0c\u5373\u4f7f\u662f\u90e8\u7f72\u5728\u56fd\u5916\u7684\u670d\u52a1\u5668\u4e5f\u4f1a\u51fa\u73b0\u8d85\u65f6\u7684\u60c5\u51b5\u3002<\/p>\n\n\n\n<p><strong>\u4e8c\u662f\u5229\u7528\u81ea\u52a8\u91cd\u8bd5\u89e3\u51b3\u95ee\u9898\u3002<\/strong> \u901a\u8fc7\u8c03\u6574\u8d85\u65f6\u7684\u65f6\u95f4\uff0c\u63d0\u5347\u54cd\u5e94\u901f\u5ea6\uff0c\u65b9\u6848\u53ef\u884c\u3002<\/p>\n\n\n\n<h2>\u5b9e\u65bd\u89e3\u51b3\u65b9\u6848<\/h2>\n\n\n\n<p>\u89e3\u51b3\u8fc7\u7a0b\u4e2d\uff0c\u7b14\u8005\u5206\u4e24\u6b65\u7531\u6d45\u81f3\u6df1\u5730\u8c03\u6574\u4e86\u8d85\u65f6\u65f6\u95f4\uff1b\u5982\u679c\u60f3\u76f4\u63a5\u4e86\u89e3\u6700\u7ec8\u65b9\u6848\uff0c\u8bf7\u79fb\u6b65\u300c\u89e3\u51b3\u65b9\u6848\u4e8c\u300d~<\/p>\n\n\n\n<ul><li><strong>\u8fd0\u884c\u73af\u5883\uff1a<\/strong><\/li><\/ul>\n\n\n\n<p><code>Python: 3.10.7<\/code><\/p>\n\n\n\n<p><code>openai: 0.27.6<\/code><\/p>\n\n\n\n<ul><li><strong>\u8c03\u7528\u65b9\u6cd5\uff1a<\/strong><\/li><\/ul>\n\n\n\n<p><code>openai.api_resources.chat_completion.ChatCompletion.acreate<\/code><\/p>\n\n\n\n<p>\uff08 \u8fd9\u662f\u5f02\u6b65\u8c03\u7528 ChatGPT \u7684\u65b9\u6cd5\u3002\uff09<\/p>\n\n\n\n<ul><li><strong>\u65b9\u6cd5\u8c03\u7528\u94fe\u8def\uff1a<\/strong><\/li><\/ul>\n\n\n\n<p>\u8d85\u65f6\u53c2\u6570 <code>ClientTimeout<\/code>\uff0c\u4e00\u5171\u6709 4 \u4e2a\u5c5e\u6027 <code>total<\/code>\u3001<code>connect<\/code>\u3001<code>sock_read<\/code> \u548c <code>sock_connect<\/code>\u3002<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code># \u65b9\u6cd5 -&gt; \u8d85\u65f6\u76f8\u5173\u53c2\u6570\nopenai.api_resources.chat_completion.ChatCompletion.acreate -&gt; kwargs\nopenai.api_resources.abstract.engine_api_resource.EngineAPIResource.acreate -&gt; params\nopenai.api_requestor.APIRequestor.arequest -&gt; request_timeout\n# request_timeout \u5728\u8fd9\u4e00\u6b65\u53d8\u6210\u4e86 timeout\uff0c\u56e0\u6b64\uff0c\u53ea\u9700\u8981\u4f20\u53c2 request_timeout \u5373\u53ef\nopenai.api_requestor.APIRequestor.arequest_raw -&gt; request_timeout\naiohttp.client.ClientSession.request -&gt; kwargs\naiohttp.client.ClientSession._request -&gt; timeout\n    tm = TimeoutHandle(self._loop, real_timeout.total) -&gt; ClientTimeout.total\n    async with ceil_timeout(real_timeout.connect): -&gt; ClientTimeout.connect\n# \u5b50\u5206\u652f1\naiohttp.connector.BaseConnector.connect -&gt; timeout\naiohttp.connector.TCPConnector._create_connection -&gt; timeout\naiohttp.connector.TCPConnector._create_direct_connection -&gt; timeout\naiohttp.connector.TCPConnector._wrap_create_connection -&gt; timeout\n    async with ceil_timeout(timeout.sock_connect): -&gt; ClientTimeout.sock_connect\n# \u5b50\u5206\u652f2\naiohttp.client_reqrep.ClientRequest.send -&gt; timeout\naiohttp.client_proto.ResponseHandler.set_response_params -&gt; read_timeout\naiohttp.client_proto.ResponseHandler._reschedule_timeout -&gt; self._read_timeout\n    if timeout:\n    self._read_timeout_handle = self._loop.call_later(\n        timeout, self._on_read_timeout\n    ) -&gt; ClientTimeout.sock_read<\/code><\/pre>\n\n\n\n<h3>\u89e3\u51b3\u65b9\u6848\u4e00<\/h3>\n\n\n\n<p><code>openai.api_requestor.APIRequestor.arequest_raw<\/code> \u65b9\u6cd5\u4e2d\u7684 <code>request_timeout<\/code> \u53c2\u6570\u53ef\u4ee5\u4f20\u9012 <code>connect<\/code> \u548c <code>total<\/code> \u53c2\u6570.<\/p>\n\n\n\n<p>\u56e0\u6b64\u53ef\u4ee5\u5728\u8c03\u7528 <code>openai.api_resources.chat_completion.ChatCompletion.acreate<\/code>\u65f6\uff0c\u8bbe\u7f6e <code>request_time(10, 300)<\/code>\u3002<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>#\nasync def arequest_raw(\n    self,\n    method,\n    url,\n    session,\n    *,\n    params=None,\n    supplied_headers: Optional&#91;Dict&#91;str, str]] = None,\n    files=None,\n    request_id: Optional&#91;str] = None,\n    request_timeout: Optional&#91;Union&#91;float, Tuple&#91;float, float]]] = None,\n) -&gt; aiohttp.ClientResponse:\n    abs_url, headers, data = self._prepare_request_raw(\n        url, supplied_headers, method, params, files, request_id\n    )\n\n    if isinstance(request_timeout, tuple):\n        timeout = aiohttp.ClientTimeout(\n            connect=request_timeout&#91;0],\n            total=request_timeout&#91;1],\n        )else:\n            timeout = aiohttp.ClientTimeout(\n                total=request_timeout if request_timeout else TIMEOUT_SECS\n            )\n    ...<\/code><\/pre>\n\n\n\n<p>\u8be5\u65b9\u6848\u6709\u6548\uff0c\u4f46\u6ca1\u6709\u5b8c\u5168\u751f\u6548\uff1a\u5b83\u53ef\u4ee5\u63a7\u5236\u8fde\u63a5\u65f6\u95f4\u548c\u8bf7\u6c42\u7684\u5168\u90e8\u65f6\u95f4\uff0c\u4f46\u6ca1\u6709\u5f7b\u5e95\u89e3\u51b3\u8d85\u65f6\u5f02\u5e38\uff0c\u56e0\u4e3a\u300c\u8bf7\u6c42\u8fde\u63a5\u65f6\u95f4\u300d\u548c\u300c\u7b2c\u4e00\u4e2a\u5b57\u7b26\u8bfb\u53d6\u65f6\u95f4\u300d\u662f\u4e24\u7801\u4e8b\u3002\u300c\u8bf7\u6c42\u8fde\u63a5\u65f6\u95f4\u300d\u57fa\u4e8e <code>total<\/code> \u65f6\u95f4\u91cd\u8bd5\uff08300s\uff09\uff0c\u800c\u7f51\u5173\u65f6\u95f4\u5e76\u6ca1\u6709\u8bbe\u7f6e\u8fd9\u4e48\u4e45\u3002<\/p>\n\n\n\n<p>\u4e8e\u662f\uff0c\u7b14\u8005\u7ee7\u7eed\u63d0\u51fa\u300c\u89e3\u51b3\u65b9\u6848\u4e8c\u300d\u3002<\/p>\n\n\n\n<h3>\u89e3\u51b3\u65b9\u6848\u4e8c<\/h3>\n\n\n\n<p>\u4f7f\u7528 <code>monkey_patch<\/code> \u65b9\u5f0f\u91cd\u5199 <code>openai.api_requestor.APIRequestor.arequest_raw<\/code> \u65b9\u6cd5\uff0c\u91cd\u70b9\u5728\u4e8e\u91cd\u5199 request_timeout \u53c2\u6570\uff0c\u8ba9\u5176\u652f\u6301\u539f\u751f\u7684 <code>aiohttp.client.ClientTimeout<\/code> \u53c2\u6570\u3002<\/p>\n\n\n\n<p><strong>1. \u65b0\u5efa <code>api_requestor_mp.py<\/code> \u6587\u4ef6\uff0c\u5e76\u5199\u5165\u4ee5\u4e0b\u4ee3\u7801\u3002<\/strong><\/p>\n\n\n\n<pre class=\"wp-block-code\"><code># \u6ce8\u610f request_timeout \u53c2\u6570\u5df2\u7ecf\u6362\u4e86\uff0cOptional&#91;Union&#91;float, Tuple&#91;float, float]]] -&gt; Optional&#91;Union&#91;float, tuple]]\nasync def arequest_raw(\n        self,\n        method,\n        url,\n        session,\n        *,\n        params=None,\n        supplied_headers: Optional&#91;Dict&#91;str, str]] = None,\n        files=None,\n        request_id: Optional&#91;str] = None,\n        request_timeout: Optional&#91;Union&#91;float, tuple]] = None,\n) -&gt; aiohttp.ClientResponse:\n    abs_url, headers, data = self._prepare_request_raw(\n        url, supplied_headers, method, params, files, request_id\n    )\n    # \u5224\u65ad request_timeout \u7684\u7c7b\u578b\uff0c\u6309\u9700\u8bbe\u7f6e sock_read \u548c sock_connect \u5c5e\u6027\n    if isinstance(request_timeout, tuple):\n        timeout = aiohttp.ClientTimeout(\n            connect=request_timeout&#91;0],\n            total=request_timeout&#91;1],\n            sock_read=None if len(request_timeout) &lt; 3 else request_timeout&#91;2],\n            sock_connect=None if len(request_timeout) &lt; 4 else request_timeout&#91;3],\n        )\n    else:\n        timeout = aiohttp.ClientTimeout(\n            total=request_timeout if request_timeout else TIMEOUT_SECS\n        )\n    if files:\n        # TODO: Use aiohttp.MultipartWriter to create the multipart form data here.\n        # For now we use the private requests method that is known to have worked so far.\n        data, content_type = requests.models.RequestEncodingMixin._encode_files(  # type: ignore\n            files, data\n        )\n        headers&#91;\"Content-Type\"] = content_type\n    request_kwargs = {\n        \"method\": method,\n        \"url\": abs_url,\n        \"headers\": headers,\n        \"data\": data,\n        \"proxy\": _aiohttp_proxies_arg(openai.proxy),\n        \"timeout\": timeout,\n    }\n    try:\n        result = await session.request(**request_kwargs)\n        util.log_info(\n            \"OpenAI API response\",\n            path=abs_url,\n            response_code=result.status,\n            processing_ms=result.headers.get(\"OpenAI-Processing-Ms\"),\n            request_id=result.headers.get(\"X-Request-Id\"),\n        )\n        # Don't read the whole stream for debug logging unless necessary.\n        if openai.log == \"debug\":\n            util.log_debug(\n                \"API response body\", body=result.content, headers=result.headers\n            )\n            return result\n        except (aiohttp.ServerTimeoutError, asyncio.TimeoutError) as e:\n            raise error.Timeout(\"Request timed out\") from e\n        except aiohttp.ClientError as e:\n            raise error.APIConnectionError(\"Error communicating with OpenAI\") from e\n\ndef monkey_patch():\n    APIRequestor.arequest_raw = arequest_raw<\/code><\/pre>\n\n\n\n<p><strong>2. \u5728\u521d\u59cb\u5316 ChatGPT API \u7684\u6587\u4ef6\u5934\u90e8\u8865\u5145\uff1a<\/strong><\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>from *.*.api_requestor_mp import monkey_patch\n\ndo_api_requestor = monkey_patch<\/code><\/pre>\n\n\n\n<p>\u8bbe\u7f6e\u53c2\u6570 <code>request_timeout=(10, 300, 15, 10)<\/code> \u540e\uff0c\u518d\u8c03\u8bd5\u5c31\u6ca1\u4ec0\u4e48\u95ee\u9898\u4e86\u3002<\/p>\n\n\n\n<p>\u4ea4\u4ed8\u6d4b\u8bd5\uff0c\u901a\u8fc7\u3002<\/p>\n\n\n\n<h2>\u7ecf\u9a8c\u603b\u7ed3<\/h2>\n\n\n\n<ul><li>\u76f4\u63a5\u770b\u4ee3\u7801\u3001\u770b\u65b9\u6cd5\u8c03\u7528\u94fe\u8def\u4f1a\u6709\u70b9\u56f0\u96be\uff0c\u53ef\u4ee5\u901a\u8fc7\u5f02\u5e38\u5806\u6808\u6765\u627e\u8c03\u7528\u94fe\u8def\uff0c\u8fd9\u6837\u66f4\u65b9\u4fbf\u3002<\/li><li>ChatGPT API \u66b4\u9732\u7684 <code>request_timeout<\/code> \u53c2\u6570\u4e0d\u591f\u7528\uff0c\u9700\u8981\u91cd\u5199\uff1b\u641c\u7d22\u4e86\u4e00\u4e0b\u91cd\u5199\u65b9\u6848\uff0c\u4e86\u89e3\u5230 <code>monkey_patch<\/code>\uff0c\u975e\u5e38\u5b9e\u7528\u3002<\/li><li>\u9879\u76ee\u8fc7\u7a0b\u4e2d\uff0c\u7b14\u8005\u53d1\u73b0\u6539\u4ee3\u7801\u672c\u8eab\u4e0d\u96be\uff0c\u96be\u7684\u662f\u77e5\u9053\u300c\u6539\u54ea\u91cc\u300d\u300c\u600e\u4e48\u6539\u300d\u4ee5\u53ca\u300c\u4e3a\u4ec0\u4e48\u300d\u3002<\/li><\/ul>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<p>><strong>> LigaAI \u5f80\u671f\u7cbe\u5f69\u9605\u8bfb &lt;&lt;<\/strong><\/p>\n\n\n\n<p><a href=\"https:\/\/ligai.cn\/blog\/sharing\/1328.html\">\u5728 IDE \u63d2\u4ef6\u5f00\u53d1\u4e2d\u63a5\u5165 JCEF \u6846\u67b6 \u2013 LigaAI \u56e2\u961f\u535a\u5ba2 (ligai.cn)<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/ligai.cn\/blog\/%e7%a0%94%e5%8f%91%e7%ae%a1%e7%90%86\/1322.html\">\u51c6\u300cAI \u65f6\u4ee3\u300d\u4e0b\uff0c\u5982\u4f55\u8861\u91cf\u7a0b\u5e8f\u5458\u7684\u5de5\u4f5c\u6548\u7387\u548c\u751f\u4ea7\u529b\uff1f<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/ligai.cn\/blog\/%e7%a0%94%e5%8f%91%e7%ae%a1%e7%90%86\/1307.html\">\u751f\u6210\u5f0f AI \u5982\u4f55\u91ca\u653e\u5f00\u53d1\u8005\u7684\u751f\u4ea7\u529b\uff1f<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/ligai.cn\/blog\/%e7%a0%94%e5%8f%91%e7%ae%a1%e7%90%86\/1303.html\">\u65b0\u664b\u6280\u672f\u7ba1\u7406\u8005\u5982\u4f55\u63a8\u52a8\u7ec4\u7ec7\u53d8\u9769\uff1f<\/a><\/p>\n\n\n\n<h2><strong>\u6b22\u8fce\u8bd5\u7528&nbsp;<a href=\"https:\/\/ligai.cn\/\">LigaAI-\u667a\u80fd\u7814\u53d1\u534f\u4f5c\u5e73\u53f0<\/a>\uff0c\u4f53\u9a8c\u667a\u80fd\u7814\u53d1\u534f\u4f5c\uff0c\u4e00\u8d77\u53d8\u5927\u53d8\u5f3a\uff01<\/strong><\/h2>\n","protected":false},"excerpt":{"rendered":"<p>\u95ee\u9898\u91cd\u73b0 \u5728\u8c03\u7528 ChatGPT API \u5e76\u4f7f\u7528\u6d41\u5f0f\u8f93\u51fa\u65f6\uff0c\u6211\u4eec\u7ecf\u5e38\u4f1a\u9047\u5230\u7f51\u7edc\u95ee\u9898\u5bfc\u81f4\u7684\u8d85\u65f6\u60c5\u51b5\u3002\u6709\u8da3\u7684\u662f\uff0c\u7b14 &#8230; <a title=\"\u6280\u672f\u5206\u4eab | ChatGPT API \u8c03\u7528\u603b\u8d85\u65f6\uff1f\u89e3\u51b3\u65b9\u6848\u5728\u8fd9\" class=\"read-more\" href=\"https:\/\/ligai.cn\/blog\/sharing\/1334.html\" aria-label=\"\u7ee7\u7eed\u9605\u8bfb\u6280\u672f\u5206\u4eab | ChatGPT API \u8c03\u7528\u603b\u8d85\u65f6\uff1f\u89e3\u51b3\u65b9\u6848\u5728\u8fd9\">\u9605\u8bfb\u66f4\u591a<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[22],"tags":[15],"_links":{"self":[{"href":"https:\/\/ligai.cn\/blog\/wp-json\/wp\/v2\/posts\/1334"}],"collection":[{"href":"https:\/\/ligai.cn\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ligai.cn\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ligai.cn\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ligai.cn\/blog\/wp-json\/wp\/v2\/comments?post=1334"}],"version-history":[{"count":1,"href":"https:\/\/ligai.cn\/blog\/wp-json\/wp\/v2\/posts\/1334\/revisions"}],"predecessor-version":[{"id":1335,"href":"https:\/\/ligai.cn\/blog\/wp-json\/wp\/v2\/posts\/1334\/revisions\/1335"}],"wp:attachment":[{"href":"https:\/\/ligai.cn\/blog\/wp-json\/wp\/v2\/media?parent=1334"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ligai.cn\/blog\/wp-json\/wp\/v2\/categories?post=1334"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ligai.cn\/blog\/wp-json\/wp\/v2\/tags?post=1334"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}