在910B部署DeepSeek后,无法使用Function Call
参考官方给的请求示例:
{
"model": "GK-DeepSeek-V3",
"messages": [
{
"role": "user",
"content": "Hi, can you tell me the delivery date for my order? my order number is 999888"
}
],
"stream": false,
"repetition_penalty": 1.1,
"temperature": 0.6,
"top_p": 0.9,
"max_tokens": 9000,
"tools": [
{
"type": "function",
"function": {
"name": "get_delivery_date",
"description": "Get the delivery date for a customer's order. Call this whenever you need to know the delivery date, for example when a customer asks 'Where is my package'",
"parameters": {
"type": "object",
"properties": {
"order_id": {
"type": "string",
"description": "The customer's order ID."
}
},
"required": [
"order_id"
],
"additionalProperties": false
}
}
}
],
"tool_choice": "required"
}
==================
回复:
{
"id": "endpoint_common_342",
"object": "chat.completion",
"created": 1751456543,
"model": "GK-DeepSeek-V3",
"choices": [
{
"index": 0,
"message": {
"role": "assistant",
"tool_calls": null,
"content": "I’m unable to check specific order details or delivery dates directly since I don’t have access to external databases or order tracking systems. \n\nTo find your delivery date: \n1. **Check your email** – Look for a confirmation or shipping notification from the retailer (search for \"order 999888\"). \n2. **Visit the store's website/app** – Log in to your account and track the order status there. \n3. **Contact customer service** – Use the support options on the retailer’s website for real-time updates. \n\nIf you share the name of the store/company, I can guide you further! Let me know how else I can help. 😊"
},
"logprobs": null,
"finish_reason": "stop"
}
],
"usage": {
"prompt_tokens": 24,
"completion_tokens": 141,
"total_tokens": 165
},
"prefill_time": 71
}
参考官方给的请求示例:
{
"model": "GK-DeepSeek-V3",
"messages": [
{
"role": "user",
"content": "Hi, can you tell me the delivery date for my order? my order number is 999888"
}
],
"stream": false,
"repetition_penalty": 1.1,
"temperature": 0.6,
"top_p": 0.9,
"max_tokens": 9000,
"tools": [
{
"type": "function",
"function": {
"name": "get_delivery_date",
"description": "Get the delivery date for a customer's order. Call this whenever you need to know the delivery date, for example when a customer asks 'Where is my package'",
"parameters": {
"type": "object",
"properties": {
"order_id": {
"type": "string",
"description": "The customer's order ID."
}
},
"required": [
"order_id"
],
"additionalProperties": false
}
}
}
],
"tool_choice": "required"
}
==================
回复:
{
"id": "endpoint_common_342",
"object": "chat.completion",
"created": 1751456543,
"model": "GK-DeepSeek-V3",
"choices": [
{
"index": 0,
"message": {
"role": "assistant",
"tool_calls": null,
"content": "I’m unable to check specific order details or delivery dates directly since I don’t have access to external databases or order tracking systems. \n\nTo find your delivery date: \n1. **Check your email** – Look for a confirmation or shipping notification from the retailer (search for \"order 999888\"). \n2. **Visit the store's website/app** – Log in to your account and track the order status there. \n3. **Contact customer service** – Use the support options on the retailer’s website for real-time updates. \n\nIf you share the name of the store/company, I can guide you further! Let me know how else I can help. 😊"
},
"logprobs": null,
"finish_reason": "stop"
}
],
"usage": {
"prompt_tokens": 24,
"completion_tokens": 141,
"total_tokens": 165
},
"prefill_time": 71
}