-
Notifications
You must be signed in to change notification settings - Fork 282
Description
Is your feature request related to a problem? Please describe.
Fine-tuning for a Task that requires tool / function calls (as in these examples) is currently not supported.
Checks
- I've searched the docs for a solution
- I've searched for existing Github issues
Describe the solution you'd like
A rough idea of what that would likely involve:
Task
-level (orProject
-level) definedtools
where we define the tools and their schemas, etc.- The Runs would display tool calls in some way and probably allow editing to correct incorrect tool calls
Describe alternatives you've considered
Not using tools 😄
Additional context
It seems like fine-tuning would be helpful for cases where tool usage depends on nuanced / semi-subjective context. For example, in a RAG setup, a model may need to decide whether to query a vector database or generate an answer directly based on context. Fine-tuning could help improve when and how it makes this decision.
Found this cookbook by OpenAI on fine-tuning for Function Calling: https://cookbook.openai.com/examples/fine_tuning_for_function_calling