Tool use not returning an reply (no text deltas)

[benorudolf]

I've recently updated the package to v5 and have unfortunately encountered some issues.

My setup consists of an LLM call using the streamText method with several tools available for the LLM. I provide a system prompt and the user message/s and the LLM responds. This is used as a chat app on the frontend.
In the previous version I had set max steps at 8 and the LLM was capable to decide which tools to call and come up with a good answer.

With the v5 version, I mostly get 1-2 tool calls and then it finishes (successfully) with no response. In the logs I don't see any text-delta chunks anymore, just all the new tool-* chunk types that have been added. The finish chunk always has the finishReason: tool-calls. I've replaced the maxSteps param with stopWhen: [stepCountIs(8)] but that didn't really help.

I've re-read the docs and scoured the discussions multiple times now and can't seem to find any information.
Based on the docs - with the weather example - the LLM should provide a text response as part of step 2 after the initial step 1 tool call, when there are more step counts set. But in my case it finishes after the first or sometimes second tool call with no response.

If I give it a user message where I know it won't call any tools (generic "hi there"), it responds nicely and I can see the text-delta chunks nicely in the logs.

Any help or guidance would be really appreciated 🙏

[benorudolf]

As I submitted this it occurred to me that I may have an overwrite issue with my config. And indeed it was. My stopWhen param was being overwritten and because the default is set to [stepCountIs(1)] it was behaving exactly as it should.

So to anyone facing a similar issue - make sure you stopWhen is set correctly!

Apologies for the support spam 🙏

[github-actions[bot]]

This discussion was automatically locked because it has not been updated in over 30 days. If you still have questions about this topic, please ask us at community.vercel.com/ai-sdk