You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
I saw the current implementation of Groq and Mistral Client doesn't print chunk to IOStream when in stream mode. And I observed that in Gemini and Together Client there are comments to describe why they can't be stream or will do in the future. I wonder is there something blocking print chunk to IOStream in Groq or Mistral Client, or just missing the implementation?
For myself, I manually add logic to print chunk to IOStream for GroqClient and it seems works well, with groq == 0.9.0, maybe we can also add the logic to MistralClient ?
Describe the solution you'd like
No response
Additional context
No response
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
I saw the current implementation of Groq and Mistral Client doesn't print chunk to IOStream when in stream mode. And I observed that in Gemini and Together Client there are comments to describe why they can't be stream or will do in the future. I wonder is there something blocking print chunk to IOStream in Groq or Mistral Client, or just missing the implementation?
For myself, I manually add logic to print chunk to IOStream for GroqClient and it seems works well, with
groq == 0.9.0
, maybe we can also add the logic to MistralClient ?Describe the solution you'd like
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: