How to identify end of sentence while streaming? – ChatGPT


I am trying to have sentences streamed from backend to frontend. OpenAI LLM streaming has chunks and not sentences. I can join chunks until a sentence is formed but not sure how to know once a sentence is formed. Pls let me know if there are any external libs that can help with the same.



Source link

Leave a Comment