How to use the same “user” part of the API object in all requests without releating it? – API


I want to reduce the tokens that I have to pay for the consequest aquestions.
So I want to pay for the user object only once.
And then pay only for the tokens in the prompt.
Is there a method to do it?

Hi and welcome to the Developer Forum!

Unfortunately not, current generation LLM’s are “stateless”, that is, they have no memory of past events and must be transferred all relevant context for each API call.



1 Like



Source link

Leave a Comment