Hi,
I am encountering too many 504 deadline exceeded messages — maybe half of my requests.
I would like to implement exponential backoff. There is an @backoff function decorator available in OpenAI. How do I achieve this in gemini?
Using google-generativeai v 0.62, gemini pro 1.5.
Just something to surround:
try:
response = model.generate_content(prompt)
except Exception as e:
errormsg = traceback.print_exc()
logging.error(f"error generating content: {errormsg}")