Open Ai API very slow response.

Lately, the response from the OpenAI API has been very slow. In one step, I have two API requests, and what used to be fast is now very slow. I am using the GPT-4o version. Any suggestions to make the response faster? Thanks

Hello @Jorge,

Thanks for sharing the details. The response time in this case is entirely dependent on the OpenAI API itself. Since the execution speed is managed on OpenAI’s end, we do not have control over the processing time. You may experience variations depending on their server load and response capacity at the given moment.

I have another question, how much information can you process? I am trying to process approximately 160 Google reviews from a sheet to transfer them to a document, but it keeps loading for a long time. What version do you recommend? Im susin chat gpt 4o right now.

In Pabbly Connect, you can pass data of no more than 250,000 characters in length, but that’s not the issue here.
https://forum.pabbly.com/threads/maximum-character-length.10600/

The issue is related to OpenAI not being able to process the large amount of data in sufficient time. You can try adding an Iterator to your workflow after 'Get Row(s)' action step. This will help you pass each review individually to OpenAI, so it can process it, then append the data in your Google Doc. You may need to setup the workflow in this manner.
https://connect.pabbly.com/workflow/mapping/IjU3NjYwNTY1MDYzMDA0M2M1MjY1NTUzNzUxMzEi_pc

youtube.com/watch?v=zJaGQ-SIB0I

Thanks & Regards,
Arshil Ahmad
Customer Support Associate
? Pabbly.com
?Rate your support