Business GPT API question.

[Publisher Bucks]

When it comes to utilizing the ChatGPT API, what is considered a 'good' ratio of requests/tokens?

Is 43 requests to 7434 tokens okay or can that be improved?

Is there even such a thing?

[2MuchMark]

It probably depends on your usecase, but why not just run an LLM on your local machine instead? Its probably faster depending on your hardware, dIt's efinately private, and its pretty f'in cool too..

[Publisher Bucks]

It probably depends on your usecase, but why not just run an LLM on your local machine instead? Its probably faster depending on your hardware, dIt's efinately private, and its pretty f'in cool too..

It's not something being utilized locally, it's a program that has been developed for our writers to use (who are spread out across the globe) in this instance its just easier how we have it setup.