Recently, I created a service that execute a set of prompts to support a classification task. Since this type of task involves processing numerous records simultaneously, performance is critical.