Repeated inference in practice

We use LLMs to identify which elements on a website are most relevant for changes based on a specific marketing strategy. This is a complex task, and due to the size of the prompt, the structured output from the LLM can sometimes be unstable and may lack precision and recall. By running multiple inferences and combining and reranking the outputs, we can achieve better stability and quality in the results.