Define the Workload Before Choosing a Model

A model comparison is only meaningful when the workload is defined. “Summarize documents” is too broad. A useful workload description names the input, expected output, approximate input size, response time requirement, expected usage pattern, and consequence of an incorrect answer.…