It depends on the benchmark. Most of the benchmarks I ran are multiple choice questions over a variety of domains like science, law, math, history, etc. IFEval is a benchmark on instruction following where questions are like "Write a joke about morphology that’s professional and includes the word ”cat” at least once, and the word ”knock” at least twice. Wrap your whole response with double quotation marks."

I also included the speed benchmarks but those are just how fast it processes a prompt (very slow typically on Mac) and how fast it generates a response.