Should we display which precision was used in which results? #851
Description
Some people in the committee felt that having precision associated with each result helps everyone to understand which results were say fp4 and which ones are fp8.
But others feel that sharing information about the precision is information they may not want to disclose. And that its more of an implementation detail. Also RFPs may ask for say fp8 numbers but now, providers can share fp4 mlperf numbers since its faster. But stating explicitly that its fp4 or fp8 might make things complicated.