在发现Intel oneAPI DPC++编译器通过有针对性的优化有效地按照他们的标准作弊后,SPEC实际上已经使2000多个SPEC CPU 2017基准测试提交无效。
今天有很多人写了一些关于SPEC CPU的文章, 意见书现在带着这个编译器通知:
“SPEC已裁定,用于此结果的编译器正在执行编译,该编译使用SPEC代码和数据集的先验知识来执行具有很小适用性的转换,从而专门提高523.xalancbmk_r/623.xalancbmk_S基准的性能。
为了鼓励具有广泛适用性的优化(参见规则1.4),https://www.spec.org/cpu2017/Docs/runrules.html#rule_1.4),SPEC将不再发布使用此优化的结果。
此结果保留在SPEC结果数据库中以供历史参考。“
使用英特尔oneAPI DPC++编译器进行此优化后,似乎有2000~2500份提交受到影响。
What I've heard is that Intel oneAPI 2022.0 through 2023.0 are affected by this outlawed compiler optimization. So the very latest post-2023.0 are okay according to the SPEC rules as well as the pre-2022 data. In the benchmark test targeted by this compiler optimization it could increase the result by more than 50%. In the grand scheme of things for the overall SPECint scoring could be impacted by several percentage points.