Story perspectives

Omniwise: New Tool Predicts GPU Performance with 90% Accuracy

6/30/2025

28 5

Summary

Story summary

Researchers at the University of Illinois and AMD created Omniwise, a system that predicts GPU kernel performance using large language models.
Omniwise boasts over 90% accuracy with a 10% error margin on AMD’s MI250 and MI300X architectures.
It estimates crucial metrics such as memory bandwidth and arithmetic intensity, helping developers pinpoint performance issues.
Future updates aim to include power consumption predictions and integration with current performance analysis tools for better optimization.

1 of 1

Story summary

Researchers at the University of Illinois and AMD created Omniwise, a system that predicts GPU kernel performance using large language models.
Omniwise boasts over 90% accuracy with a 10% error margin on AMD’s MI250 and MI300X architectures.
It estimates crucial metrics such as memory bandwidth and arithmetic intensity, helping developers pinpoint performance issues.
Future updates aim to include power consumption predictions and integration with current performance analysis tools for better optimization.