Automatic Feature Generation for Machine Learning Based Optimizing Compilation

H. Leather, E. Bonilla, M. O'Boyle

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Recent work has shown that machine learning can automate and in some cases outperform hand crafted compiler optimizations. Central to such an approach is that machine learning techniques typically rely upon summaries or features of the program. The quality of these features is critical to the accuracy of the resulting machine learned algorithm; no machine learning method will work well with poorly chosen features. However, due to the size and complexity of programs, theoretically there are an infinite number of potential features to choose from. The compiler writer now has to expend effort in choosing the best features from this space. This paper develops a novel mechanism to automatically find those features which most improve the quality of the machine learned heuristic. The feature space is described by a grammar and is then searched with genetic programming and predictive modeling. We apply this technique to loop unrolling in GCC 4.3.1 and evaluate our approach on a Pentium 6. On a benchmark suite of 57 programs, GCC's hard-coded heuristic achieves only 3% of the maximum performance available, while a state of the art machine learning approach with hand-coded features obtains 59%. Our feature generation technique is able to achieve 76% of the maximum available speedup, outperforming existing approaches.
Original languageEnglish
Title of host publicationCode Generation and Optimization, 2009. CGO 2009. International Symposium on
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Number of pages11
ISBN (Print)978-0-7695-3576-0
Publication statusPublished - 1 Mar 2009

Fingerprint Dive into the research topics of 'Automatic Feature Generation for Machine Learning Based Optimizing Compilation'. Together they form a unique fingerprint.

Cite this