Tichenor, S., & Reuther, A. (2006). CTWatch Quarterly » Making the Business Case for High Performance Computing: A Benefit-Cost Analysis Methodology (tech. rep.). https://icl.utk.edu/ctwatch/quarterly/articles/2006/11/making-the-business-case-for-high-performance-computing-a-benefit-cost-analysis-methodology/index.html

Apon, Amy and Ahalt, Stanley and Dantuluri, Vijay and Gurdgiev, Constantin and Limayem, Moez and Ngo, Linh and Stealey, Michael, High Performance Computing Instrumentation and Research Productivity in U.S. Universities (September 19, 2010). Journal of Information Technology Impact, Vol. 10, No. 2, pp. 87-98, 2010, Available at SSRN: https://ssrn.com/abstract=1679248

Adam G. Carlyle, Stephen L. Harrell, and Preston M. Smith. 2010. Cost-Effective HPC: The Community or the Cloud? In Proceedings of the 2010 IEEE Second International Conference on Cloud Computing Technology and Science (CLOUDCOM ’10). IEEE Computer Society, USA, 169–176. https://doi.org/10.1109/CloudCom.2010.115

Joseph, E. C., Dekate, C., & Conway, S. (2013). Creating Economic Models Showing the Relationship Between Investments in HPC and the Resulting Financial ROI and Innovation — and How It Can Impact a Nation’s Competitiveness and Innovation (tech. rep.). IDC. https://www.osti.gov/servlets/purl/1156830

Ludwig, T. (2012). The costs of HPC-based science in the exascale era. Proceedings – 2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012, 2120–2188. https://doi.org/10.1109/SC.COMPANION.2012.355

Berente, Nicholas and Howison, James and King, John L. and Cutcher-Gershenfeld, Joel and Pennington, Robert, Leading Cyberinfrastructure Enterprise: Value Propositions, Stakeholders, and Measurement (March 26, 2014). Available at SSRN: https://ssrn.com/abstract=2416247 or http://dx.doi.org/10.2139/ssrn.2416247

Newby G, Apon A, Berente N, Eigenmann R, Fratkin S, Lifka D, Stewart C. Return on Investment from Academic Supercomputing: SC14 Panel. Technical report November. 2014. https://scholarworks.iu.edu/dspace/bitstream/handle/2022/19242/roi-sc14.pdf?sequence=1 &isAllowed=y.

Council on Competitiveness. (2014). Solve: The Exascale Effect: the Benefits of Supercomputing Investment for U.S. Industry (tech. rep.). Council on Competitiveness. https://www.compete.org/reports/all/2695

Johnson, R., Steliaros, R., & O’Brien, C. (2014). The impact of HECToR. https://doi.org/10.5281/ZENODO.1445286

Apon AW, Ngo LB, Payne ME, Wilson PW. Assessing the effect of high performance computing capabilities on academic research output. Empir Econ. 2015;48(1):283–312. https://doi.org/10.1007/s00181-014-0833-7.

C. A. Stewart et al., “Return on Investment for Three Cyberinfrastructure Facilities: A Local Campus Supercomputer, the NSF-Funded Jetstream Cloud System, and XSEDE (the eXtreme Science and Engineering Discovery Environment),” 2018 IEEE/ACM 11th International Conference on Utility and Cloud Computing (UCC), Zurich, Switzerland, 2018, pp. 223-236, doi: 10.1109/UCC.2018.00031.

Stewart CA, Apon A, Payne R, Slavin SD, Hancock DY, Wernert J, Furlani T, Lifka D, Sill A, Berente N, McMullen DF, Cheatham T. Assessment of financial returns on investments in cyberinfrastructure facilities. In: Proceedings of the practice and experience in advanced research computing on rise of the machines (learning)—PEARC ’19. New York: ACM Press; 2019. pp. 1–8. https://doi.org/10.1145/3332186.3332228 . http://dl.acm.org/citation.cfm?doid=3332186.3332228.

Craig A. Stewart, Amy Apon, David Y. Hancock, Thomas Furlani, Alan Sill, Julie Wernert, David Lifka, Nicholas Berente, Thomas Cheatham, and Shawn D. Slavin. 2019. Assessment of non-financial returns on cyberinfrastructure: A survey of current methods. In Proceedings of the Humans in the Loop: Enabling and Facilitating Research on Cloud Computing (HARC '19). Association for Computing Machinery, New York, NY, USA, Article 2, 1–10. https://doi.org/10.1145/3355738.3355749

Smith P, Harrell SL, Younts A, Zhu X. Community clusters or the cloud: continuing cost assessment of on-premises and cloud HPC in higher education. In: Proceedings of the practice and experience in advanced research computing on rise of the machines (Learning). PEARC ’19, New York: ACM; 2019; pp. 97–1974. https://doi.org/10.1145/3332186.3333155.

Snell, Addison (2020). ROI: Is HPC Worth It? What Can We Actually Measure? https://www.hpcwire.com/2020/10/15/roi-is-hpc-worth-it-what-can-we-actually-measure/

Rajamohan S, Settlage RE. Informing the on/off-prem cloud discussion in higher education. In: Practice and Experience in Advanced Research Computing. New York: Association for Computing Machinery; 2020. pp. 64–71. https://doi.org/10.1145/3311790.3396627.

Chalker A, Hillegas CW, Sill A, Broude Geva S, Stewart CA. Cloud and on-premises data center usage, expenditures, and approaches to return on investment: a survey of academic research computing organizations. In: Practice and experience in advanced research computing. PEARC ’20. New York: Association for Computing Machinery; 2020. pp. 26–33. https://doi.org/10.1145/3311790.3396642.

Broude Geva S, Chalker A, Hillegas C, Petravick D, Sill A, Stewart C. Results from a second longitudinal survey of academic research computing and data center usage: expenditures, utilization patterns, and approaches to return on investment. In: Practice and experience in advanced research computing. PEARC ’21. New York: Association for computing machinery; 2021. https://doi.org/10.1145/3437359.3465589

Preston Smith. 2022. Measuring the Relative Outputs of Computational Researchers in Higher Education. In Practice and Experience in Advanced Research Computing 2022: Revolutionary: Computing, Connections, You (PEARC ’22). Association for Computing Machinery, New York, NY, USA, Article 21, 1–7. https://doi.org/10.1145/3491418.3530764

Craig Stewart, Julie Wernert, Claudia Costa, David Y. Hancock, Richard Knepper, and Winona Snapp-Childs. 2022. Return on Investment in Research Cyberinfrastructure: State of the Art. In Practice and Experience in Advanced Research Computing 2022: Revolutionary: Computing, Connections, You (PEARC ’22). Association for Computing Machinery, New York, NY, USA, Article 60, 1–4. https://doi.org/10.1145/3491418.3535131

Praneeth Chityala, Claudia Costa, Julie Wernert, and Craig Stewart. 2022. Cyberinfrastructure value: a survey on perceived importance and usage. In Practice and Experience in Advanced Research Computing 2022: Revolutionary: Computing, Connections, You (PEARC ’22). Association for Computing Machinery, New York, NY, USA, Article 30, 1–4. https://doi.org/10.1145/3491418.3535173

Stewart, C.A., Costa, C.M., Wernert, J.A. et al. Use of accounting concepts to study research: return on investment in XSEDE, a US cyberinfrastructure service. Scientometrics 128, 3225–3255 (2023). https://doi.org/10.1007/s11192-022-04539-8

Arora, R., Sondhi, S. Towards Developing an Open-Infrastructure for Assessing the Progress, Success, and Impacts of CyberInfrastructure Projects. SN COMPUT. SCI. 5, 617 (2024). https://doi.org/10.1007/s42979-024-02961-8

Snapp-Childs, W.G., Hart, D.L., Costa, C.M. et al. Evaluating Return on Investment for Cyberinfrastructure Using the International Integrated Reporting <IR> Framework. SN COMPUT. SCI. 5, 558 (2024). https://doi.org/10.1007/s42979-024-02889-z

Smith, P. The Value Proposition of Campus High Performance Computing Facilities to Institutional Productivity: A Production Function Model. SN COMPUT. SCI. 5, 551 (2024). https://doi.org/10.1007/s42979-024-02888-0

Preston M. Smith, James Wilgenbusch, Winona Snapp-Childs, Brian W. O’Shea, David Y. Hancock, Jill Gemmill.  Application of the Cyberinfrastructure Production Function Model to R1 Institutions. Frontiers in Research Metrics and Analytics, Volume 10 DOI: 10.3389/frma.2025.1449996

Shu, P., Chen, J., Liu, Z., Zhao, H., Li, X., & Liu, T. (2025). Survey of HPC in US Research Institutions. https://doi.org/10.48550/arXiv.2506.19019

Hubbart, J. A. (2025). The Computational Pivot: Turning Fiscal Austerity into Research Advantage at Public Universities. IOSR Journal of Research & Method in Education (IOSR-JRME) , 15(4), 19–29. https://doi.org/10.9790/7388-1504011929

Hubbart, J. A. (2025). Aligning the United States Land-Grant Institution Research Enterprise with Modern Computational Research Needs. IOSR Journal of Research & Method in Education (IOSR-JRME), 15(4), 8–18. https://doi.org/10.9790/7388-1504010818

Snapp-Childs, Winona G., Hancock,  David Y., Smith, Preston M., Towns,  John, & Stewart, C. (2025). Assessing the Value of Advanced Computing Infrastructure for Supporting Research: New Tools to Inform Research Policy. https://doi.org/10.2139/SSRN.5132558

ROI