Related Experiment Video
Updated: May 11, 2025

05:30
Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit
Published on: September 8, 2023
455
Benchmarking the performance of quantum computing software for quantum circuit creation, manipulation and compilation
Paul D Nation1, Abdullah Ash Saki2, Sebastian Brandhofer3
1IBM Quantum, IBM T. J. Watson Research Center, Yorktown Heights, NY, USA. paul.nation@ibm.com.
Nature Computational Science
|April 18, 2025
Summary
Benchpress is a new tool for testing quantum computing software. It evaluates performance and functionality across various quantum software development kits, aiding in the assessment of quantum circuit processing costs.
Area of Science:
- Quantum Computing
- Software Engineering
Background:
- Quantum computing software development kits (SDKs) are rapidly evolving.
- Standardized performance evaluation is crucial for tracking progress and identifying bottlenecks.
Purpose of the Study:
- To introduce Benchpress, a comprehensive benchmarking suite for quantum computing SDKs.
- To provide a unified framework for evaluating performance and functionality.
Main Methods:
- Developed a suite of over 1,000 tests for quantum circuit operations.
- Included tests for circuits up to 930 qubits and O(10^6) two-qubit gates.
- Created an execution framework for standardized testing across multiple SDKs.
Main Results:
- Generated representative performance results for seven different quantum software packages.
- Demonstrated Benchpress's capability to measure key performance metrics.
- Highlighted the flexibility of the framework for ongoing evaluation.
Conclusions:
- Benchpress offers a flexible and scalable solution for benchmarking quantum computing software.
- The suite can keep pace with hardware improvements and predict future circuit processing costs.
- Enables informed selection and development of quantum computing tools.

