This report compares seven solvers on fixed quadratic programs from robotic control and humanoid trajectory optimization. It measures complete solver calls and independently checks returned solutions against the original problem. The GTSAM entries are Dense Dual, Sparse Dual, and the direct Gaussian augmented Lagrangian solver with QR disabled.
Dense Dual and Sparse Dual certify all 256 MPC combinations. DAQP is fastest on the small MPC families; Dense Dual is the strongest GTSAM option there. Larger G1 problems favor different sparse methods. The plots count failures instead of rewarding fast unsuccessful returns. Interactive charts require an internet connection to load Plotly 3.1.0.
The 64 public MPC problems run at four settings, producing 256 combinations per solver. Default uses each solver’s native tolerances and an external acceptance threshold of 1.0; it is not an equal-accuracy comparison. The other settings request absolute tolerances of 1e-3, 1e-6, or 1e-9, and use that threshold for the external certificate. A certificate requires native success, finite original-QP primal and stationarity residuals, absolute duality gap, and correctly signed inequality multipliers.
Each MPC combination receives an initial call and five fresh repetitions. Timings are medians of those five repetitions. Profiles use a case only if all six calls certify; all 64 cases remain in each denominator (four in QUAD-only profiles). The horizontal axis is time divided by the fastest certified solver for that case. A curve reaching farther left is faster; a curve ending lower has more failures.
GTSAM timing starts with assembled native factors, before solver construction, and includes setup, ordering, equality handling, initialization, optimization, multiplier recovery and output conversion. Input matrix-to-factor translation and independent scoring are excluded. External solvers retain their upstream matrix-input setup and solve boundaries. Cold starts and fresh solver caches are used throughout. MPC calls run serially on CPU 0, with one TBB/numerical thread and a 10-second native watchdog; profiling is disabled.
ALM uses the direct Gaussian solver with params.lmParams.multifrontalParams.qrMode = QRMode::Off, BCL defaults, 20 outer and 100 inner iterations, and no added objective regularization. Explicit MPC accuracies change its absolute violation and stationarity tolerances. Both dual GTSAM solvers use requested proximal weight 1e-9 on MPC and zero additional regularization on G1. DAQP keeps its native selective proximal treatment of weak curvature. WALK/BAL use vector blocks; QUAD retains state/contact blocks.
QR-off ALM was measured on November 8 with 1,536 MPC calls. Dense Dual, Sparse Dual and DAQP use the corresponding November 8 campaign; ProxQP, Clarabel and OSQP retain November 7 measurements on the same inputs and hardware. The source campaigns and fingerprints are recorded below; this report edit does not claim that every solver was rerun together.
| Solver | Default | 1e-3 | 1e-6 | 1e-9 | Total / 256 |
|---|---|---|---|---|---|
| DAQP | 64 | 64 | 60 | 60 | 248 |
| GTSAM Dense Dual | 64 | 64 | 64 | 64 | 256 |
| GTSAM Sparse Dual | 64 | 64 | 64 | 64 | 256 |
| ProxQP | 64 | 46 | 63 | 62 | 235 |
| Clarabel | 64 | 64 | 64 | 64 | 256 |
| OSQP | 64 | 64 | 60 | 59 | 247 |
| GTSAM ALM (QR off) | 64 | 41 | 57 | 60 | 222 |
The certificate includes multiplier signs as well as the benchmark’s residual and gap checks. In particular, ProxQP passes 235/256 with the sign check, versus 253/256 under the published checks alone. ALM passes 222/256: 64 at Default, 41 at 1e-3, 57 at 1e-6, and 60 at 1e-9. Native convergence alone does not imply a certificate.
Default family times below are medians of per-case five-repeat medians, restricted to cases that certify in all calls. Parentheses give the number of cases included; families with different failure counts do not describe the same successful subset.
| Default family / ms (certified cases) | DAQP | GTSAM Dense Dual | GTSAM Sparse Dual | ProxQP | Clarabel | OSQP | GTSAM ALM (QR off) |
|---|---|---|---|---|---|---|---|
| LIPMWALK | 0.037 (30) | 0.095 (30) | 0.137 (30) | 0.135 (30) | 0.271 (30) | 0.351 (30) | 0.195 (30) |
| WHLIPBAL | 0.059 (30) | 0.192 (30) | 0.192 (30) | 0.302 (30) | 0.685 (30) | 0.477 (30) | 0.316 (30) |
| QUADCMPC | 7.992 (4) | 18.703 (4) | 8.378 (4) | 27.790 (4) | 3.035 (4) | 2.955 (4) | 9.817 (4) |
Hatched timing bars denote combinations with at least one failed certificate. They remain visible to distinguish fast inaccurate answers from slow successful solves; they do not contribute as successes to the profiles.
These are three fixed application QPs, with 18,549 to 193,566 variables. G1 calls use up to eight TBB/solver threads on CPUs 0–7, one numerical-library thread, a 300-second watchdog and a 16 GiB memory cap. External solvers retain their recorded supported thread settings; OSQP uses its serial sparse backend. Objective factors, original inverse sigmas and application damping are preserved. No additional objective regularization is added. All original feasibility, stationarity, sign and absolute-gap thresholds are 1e-7; complementarity is recorded separately.
The table uses primary complete-call times, not medians. GTSAM times exclude native factor reconstruction; external setup/solve times exclude separately recorded Hessian conversion. Five additional G1SP20 observations are available in the JSON for the retained successful external and Sparse Dual calls; other G1 results are single observations. Watchdog entries are censored lower bounds, never completed solves. DAQP was not run on G1.
| Capture | Solver | Primary seconds | Original certificate / outcome | Absolute gap |
|---|---|---|---|---|
| G1SP20 | DAQP | — | not run | — |
| G1SP20 | GTSAM Dense Dual | — | memory_limit | — |
| G1SP20 | GTSAM Sparse Dual | 3.697 | certified | 1.68e-13 |
| G1SP20 | ProxQP | 1.002 | certified | 1.57e-08 |
| G1SP20 | Clarabel | 2.555 | certified | 2.83e-08 |
| G1SP20 | OSQP | 5.584 | certified | 7.41e-08 |
| G1SP20 | GTSAM ALM (QR off) | 42.154 | failed certificate | 2e-07 |
| G1CMCTWO | DAQP | — | not run | — |
| G1CMCTWO | GTSAM Dense Dual | — | memory_limit | — |
| G1CMCTWO | GTSAM Sparse Dual | 25.504 | certified | 8.54e-13 |
| G1CMCTWO | ProxQP | ≥300.001 | watchdog_timeout | — |
| G1CMCTWO | Clarabel | 14.489 | certified | 2.11e-08 |
| G1CMCTWO | OSQP | 22.504 | certified | 9.44e-08 |
| G1CMCTWO | GTSAM ALM (QR off) | 12.308 | certified | 1.88e-08 |
| G1SPFULL | DAQP | — | not run | — |
| G1SPFULL | GTSAM Dense Dual | — | memory_limit | — |
| G1SPFULL | GTSAM Sparse Dual | ≥300.001 | watchdog_timeout | — |
| G1SPFULL | ProxQP | ≥300.001 | watchdog_timeout | — |
| G1SPFULL | Clarabel | 42.293 | certified | 3.85e-09 |
| G1SPFULL | OSQP | 101.755 | certified | 9.77e-08 |
| G1SPFULL | GTSAM ALM (QR off) | ≥300.000 | watchdog_timeout | — |
Dense Dual exceeds the memory cap on all three captures. QR-off ALM certifies G1CMCTWO in 12.308 seconds; its G1SP20 return takes 42.154 seconds but fails the absolute-gap threshold. The failed gap is about 2e-7 against a 1e-7 limit. These outcomes remain failures in the comparison.
| Dataset | Cases | Variables | Equalities | Inequality rows | Finite bound sides |
|---|---|---|---|---|---|
| LIPMWALK | 30 | 16 | 0 | 32 | 0 |
| WHLIPBAL | 30 | 50 | 0 | 100 | 0 |
| QUADCMPC1 | 1 | 768 | 384 | 512 | 512 |
| QUADCMPC2 | 1 | 576 | 288 | 384 | 384 |
| QUADCMPC3 | 1 | 384 | 192 | 256 | 128 |
| QUADCMPC4 | 1 | 384 | 192 | 256 | 256 |
| G1SP20 | 1 | 18549 | 0 | 230 | 0 |
| G1CMCTWO | 1 | 106836 | 0 | 378 | 0 |
| G1SPFULL | 1 | 193566 | 0 | 2437 | 0 |
| Solver | Method | Configuration |
|---|---|---|
| DAQP | Dual active set | Recursive LDLᵀ updates; dense MPC only; version 0.8.7 uses selective proximal regularization for weak curvature |
| GTSAM Dense Dual | Dual active set | Native positive-definite Hessian Cholesky when eligible; equality reduction and square-root fallback otherwise; LDLᵀ working updates, original-coordinate refinement and KKT checks; MPC and G1, with retained G1 timings |
| GTSAM Sparse Dual | Dual active set | Zero-multiplier cold start; equality elimination through cached sparse constrained solves; working LDLᵀ updates and original-coordinate refinement; proximal weight 1e-9 on MPC, zero additional regularization on G1; MPC and G1 |
| ProxQP | Proximal primal-dual augmented Lagrangian | Solves regularized subproblems with semismooth Newton inner iterations |
| Clarabel | Interior point | Primal-dual interior-point steps toward the constrained optimum |
| OSQP | Operator splitting (ADMM) | Alternates linear-system solves and projections onto constraint bounds |
| GTSAM ALM (QR off) | Augmented Lagrangian | Direct Gaussian AugmentedLagrangianSolver; BCL updates, LM inner solves, COLAMD, QRMode::Off; zero initial values. |
The MPC input snapshot is qpsolvers/mpc_qpbenchmark revision 954906ac1f48b77e84a5bc314b7c2f00fb0d4ebc. All 64 input checksums and all three private G1 manifests were verified. Benchmark drivers, private captures and raw per-call data remain in the ignored benchmark workspace. Download the per-case aggregates and provenance JSON.
{
"date": "2026-11-08",
"branch": "codex/alm-qp-investigation",
"base_revision": "3ea2fe19f3b776c8de2716a658b06b4113a0e187",
"uncommitted": true,
"hardware": "Intel Core i7-14700F, 28 logical CPUs, 31 GiB RAM",
"build": "Release, GCC 13.3.0, C++17, TBB",
"versions": {
"numpy": "2.5.4",
"scipy": "1.18.1",
"qpsolvers": "4.13.0",
"qpbenchmark": "2.7.0",
"clarabel": "0.11.1",
"osqp": "1.1.3",
"proxsuite": "0.7.3",
"daqp": "0.8.7"
},
"dataset": {
"source": "https://github.com/qpsolvers/mpc_qpbenchmark",
"commit": "954906ac1f48b77e84a5bc314b7c2f00fb0d4ebc",
"file_sha256": {
"LIPMWALK0.npz": "2f23a3a57f9fd750fa23d33c999307c88b6d42b9f51b9d696fc1f9807e7b9e4a",
"LIPMWALK1.npz": "7cce741507fb4bc090849f7557bd51cea8f131a80db53aa0e9141224608cee44",
"LIPMWALK10.npz": "06d0612ecda4cdbe1382c916853ef56eb4abfb53f8502b073fb156dc08ddf61f",
"LIPMWALK11.npz": "6dfad4ae9d7735bb25359b1adf8c82d125fd3ab2c09b621e17dba026db050eb2",
"LIPMWALK12.npz": "fd16ccd147903b66f82c3f3eed208dd4b0c2baba28273013ec361724420ae863",
"LIPMWALK13.npz": "8fe3c4eded9dcd38bfa6db30d0442067369677bc1e11ff8e084bb05bbfed53f1",
"LIPMWALK14.npz": "bbfe8f5581610577a04b65486fd351c3de34016f136cf4ff37315fd72261f8c9",
"LIPMWALK15.npz": "61122422a44c90c9d8cc4b603c2be42eef1c2bede70519e37baf2d38e372b936",
"LIPMWALK16.npz": "047db1a609856fe2b7effd9a2e52b68c33b3a14f45007455754596fda38357cc",
"LIPMWALK17.npz": "ffe92a1e6a19a38c1e54840d12b0005815ee2bb59b3d2bd79841eaa4d2cb422b",
"LIPMWALK18.npz": "f10b4d0aaae33cd2e6fad30b226898d036f579a09e77f2b95eca2b0cb6731221",
"LIPMWALK19.npz": "defae0b839e2455088f5917867a4f0044766fb292ca60eab23e2e76273869b6d",
"LIPMWALK2.npz": "7cb50087bb6b9c70e0b65afc24e397f91a6194b4ceae49896ed7f9851b1c727e",
"LIPMWALK20.npz": "b04addd68a56d6f048df4d66382a4172278888433a305514640332d716d97256",
"LIPMWALK21.npz": "fd81ac3fe0392db1902082881f93741d1df1724ad75a461661e67bc9db348637",
"LIPMWALK22.npz": "24147033ecf014f904af70381a2dbf1fc3792194be63e146d2c5ae1dfe9e03b5",
"LIPMWALK23.npz": "0010cce388095bb03df0cbc4f0052a97647d945490290c92ccdf1c8973856957",
"LIPMWALK24.npz": "b22cc50c1734abcd0bb703673249fbadaa6ebeed808865e51575a319fb7fc22e",
"LIPMWALK25.npz": "f66f4d95f4d637b196a0df8b1d169a69e0965d81b62eb288a5e11ab63785b0a0",
"LIPMWALK26.npz": "f2f702f99cccf19ba50e88d36f6300bde906900a47e776c9e8f4570e420822e4",
"LIPMWALK27.npz": "e81eb30b8e15810a604051b4537d90f9986fc4a6484528821679c4389413e77b",
"LIPMWALK28.npz": "d3e57685395fd807544e6535d55380bb34339b7aaa3c3b3de602911e3b39cfff",
"LIPMWALK29.npz": "2ac2d68694e7d4549d4ffe8a62b8e43f663292607ea12d29f0d47dda4fdd1a06",
"LIPMWALK3.npz": "144fb07b640d4623e9e7993b590fae3ce877f079bb2140416b0535aef9baff55",
"LIPMWALK4.npz": "fc829050b21df1a98b6e9bf643a7580baf96d3a5c53142e3886ea217320801e7",
"LIPMWALK5.npz": "83f5f48722db420b7680bae4d3b0b81c157739f6e033f7846da31d12fbb97cc9",
"LIPMWALK6.npz": "0d8b770dd12254a1396c6a1856e0a3511f24a887e72a36ee9fe0367c37097465",
"LIPMWALK7.npz": "d52b7a99b168d0f711dc8e36c184ddf1502ad86748a21bf90eefadbf1cf9a8ca",
"LIPMWALK8.npz": "733f15a97c07e878874cd55085702163af0d957bfda434b8d56cf4f2b4cb586e",
"LIPMWALK9.npz": "1bd46a5f211977089a2beb1a0d22aec48836a7996e5db7e69dae4ca6686b4951",
"QUADCMPC1.npz": "57afe89122e133bc5e37b30e1b503fdb217748a8718fbb7d18a95ea6112283af",
"QUADCMPC2.npz": "78ad8f559028e8388f904537b97309f437f57bdf3780864f9dd12c0d5dd26cd1",
"QUADCMPC3.npz": "8bd9f4d572025220b288ec57050c86d8ef02f8dcf45ded0c4055b4bb3e9d6d6a",
"QUADCMPC4.npz": "a2c86267fab45ff5b32c76b8ad9d03305c307db5d180b1b81b0c39f80a457e0f",
"WHLIPBAL0.npz": "511789d594d960106c497f0a716a42bed109a5703bde7c8cbf446613a5f49e62",
"WHLIPBAL1.npz": "4549704aa6b8333a45adbc15d1c8763640e7fb6479b14fad669d67b4ce33cb61",
"WHLIPBAL10.npz": "aef9e52ddc3f6b215d8bb6a4e1efd2e4a2659c27ad7d8d79a1a12e217bc9d594",
"WHLIPBAL11.npz": "9a931737f16eb2cbd9353d27175816df504568b8a3320961b1939e371c1ee4cf",
"WHLIPBAL12.npz": "dc65e7dbf1d58f6486987a9f489aa3956632c66e30c2e808a4fa1155aa9dc56d",
"WHLIPBAL13.npz": "881c439e7085c8ed4791d6de274513d110e283d0939096761309a8a98985d216",
"WHLIPBAL14.npz": "2a8d266c5e46b1920eac0b69a8540488926da8042d3b53d372e3048dd2aa471b",
"WHLIPBAL15.npz": "0a2b0d42dd9c548b0547074b1befbdf198f786964d782571d044b58ea0a488f8",
"WHLIPBAL16.npz": "c08d4738ad37f98f1f24ecb8f378841ae3f3d4185ae07602f6722a16c1bcb183",
"WHLIPBAL17.npz": "5814033b89e82ce12f2b46a53e75f9b10ada29c2523501b976e6d51a76870404",
"WHLIPBAL18.npz": "d4d635b762389f9c7854db1f8f07555abe36112acb9934ccdca85f611d1863e1",
"WHLIPBAL19.npz": "6fb53442ea341c88fa751c95c4eb698111e785be7499eabe31d12448421cc31b",
"WHLIPBAL2.npz": "6455c45f065918ff989f89dd2d4d99cf9069a7c0e1f149c20e52e0e5abfdec09",
"WHLIPBAL20.npz": "b7954528333093afbcde25ab867b8faaa5dd0435ec51c58728d9668d40870525",
"WHLIPBAL21.npz": "6c5237443e9d9d101ffac574a9787d00af56f44f0dc2b351cef9231f26438462",
"WHLIPBAL22.npz": "fd4b30a524c18074201b99bcb8ed5a30e6281151d898c8e9cbc0feb238767423",
"WHLIPBAL23.npz": "d3cfcd5824bdc672e32d8a32cc0127a419ceb0951f59bc2a545fda121f340e0e",
"WHLIPBAL24.npz": "82cd6e7bcc9cc160d15ffcaf0408c1c137f3c1971546ca829ecc3682d9c44342",
"WHLIPBAL25.npz": "058d5577ae7869c99f5536f07962b4e2df2e55237372bcb9fec36d844ac8c926",
"WHLIPBAL26.npz": "f955e1c0db98575d893c12052748051c886c731aef394f4fb0a1227a2443ab8a",
"WHLIPBAL27.npz": "a632fb21b91186e1b21c5717e057e0603804b4401b4eb6b56e1065ffaa1a4e8c",
"WHLIPBAL28.npz": "5fa350011847f9396703bdc5f2f4dc6d988496909e1fd1e69eec70ba13af9c39",
"WHLIPBAL29.npz": "b7c78c5ce45ff7e376ba70f4ec28278cab01622f87c47a22a1e03364f16d8c65",
"WHLIPBAL3.npz": "6fe5e98ca90b1f150d6c6e47c8912454cdddb351d539fdccb7e77d6ae668db37",
"WHLIPBAL4.npz": "e8fe240e21593ed1e5994ecd345f4702fc88e790f02eae4ddb35e990a794c52b",
"WHLIPBAL5.npz": "93d4ba90a625fa933d24aaad442ef1e59c72ecae76cf179fb504dcdd514ca90e",
"WHLIPBAL6.npz": "907b604c9d4ac3a4e386b9017a2b59be6c5ad013eff985ba5f411a0a12b82bdb",
"WHLIPBAL7.npz": "2c1190e5ed952803160108f16662c92ab713a27c33cfe338b5cc24c2dac3de3a",
"WHLIPBAL8.npz": "f1bf396c5ca88ceda1cbce6afd0918cf2faa79df07e271ec2bf740dd5460b1db",
"WHLIPBAL9.npz": "ef7d5b6cbd0e34d1d53514dba03f31b49bffa9f0759018d26183ccc56c128b4b"
}
},
"current_library_sha256": "607f39ab3283526a3470f7b345e91817eb8ac2a2294a50e0e6232292c7dd122d",
"raw_sha256": {
"/tmp/alm-qr-option/mpc-off-full.jsonl": "b5334b40968c3efc5f24c52175790140355cee38475eafce9b0c42918448e07e",
"/tmp/alm-qr-option/g1-off.jsonl": "e2eb7fcb092c2ec67045d4690c7c09c2cff8bb14da6dc60ab2daa10c8fe4fa07",
"/tmp/alm-qr-option/g1-full-off.jsonl": "cee4ccecf7af28935f04ee0d9b6387bd96c8d552f99acabbea9d7d00d933210a",
"/tmp/alm-refactor/full-rows.jsonl": "63a2c9d88801bde4573725ee915d9b85bec80d61c330bf30bdcf41800b7b0df2",
"/tmp/qp-cholesky/qp-benchmark-results.json": "95da6f0b49097f67ad862a3e68ce0f595bdc51440eb59ee29685f9ddc436333f"
},
"source_campaigns": {
"current": "ALM QR off: 1536 MPC calls, one initial and five fresh repetitions per combination; three single G1 attempts. Dense Dual/Sparse Dual/DAQP: corresponding 4608 calls from the shared November 8 campaign.",
"retained": "ProxQP/Clarabel/OSQP MPC and non-ALM G1: November 7 measurements; not rerun for this report edit.",
"retained_g1_protocol": {
"numerical_threads": 1,
"TBB_threads": 8,
"affinity": [
0,
1,
2,
3,
4,
5,
6,
7
],
"additional_regularization": 0,
"accounting": "Existing measurements minus their separately recorded native_factor_build_time; other Python preparation retained",
"watchdog": "Original 300-second total-call cap retained; censored lower bounds subtract recorded reconstruction and are not reported as completed solves",
"new_solves": false,
"new_dual_solves": true,
"dual_timing_boundary": "Assembled native factors before solver construction through native result conversion; factor reconstruction and independent certificate scoring excluded",
"dual_numerical_threads": 1,
"dual_TBB_threads": 8,
"dual_affinity": [
0,
1,
2,
3,
4,
5,
6,
7
],
"dual_watchdog_seconds": 300,
"dual_memory_limit_gib": 16,
"dual_memory_enforcement": "RSS watchdog and RLIMIT_AS; caught allocation failures reported as memory limits",
"dual_additional_regularization": 0,
"dual_certificate_tolerance": 1e-07,
"dual_cold_start": "Zero vectors and multipliers; no phase one",
"dual_ordering": "COLAMD",
"dual_g1sp20_additional_timings": 5,
"retained_g1_timings": "Existing baseline and primal calls, with the separately recorded native reconstruction time subtracted from GTSAM calls; not rerun"
}
},
"source_sha256": {
"gtsam/constrained/AugmentedLagrangianSolver.cpp": "eab27b745ce10863088250e3f562226a7dd8908e732684f18aa11d692d545aae",
"gtsam/constrained/internal/AugmentedLagrangianEngine.h": "1ea2ce850e0aae9b992bac99855d32c45b685de64170535accd05db169168112",
"gtsam/constrained/internal/GaussianAlmModel.h": "0536894df537a029cb7226dd58883c0200a8cee59f1e2c2d45d9af852ac762b5",
"gtsam/nonlinear/NonlinearMultifrontalSolver.cpp": "07f411f0f7c22e074b655b15962cf963086a9c16072791e00f2bbee06f699cd2"
}
}