Measurements of public-key signature systems on one machine: amd64; Haswell+AES (306c3); 2013 Intel Xeon E3-1220 v3; 4 x 3100MHz; hiphop, supercop-20231107
[Page version: 20241006 02:11:55]
eBATS
(ECRYPT Benchmarking
of Asymmetric Systems)
is a project
to measure the performance of public-key systems.
This page presents benchmark results collected in eBATS
for public-key signature systems:
- Time (cycles) to generate a key pair:
a secret key and a corresponding public key.
- Time to sign a short message (59 bytes).
- Time to open a signed short message,
i.e., to verify a (larger) signed message and recover the original short message.
- Space (bytes) for a secret key.
- Space for a public key.
- Space for a signature on a 0-byte message.
- Space for a signature on a 23-byte message:
i.e.,
the signed-message length minus 23 bytes.
- Space for a signature on a long message:
i.e.,
the signed-message length minus the message length.
For signature systems that support "message recovery",
the space for a signature on a long message
is shorter than the space for a signature on a short message.
Each table row lists
the first quartile of many speed measurements,
the median of many speed measurements,
the third quartile of many speed measurements, and
the name of the primitive.
Measurements with large variance are indicated in red with question marks.
The symbol
T:
(starting with supercop-20200816)
means that the SUPERCOP database
at the time of benchmarking did not list constant time
as a goal for this implementation.
The symbol
T!!!
means that constant time was listed as a goal for this implementation,
but that the implementation failed TIMECOP.
(TIMECOP failures are not necessarily security issues;
they can sometimes be resolved by, e.g., declaring that a rejection-sampling condition is safe to declassify.)
There is a
separate page
with more information about each signature system and each implementation.
Designers and implementors
interested in submitting new signature systems
and new implementations of existing signature systems
should read the call for submissions.
Test results
Graphs:
old
(pkcycles,pkbytes)
(smcycles,sbytes)
(mcycles,pkbytes)
(mcycles,sbytes)
(pkbytes,sbytes)
NISTPQC graphs:
(pkcycles,pkbytes)
(smcycles,sbytes)
(mcycles,pkbytes)
(mcycles,sbytes)
(pkbytes,sbytes)
Measurement failures: ntrumls401x, ntrumls439x, ntrumls593x, ntrumls743x, qtesla128, qtesla192, qtesla256
Cycles to generate a key pair |
25% | 50% | 75% | system |
3535? | 3572? | 4576? | picnic3l1 |
3228? | 4008? | 4155? | picnicl1full |
4392 | 4786 | 4873 | picnic3l3 |
4820 | 4860 | 4929 | T: picnic2l1fs |
4951 | 4967 | 5139 | picnicl1fs |
4958 | 5026 | 5479 | picnicl1ur |
4431 | 5162 | 5339 | picnicl3full |
5761 | 6337 | 6766 | picnic3l5 |
5870? | 6719? | 7364? | picnicl5full |
8923 | 8971 | 9105 | T: picnic2l3fs |
9328 | 9381 | 10587 | picnicl3fs |
9221 | 9829 | 10157 | picnicl3ur |
12066 | 12301 | 14962 | T: picnic2l5fs |
12430 | 13543 | 14329 | picnicl5fs |
13556 | 13687 | 15425 | picnicl5ur |
24944 | 25015 | 25114 | T: lattisigns512 |
57130 | 57262 | 57407 | ed25519 |
65246 | 65541 | 65904 | dilithium2aes |
96519 | 97106 | 98640 | dilithium2 |
102737 | 103389 | 104199 | dilithium3aes |
159353 | 159756 | 160349 | dilithium5aes |
173111 | 173583 | 181546 | dilithium3 |
175066 | 175372 | 175673 | T: ed448goldilocks |
251660 | 253621 | 257013 | T: pass769 |
269084 | 269788 | 272832 | dilithium5 |
287367 | 297927 | 303738 | T: pass863 |
827014 | 829888 | 831869 | T: mqdss48 |
851799 | 855226 | 862477 | T: edons128k08n72nu8l4mu3 |
883500 | 906594 | 908617 | T: sphincsf128harakasimple |
1100748 | 1101841 | 1102562 | T: sphincsf128harakarobust |
1269720 | 1283476 | 1291885 | T: donald2048 |
1289036 | 1289424 | 1290087 | T: sphincsf192harakasimple |
1620139 | 1621248 | 1629488 | T: sphincsf192harakarobust |
1310614? | 1724941? | 2576382? | T: qtesla1 |
1904758 | 1906131 | 1907890 | T: mqdss64 |
2562417 | 2566855 | 2569421 | T: edons128ref |
2788187 | 2789950 | 2791179 | T: sphincs256 |
2841975? | 2860019? | 4240577? | T: qtesla3f |
3500542 | 3502335 | 3513154 | T: sphincsf256harakasimple |
4281560 | 4283540 | 4288900 | T: sphincsf256harakarobust |
4491675 | 4494352 | 4500121 | T: sphincsf128shake256simple |
5095075 | 5097015 | 5167122 | T: luov863256 |
4219061? | 5626238? | 9700665? | T: qtesla3s |
6547904 | 6555512 | 6802949 | T: sphincsf192shake256simple |
6203108? | 7054895? | 8698827? | T: qtesla1p |
8208944 | 8210929 | 8214028 | T: sphincsf128shake256robust |
9740831 | 9744493 | 9771227 | T: luov863256pc |
12070954 | 12077104 | 12091911 | T: sphincsf192shake256robust |
12089153 | 12112275 | 12126964 | T: rainbowbinary256181212 |
17219678 | 17223339 | 17238928 | T: sphincsf256shake256simple |
18315917 | 18324100 | 18440935 | T: rainbow1aclassic363232 |
18089853 | 18941531 | 20882265 | T: falcon512dyn |
19042291 | 19107642 | 19144338 | T: luov4849242 |
18278146 | 19278397 | 20094273 | T: falcon512tree |
20475751 | 20480561 | 20492067 | T: rainbow1acyclicc363232 |
20488178 | 20501823 | 20513515 | T: rainbow1acompres363232 |
21438865 | 21516384 | 22044689 | T: luov890351 |
27658108 | 27664176 | 27695199 | T: sphincss128harakasimple |
31945196 | 31980289 | 32046793 | T: sphincsf256shake256robust |
34875086 | 34911960 | 34915406 | T: sphincss128harakarobust |
27847318? | 35617588? | 43359456? | T: qtesla3p |
35780538 | 35799449 | 35877342 | T: luov890351pc |
36548597 | 36670106 | 36732903 | T: luov8117404 |
42758239 | 42807234 | 42995852 | T: sphincss192harakasimple |
50513911 | 50558387 | 50593416 | T: sphincss192harakarobust |
54172541 | 54255340 | 54458290 | T: sphincss256harakasimple |
54684086 | 55033656 | 55366363 | T: rainbowbinary16242020 |
56424218 | 58421090 | 60785820 | T: falcon1024dyn |
56827236 | 59609677 | 65186082 | T: falcon1024tree |
62966856 | 63020492 | 63100025 | T: luov8117404pc |
64765676 | 64774271 | 64785449 | T: redgemss128 |
64835750 | 64852971 | 64869760 | T: gemss128 |
64708864 | 65006736 | 65245830 | T: luov6468330 |
66401362 | 66425840 | 66453504 | T: bluegemss128 |
66703972 | 66751378 | 66984317 | T: sphincss256harakarobust |
71462328 | 71504655 | 71555873 | T: redgemss128v2 |
92367561 | 92389845 | 92397760 | T: gemss128v2 |
94497096 | 94509511 | 94577843 | T: bluegemss128v2 |
114932334 | 115042727 | 115423901 | T: rainbow3cclassic683248 |
118716688 | 119027613 | 121148269 | T: rainbow3ccompres683248 |
121195488 | 121355283 | 121579806 | T: luov8086399 |
124507935 | 124669235 | 124708113 | T: rainbow3ccyclicc683248 |
143132542 | 143573047 | 143752944 | T: sphincss128shake256simple |
201810313 | 202655416 | 204151897 | T: sflashv2 |
210180389 | 210461492 | 210473476 | T: sphincss192shake256simple |
262981633 | 263712382 | 263742064 | T: sphincss128shake256robust |
274873226 | 274919014 | 275154581 | T: sphincss256shake256simple |
306249684 | 306700310 | 307479791 | T: redgemss192 |
309150048 | 309625702 | 310241341 | T: bluegemss192 |
311065824 | 311215604 | 311329853 | T: gemss192 |
337991075 | 338191238 | 338856619 | T: rainbow5cclassic963664 |
363398205 | 363585460 | 364025331 | T: rainbow5ccyclicc963664 |
363911355 | 364383573 | 366002433 | T: rainbow5ccompres963664 |
386932292 | 387869126 | 388423000 | T: sphincss192shake256robust |
448475018 | 448501270 | 448543146 | T: gemss192v2 |
452398076 | 452462152 | 453226507 | T: bluegemss192v2 |
454019557 | 454486848 | 454986168 | T: redgemss192v2 |
512344672 | 516531412 | 516794107 | T: sphincss256shake256robust |
902599957 | 905576375 | 927849882 | T: redgemss256 |
920900735 | 924436511 | 929187542 | T: gemss256 |
923123423 | 924759988 | 928885253 | T: bluegemss256 |
1266795882 | 1267061162 | 1271755974 | T: gemss256v2 |
1277644383 | 1280646127 | 1287360301 | T: bluegemss256v2 |
1276259340 | 1280692132 | 1294828914 | T: redgemss256v2 |
1883960278 | 1884597375 | 1886815883 | T: gravitysphincss |
4621734740 | 4715825327 | 4846737992 | T: pqrsa15 |
28738919771 | 28751477353 | 28778762382 | T: gravitysphincsl |
57523936101 | 57584136960 | 57591033218 | T: gravitysphincsm |
|
Cycles to sign 59 bytes |
25% | 50% | 75% | system |
19164 | 19302 | 19741 | T: rainbowbinary256181212 |
37333 | 37759 | 43748 | T: rainbowbinary16242020 |
59982 | 60111 | 60205 | ed25519 |
89147 | 89597 | 92042 | T: rainbow1aclassic363232 |
99299 | 99967 | 103121 | T: rainbow1acyclicc363232 |
108423 | 109264 | 110811 | T: sflashv2 |
182832 | 182908 | 182990 | T: ed448goldilocks |
144924? | 185186? | 311536? | dilithium2aes |
144348? | 206684? | 379008? | dilithium2 |
204705? | 273630? | 419882? | dilithium3aes |
279425? | 294296? | 568645? | T: pass769 |
370053 | 373763 | 379336 | T: luov863256pc |
228618? | 378202? | 544674? | dilithium5aes |
287417? | 378475? | 490649? | dilithium3 |
196484? | 379124? | 747602? | T: lattisigns512 |
401990 | 406469 | 408748 | T: rainbow3cclassic683248 |
409253 | 412456 | 417451 | T: falcon512tree |
275191? | 510226? | 833723? | T: qtesla1 |
530058 | 532503 | 538721 | T: rainbow3ccyclicc683248 |
427562? | 547401? | 734366? | dilithium5 |
424954? | 616218? | 1239080? | T: qtesla3f |
345112? | 667579? | 1027975? | T: pass863 |
787051 | 791366 | 794479 | T: falcon512dyn |
834526 | 846267 | 855513 | T: falcon1024tree |
470031? | 919238? | 1866448? | T: qtesla3s |
927566 | 930570 | 936656 | T: rainbow5cclassic963664 |
1090734 | 1105826 | 1113353 | T: luov890351pc |
820986? | 1213291? | 1873058? | T: qtesla1p |
1265656 | 1274113 | 1281795 | T: donald2048 |
1308926 | 1320392 | 1331532 | T: rainbow5ccyclicc963664 |
1385957 | 1389474 | 1395703 | T: edons128k08n72nu8l4mu3 |
1604398 | 1612142 | 1623885 | T: falcon1024dyn |
1597616 | 1618400 | 1638016 | T: luov8117404pc |
3251376 | 3258404 | 3265626 | T: edons128ref |
3680831 | 3681843 | 3835018 | T: luov863256 |
3709978 | 3712569 | 3715230 | picnicl1full |
4626030 | 4628129 | 4629836 | picnicl1fs |
3626159? | 4646588? | 7669531? | T: qtesla3p |
4039426? | 4680418? | 5358043? | T: redgemss128v2 |
4166617? | 4992943? | 6315202? | T: redgemss128 |
5178597 | 5184799 | 5208624 | T: mqdss48 |
5914647 | 5916678 | 5918872 | picnicl1ur |
7120247 | 7122574 | 7127626 | picnicl3full |
11412398 | 11442057 | 11461973 | picnicl3fs |
11820013 | 11828595 | 11847139 | picnicl5full |
12018550 | 12021165 | 12028967 | T: luov890351 |
10236042? | 12124761? | 14405852? | T: redgemss192v2 |
12381876 | 12392781 | 13400478 | T: mqdss64 |
10973432? | 13502017? | 17446229? | T: redgemss192 |
14648109 | 14652650 | 14660360 | T: gravitysphincss |
14733234 | 14740089 | 14773133 | picnicl3ur |
16504948 | 16516147 | 16811718 | T: rainbow1acompres363232 |
17529777 | 17538406 | 17546363 | picnic3l1 |
15722252? | 18426234? | 24704144? | T: redgemss256 |
19408760 | 19428786 | 19474840 | picnicl5fs |
20767956 | 20780278 | 21717455 | T: luov8117404 |
18630949? | 22123351? | 26597333? | T: redgemss256v2 |
25077419 | 25084283 | 25656106 | picnicl5ur |
26134334 | 26181210 | 26210147 | T: gravitysphincsm |
31186336 | 31197713 | 31221203 | T: gravitysphincsl |
32094554 | 32129430 | 32155157 | T: sphincsf128harakasimple |
37318772 | 37333057 | 37357777 | picnic3l3 |
37639245 | 37656194 | 37691285 | T: sphincsf192harakasimple |
40250189 | 40289071 | 40319011 | T: sphincsf128harakarobust |
43053431 | 43078851 | 43181922 | T: luov4849242 |
49241270 | 49272753 | 49324144 | T: sphincsf192harakarobust |
49543203 | 49618921 | 49761226 | T: sphincs256 |
63110267 | 63596804 | 63902697 | picnic3l5 |
89637218 | 89713854 | 89866394 | T: sphincsf256harakasimple |
100584399 | 100680941 | 100771402 | T: rainbow3ccompres683248 |
114462940 | 114565093 | 114826481 | T: sphincsf256harakarobust |
134080581 | 134288038 | 134602482 | T: luov6468330 |
147682395 | 147907645 | 148073609 | T: sphincsf128shake256simple |
149195404 | 149233183 | 149287366 | T: pqrsa15 |
164737370 | 164791184 | 164836686 | T: picnic2l1fs |
138783032? | 166210330? | 194613904? | T: bluegemss128v2 |
155970638? | 187001616? | 218194892? | T: bluegemss128 |
187232763 | 187472684 | 190785025 | T: sphincsf192shake256simple |
241553005 | 242190042 | 243785058 | T: rainbow5ccompres963664 |
258344803 | 258605496 | 258810725 | T: sphincsf128shake256robust |
269782979 | 269945914 | 270206231 | T: luov8086399 |
338437218 | 338999365 | 344073335 | T: sphincsf192shake256robust |
405099980 | 405391763 | 405616620 | T: sphincsf256shake256simple |
337837043? | 471160828? | 538505729? | T: bluegemss192v2 |
488189901 | 488640323 | 488856441 | T: picnic2l3fs |
429426605? | 515714416? | 602427394? | T: bluegemss192 |
518445944 | 518559719 | 518680646 | T: sphincss128harakasimple |
676869185 | 677041116 | 677553290 | T: sphincss128harakarobust |
571995055? | 686423826? | 800707398? | T: bluegemss256v2 |
729442940 | 729848226 | 730283744 | T: sphincsf256shake256robust |
765616623 | 765836239 | 767149271 | T: sphincss256harakasimple |
694948239? | 833887389? | 975263737? | T: bluegemss256 |
993415419 | 993574639 | 994076898 | T: sphincss256harakarobust |
1028758371 | 1029095701 | 1029233596 | T: picnic2l5fs |
867369482? | 1039994019? | 1232871541? | T: gemss128v2 |
967912898? | 1162062250? | 1355595158? | T: gemss128 |
1182942345 | 1183899131 | 1184380117 | T: sphincss192harakasimple |
1594427966 | 1594820172 | 1595490324 | T: sphincss192harakarobust |
2295049623 | 2295785613 | 2297362105 | T: sphincss128shake256simple |
2751376308 | 2764936960 | 3225466852 | T: gemss192v2 |
3355039597 | 3357083818 | 3365678344 | T: sphincss256shake256simple |
2950345652? | 3539579306? | 4129579376? | T: gemss192 |
3940819552 | 3943330394 | 3946880385 | T: sphincss128shake256robust |
4780807775 | 4885626904 | 4906986356 | T: sphincss192shake256simple |
4143402147? | 5764395938? | 5799930994? | T: gemss256v2 |
5981735856 | 5983697681 | 6011000404 | T: sphincss256shake256robust |
5130354040? | 6155885313? | 7185255400? | T: gemss256 |
8080527844 | 8090007652 | 8103685107 | T: sphincss192shake256robust |
|
Cycles to verify 59 bytes |
25% | 50% | 75% | system |
16320 | 16402 | 16729 | T: rainbowbinary256181212 |
29229 | 29720 | 30182 | T: rainbowbinary16242020 |
32760 | 34632 | 36408 | T: rainbow1aclassic363232 |
39830 | 40075 | 40502 | T: lattisigns512 |
78611 | 78894 | 79053 | dilithium2aes |
86052 | 87269 | 87688 | T: falcon512tree |
102942 | 103353 | 103754 | T: qtesla1 |
102174 | 103367 | 104227 | T: falcon512dyn |
108385 | 108544 | 108706 | dilithium2 |
107596 | 109533 | 114776 | T: gravitysphincss |
116365 | 116854 | 117678 | dilithium3aes |
127936 | 128326 | 128930 | T: sflashv2 |
126762 | 130494 | 135296 | T: luov863256pc |
172689 | 173762 | 174907 | T: falcon1024tree |
174829 | 175710 | 177130 | dilithium5aes |
177024 | 177592 | 183868 | dilithium3 |
186183 | 187260 | 188284 | ed25519 |
208435 | 208924 | 209540 | T: qtesla3f |
207806 | 208983 | 209630 | T: falcon1024dyn |
213443 | 213788 | 214522 | T: qtesla3s |
213872 | 217992 | 226372 | T: rainbow3cclassic683248 |
235457 | 240790 | 246144 | T: redgemss128v2 |
235802 | 245399 | 255870 | T: bluegemss128 |
248208 | 254542 | 266879 | T: gemss128 |
255088 | 264318 | 272622 | T: redgemss128 |
277921 | 278425 | 279099 | dilithium5 |
281259 | 290478 | 297385 | T: bluegemss128v2 |
289961 | 297306 | 302868 | T: gemss128v2 |
352153 | 356868 | 361344 | T: luov890351pc |
356915 | 359656 | 367958 | T: pass769 |
436145 | 439177 | 445308 | T: pass863 |
467543 | 469904 | 471747 | T: edons128k08n72nu8l4mu3 |
467216 | 474013 | 482916 | T: gravitysphincsm |
486634 | 488812 | 494033 | T: rainbow5cclassic963664 |
484075 | 492830 | 498523 | T: luov8117404pc |
518884 | 520773 | 523381 | T: qtesla1p |
591011 | 593652 | 595616 | T: ed448goldilocks |
612073 | 627390 | 643245 | T: gemss192 |
626977 | 632337 | 643285 | T: gravitysphincsl |
624466 | 637105 | 657813 | T: sphincss128harakasimple |
634994 | 656180 | 674486 | T: redgemss192 |
639314 | 657827 | 684369 | T: bluegemss192 |
640480 | 661669 | 678009 | T: gemss192v2 |
682484 | 694822 | 708759 | T: bluegemss192v2 |
677036 | 703145 | 716361 | T: redgemss192v2 |
869972 | 873414 | 876311 | T: edons128ref |
899949 | 924325 | 940149 | T: sphincss128harakarobust |
922833 | 941987 | 952716 | T: sphincss192harakasimple |
1281852 | 1302943 | 1316287 | T: sphincss256harakasimple |
1310871 | 1329407 | 1357158 | T: gemss256 |
1348431 | 1364570 | 1422040 | T: bluegemss256 |
1346722 | 1378262 | 1401840 | T: bluegemss256v2 |
1353224 | 1387999 | 1451135 | T: redgemss256 |
1372649 | 1390888 | 1410444 | T: redgemss256v2 |
1395035 | 1430223 | 1450449 | T: gemss256v2 |
1446385 | 1460627 | 1488457 | T: sphincsf128harakasimple |
1463088 | 1484653 | 1507136 | T: sphincss192harakarobust |
1480113 | 1491714 | 1503800 | T: donald2048 |
1645678 | 1652769 | 1666518 | T: sphincs256 |
1959111 | 1990179 | 2023642 | T: sphincss256harakarobust |
2118934 | 2149463 | 2178292 | T: sphincsf128harakarobust |
2326167 | 2341926 | 2355281 | T: sphincsf192harakasimple |
2445424 | 2453148 | 2459225 | T: qtesla3p |
2475321 | 2513002 | 2537889 | T: sphincsf256harakasimple |
2957188 | 2957922 | 2958876 | T: luov863256 |
2970975 | 2973325 | 2995338 | picnicl1full |
3349711 | 3376265 | 3397671 | T: mqdss48 |
3642171 | 3676707 | 3721430 | T: sphincsf192harakarobust |
3731963 | 3735386 | 3749441 | picnicl1fs |
3775891 | 3818764 | 3860479 | T: sphincsf256harakarobust |
3983717 | 4060196 | 4169828 | T: sphincss128shake256simple |
4837380 | 4845142 | 4878274 | picnicl1ur |
5773905 | 5782989 | 5786348 | picnicl3full |
5925367 | 6032526 | 6113158 | T: sphincss192shake256simple |
7691248 | 7890253 | 8083905 | T: sphincss128shake256robust |
7777737 | 7943291 | 8094071 | T: sphincss256shake256simple |
8310122 | 8399045 | 9015618 | T: mqdss64 |
9505433 | 9520820 | 10117429 | picnicl3fs |
9602826 | 9628778 | 9655312 | picnicl5full |
9665407 | 9799728 | 9951654 | T: sphincsf128shake256simple |
10491818 | 10501778 | 10503559 | T: luov890351 |
11396605 | 11645088 | 11839349 | T: sphincss192shake256robust |
12326436 | 12337671 | 12844695 | picnicl3ur |
13327774 | 13333147 | 13348774 | T: rainbow1acompres363232 |
13306608 | 13431623 | 13545804 | T: rainbow1acyclicc363232 |
14038587 | 14054132 | 14084459 | picnic3l1 |
14941514 | 15186293 | 15390347 | T: sphincss256shake256robust |
15533264 | 15661208 | 15807844 | T: sphincsf192shake256simple |
15688041 | 15880834 | 16101283 | T: sphincsf256shake256simple |
16247261 | 16288730 | 16318544 | picnicl5fs |
17968273 | 17977902 | 17985190 | T: luov8117404 |
18941631 | 19140751 | 19285854 | T: sphincsf128shake256robust |
19624068 | 19639266 | 19656833 | T: pqrsa15 |
21241436 | 21711281 | 22278350 | picnicl5ur |
29536204 | 29551035 | 29590697 | picnic3l3 |
30024834 | 30038027 | 30053254 | T: luov4849242 |
30140580 | 30338796 | 30651165 | T: sphincsf192shake256robust |
30572696 | 30843227 | 31319696 | T: sphincsf256shake256robust |
47189368 | 47325207 | 47401429 | picnic3l5 |
67773595 | 67889880 | 68110042 | T: picnic2l1fs |
77465639 | 77508903 | 77537637 | T: luov6468330 |
80344247 | 80406010 | 81128762 | T: rainbow3ccyclicc683248 |
80482809 | 80534628 | 81905743 | T: rainbow3ccompres683248 |
147797525 | 147870186 | 147923028 | T: luov8086399 |
154374099 | 154550559 | 154750041 | T: picnic2l3fs |
180772818 | 181322012 | 181732378 | T: rainbow5ccyclicc963664 |
181404611 | 181510435 | 184598371 | T: rainbow5ccompres963664 |
271387156 | 271658381 | 274243568 | T: picnic2l5fs |
|
|
|