Measurements of public-key signature systems on one machine: amd64; Bonnell (106ca); 2010 Intel Atom N455; 1 x 1000MHz; h2atom, supercop-20240625
[Page version: 20241006 02:11:55]
eBATS
(ECRYPT Benchmarking
of Asymmetric Systems)
is a project
to measure the performance of public-key systems.
This page presents benchmark results collected in eBATS
for public-key signature systems:
- Time (cycles) to generate a key pair:
a secret key and a corresponding public key.
- Time to sign a short message (59 bytes).
- Time to open a signed short message,
i.e., to verify a (larger) signed message and recover the original short message.
- Space (bytes) for a secret key.
- Space for a public key.
- Space for a signature on a 0-byte message.
- Space for a signature on a 23-byte message:
i.e.,
the signed-message length minus 23 bytes.
- Space for a signature on a long message:
i.e.,
the signed-message length minus the message length.
For signature systems that support "message recovery",
the space for a signature on a long message
is shorter than the space for a signature on a short message.
Each table row lists
the first quartile of many speed measurements,
the median of many speed measurements,
the third quartile of many speed measurements, and
the name of the primitive.
Measurements with large variance are indicated in red with question marks.
The symbol
T:
(starting with supercop-20200816)
means that the SUPERCOP database
at the time of benchmarking did not list constant time
as a goal for this implementation.
The symbol
T!!!
means that constant time was listed as a goal for this implementation,
but that the implementation failed TIMECOP.
(TIMECOP failures are not necessarily security issues;
they can sometimes be resolved by, e.g., declaring that a rejection-sampling condition is safe to declassify.)
There is a
separate page
with more information about each signature system and each implementation.
Designers and implementors
interested in submitting new signature systems
and new implementations of existing signature systems
should read the call for submissions.
Test results
Graphs:
old
(pkcycles,pkbytes)
(smcycles,sbytes)
(mcycles,pkbytes)
(mcycles,sbytes)
(pkbytes,sbytes)
NISTPQC graphs:
(pkcycles,pkbytes)
(smcycles,sbytes)
(mcycles,pkbytes)
(mcycles,sbytes)
(pkbytes,sbytes)
Measurement failures: ntrumls401x, ntrumls439x, ntrumls593x, ntrumls743x, qtesla128, qtesla192, qtesla256
Cycles to generate a key pair |
25% | 50% | 75% | system |
19135 | 19175 | 19271 | picnicl1full |
20802 | 20832 | 20892 | picnic3l1 |
27052 | 27137 | 29412 | picnicl3full |
27729 | 27819 | 28009 | picnic3l3 |
35767 | 35788 | 35893 | T: picnic2l1fs |
35962 | 35982 | 36045 | picnicl1ur |
35992 | 36006 | 36046 | picnicl1fs |
36216 | 36257 | 37286 | picnicl5full |
36443 | 36472 | 37279 | picnic3l5 |
62964 | 63021 | 63636 | T: picnic2l3fs |
67888 | 67991 | 68809 | picnicl3ur |
67907 | 68086 | 68680 | picnicl3fs |
91530 | 92036 | 96404 | picnicl5fs |
92618 | 92771 | 97405 | picnicl5ur |
343322 | 344815 | 406644 | ed25519 |
1155311 | 1157761 | 1177266 | T!!!dilithium2 |
1323996? | 1590701? | 1656468? | T: ed448goldilocks |
1925843 | 1928262 | 1930730 | T!!!dilithium3 |
2096776 | 2108996 | 2123113 | T: pass769 |
2509731 | 2522083 | 2542328 | T!!!dilithium2aes |
2574189 | 2593028 | 2605406 | T: pass863 |
2909343 | 2921322 | 2935809 | T: mqdss48 |
3045160 | 3046935 | 3067780 | T!!!dilithium5 |
3841713 | 3855208 | 3870851 | T!!!dilithium3aes |
4216875? | 6645458? | 7956178? | T: qtesla1 |
6711493 | 6729728 | 6753540 | T: mqdss64 |
2748687? | 7072881? | 22417686? | haetae3 |
7132672? | 7218760? | 13425515? | T: qtesla3f |
7494944 | 7515028 | 7532995 | T!!!dilithium5aes |
7969159 | 8029339 | 8115336 | T: donald2048 |
4266385? | 8318099? | 12394762? | haetae2 |
9286623? | 15206503? | 23161258? | haetae5 |
19508241 | 19536894 | 19579214 | T: sphincsf128shake256simple |
12460137? | 20156442? | 27777796? | T: qtesla3s |
17039401? | 21151178? | 23326304? | T: qtesla1p |
21645226 | 21704103 | 21783476 | T: sphincsf128harakasimple |
28627379 | 28677824 | 28733259 | T: sphincsf192shake256simple |
32026526 | 32092951 | 32155275 | T: sphincsf192harakasimple |
36243307 | 36328628 | 36412886 | T: sphincsf128shake256robust |
40789747 | 40868702 | 41452424 | T: sphincsf128harakarobust |
44644566 | 44744223 | 44954939 | T: luov4849242 |
50800027 | 51335983 | 51545811 | T: rainbowbinary256181212 |
53937621 | 54018782 | 54392714 | T: sphincsf192shake256robust |
59956594 | 60038363 | 60386437 | T: sphincsf192harakarobust |
63373592 | 63528290 | 63750903 | T: luov863256 |
75753231 | 75826233 | 76196109 | T: sphincsf256shake256simple |
84276458 | 84452285 | 84699528 | T: sphincsf256harakasimple |
85795240 | 89855590 | 101000572 | T: falcon512dyn |
86688867 | 90247439 | 98929176 | T: falcon512tree |
71275252? | 95764507? | 108079343? | T: qtesla3p |
142100524 | 142350132 | 142526211 | T: sphincsf256shake256robust |
154679638 | 155055753 | 155470393 | T: luov6468330 |
159312578 | 159498429 | 159660102 | T: sphincsf256harakarobust |
236430676 | 237710150 | 241509604 | T: rainbowbinary16242020 |
241781086 | 242219367 | 242964588 | T: luov890351 |
250719882 | 259647643 | 276025365 | T: falcon1024dyn |
248202740 | 260416531 | 280075188 | T: falcon1024tree |
284383066 | 284625974 | 285220604 | T: luov8086399 |
434316181 | 434916050 | 435935600 | T: luov8117404 |
629923225 | 630506010 | 631090648 | T: sphincss128shake256simple |
690073295 | 690716483 | 691473874 | T: sphincss128harakasimple |
918995034 | 919468471 | 920705090 | T: sphincss192shake256simple |
1164965560 | 1165687440 | 1166761022 | T: sphincss128shake256robust |
1214641677 | 1215359075 | 1216082490 | T: sphincss256shake256simple |
1299338880 | 1300242095 | 1306169639 | T: sphincss128harakarobust |
1353813087 | 1354704645 | 1355169595 | T: sphincss256harakasimple |
1479547124 | 1480577927 | 1486218394 | T: redgemss128v2 |
2266995203 | 2268270451 | 2269744451 | T: sphincss256shake256robust |
3855637322 | 3859137354 | 3862765710 | T: bluegemss128v2 |
7850625011 | 7857821522 | 7875329836 | T: redgemss192v2 |
24149522690 | 24193790858 | 24290346288 | T: redgemss256v2 |
|
Cycles to sign 59 bytes |
25% | 50% | 75% | system |
69362 | 70068 | 70461 | T: rainbowbinary256181212 |
145224 | 146425 | 149014 | T: rainbowbinary16242020 |
354528 | 354596 | 354946 | ed25519 |
1343698 | 1344837 | 1350244 | T: ed448goldilocks |
1708631 | 1724964 | 1739029 | T: falcon512tree |
2701760? | 2759851? | 5445857? | T: pass769 |
3266106 | 3276484 | 3298304 | T: falcon512dyn |
3514842 | 3536836 | 3559237 | T: falcon1024tree |
2754571? | 4699752? | 7699091? | T: qtesla1 |
2678071? | 5279361? | 12363788? | T: qtesla3f |
3892139? | 5319098? | 8176517? | T!!!dilithium2 |
3329771? | 6614064? | 6708780? | T: pass863 |
6802852 | 6823121 | 6842258 | T: falcon1024dyn |
4087178? | 7658862? | 13201317? | T!!!dilithium3 |
5336879? | 7911292? | 9264567? | T!!!dilithium2aes |
7969890 | 8032826 | 8094318 | T: donald2048 |
4511322? | 8942840? | 16492555? | T: qtesla1p |
4595102? | 10157514? | 22566000? | T: qtesla3s |
8291700? | 11130457? | 16230394? | T!!!dilithium5 |
7638075? | 13662919? | 24674580? | T!!!dilithium3aes |
10386419? | 16097856? | 19605556? | T!!!dilithium5aes |
7493414? | 17671551? | 31314731? | haetae2 |
6495775? | 21852408? | 38101149? | haetae3 |
14272063? | 26862673? | 33334670? | haetae5 |
26535469? | 30048649? | 50504577? | T: qtesla3p |
39438656 | 39549065 | 39893788 | T: luov863256 |
42146477 | 42243328 | 42391157 | picnicl1full |
49651243 | 49736293 | 49903657 | picnicl1fs |
68727512 | 68783001 | 69207520 | picnicl1ur |
81402162 | 81561052 | 81876334 | picnicl3full |
114772872 | 115040990 | 115314607 | picnicl3fs |
125885122 | 127211122 | 128303112 | T: luov4849242 |
129762763 | 129991038 | 130219355 | picnicl5full |
136273198 | 136556517 | 136895236 | T: luov890351 |
169499052 | 169648680 | 169846588 | picnicl3ur |
177336481 | 177598048 | 177983322 | T: mqdss48 |
197798556 | 198000426 | 198363530 | picnicl5fs |
210519998 | 210684220 | 211200121 | picnic3l1 |
243052117 | 243242376 | 243935263 | T: luov8117404 |
275251026 | 275710288 | 275934270 | picnicl5ur |
472680937 | 472930683 | 473170848 | picnic3l3 |
484106512 | 492893167 | 504865281 | T: luov6468330 |
545976943 | 546185634 | 546389012 | T: mqdss64 |
618897833 | 619418101 | 620044443 | T: sphincsf128shake256simple |
756894309 | 757582984 | 758263600 | picnic3l5 |
784315464 | 784805248 | 785445245 | T: sphincsf192shake256simple |
806813765 | 807664497 | 809027467 | T: sphincsf128harakasimple |
940290747 | 941343552 | 942060213 | T: sphincsf192harakasimple |
971105695 | 975017837 | 976727861 | T: luov8086399 |
1096931657 | 1098180278 | 1099281798 | T: sphincsf128shake256robust |
961920493? | 1157303030? | 1524519533? | T: redgemss128v2 |
1413305698 | 1415033745 | 1417407869 | T: sphincsf128harakarobust |
1441875145 | 1442254671 | 1442768466 | T: picnic2l1fs |
1445577443 | 1446667916 | 1461480700 | T: sphincsf192shake256robust |
1737914334 | 1738922423 | 1741842909 | T: sphincsf192harakarobust |
1740788857 | 1741731543 | 1742955059 | T: sphincsf256shake256simple |
2304803778 | 2305685540 | 2306744007 | T: sphincsf256harakasimple |
3154051871 | 3155772972 | 3161516825 | T: sphincsf256shake256robust |
3840604719 | 3842706859 | 3846941409 | T: picnic2l3fs |
3306143432? | 3961094198? | 5233887346? | T: redgemss192v2 |
4149874940 | 4151974504 | 4154221562 | T: sphincsf256harakarobust |
7542135339? | 9090131182? | 10530764686? | T: redgemss256v2 |
9366011314 | 9368780492 | 9389515389 | T: sphincss128shake256simple |
12975354871 | 12987120753 | 13024355897 | T: sphincss128harakasimple |
14520213691 | 14538181762 | 14744747505 | T: sphincss256shake256simple |
16279497812 | 16289829779 | 16507018434 | T: sphincss128shake256robust |
19574489707 | 19589189262 | 19798943172 | T: sphincss192shake256simple |
20560595334 | 20586422426 | 20787620119 | T: sphincss256harakasimple |
17692139566? | 21348211931? | 25338914281? | T: bluegemss128v2 |
22155190247 | 22185756726 | 22391468235 | T: sphincss128harakarobust |
25889636872 | 26094523871 | 26121639787 | T: sphincss256shake256robust |
|
Cycles to verify 59 bytes |
25% | 50% | 75% | system |
68700 | 68995 | 69276 | T: rainbowbinary256181212 |
111289 | 112685 | 115306 | T: rainbowbinary16242020 |
256843 | 260244 | 261130 | T: falcon512tree |
321610 | 325903 | 326938 | T: falcon512dyn |
522372 | 523386 | 524549 | T: falcon1024tree |
656478 | 658810 | 660735 | T: falcon1024dyn |
763192 | 784209 | 800175 | T: bluegemss128v2 |
785572 | 787293 | 790608 | T: qtesla1 |
806353 | 836340 | 869291 | T: redgemss128v2 |
904611 | 907499 | 911221 | haetae2 |
1271932 | 1277358 | 1287886 | ed25519 |
1407080 | 1409176 | 1410627 | T!!!dilithium2 |
1560162 | 1563269 | 1565934 | haetae3 |
1628488 | 1632667 | 1642754 | T: qtesla3f |
1639315 | 1689270 | 1727379 | T: redgemss192v2 |
1799587 | 1803345 | 1808341 | T: qtesla3s |
1855499 | 1858162 | 1861966 | haetae5 |
2196845 | 2198008 | 2217512 | T!!!dilithium3 |
2610939 | 2626311 | 2644456 | T!!!dilithium2aes |
3046440 | 3086993 | 3144766 | T: redgemss256v2 |
3252448 | 3261911 | 3272735 | T: pass769 |
3454010 | 3456061 | 3479334 | T!!!dilithium5 |
3939765 | 3953647 | 3965181 | T: pass863 |
4039451 | 4049373 | 4096133 | T: qtesla1p |
4044880 | 4054501 | 4066321 | T!!!dilithium3aes |
4831948 | 4848729 | 4875178 | T: ed448goldilocks |
7616979 | 7633414 | 7663194 | T!!!dilithium5aes |
9202331 | 9293701 | 9380493 | T: donald2048 |
10147407 | 10456912 | 10678475 | T: sphincss128shake256simple |
13355036 | 13651668 | 13914421 | T: sphincss128harakasimple |
14951870 | 15197912 | 15600951 | T: sphincss192shake256simple |
16988519 | 17006432 | 17037796 | T: qtesla3p |
19099532 | 19794902 | 20261142 | T: sphincss128shake256robust |
19755653 | 20093748 | 20443566 | T: sphincss256shake256simple |
24799377 | 25513989 | 25900825 | T: sphincss128harakarobust |
25059113 | 25569344 | 25773406 | T: sphincsf128shake256simple |
27682271 | 28022322 | 28358720 | T: sphincss256harakasimple |
31067748 | 31093388 | 31200440 | picnicl1full |
30761871 | 31345871 | 31630415 | T: sphincsf128harakasimple |
35596187 | 35675886 | 35807532 | T: luov863256 |
38220666 | 38285809 | 38381020 | picnicl1fs |
37694151 | 38376771 | 39264498 | T: sphincss256shake256robust |
39559986 | 39926497 | 40340209 | T: sphincsf192shake256simple |
39997798 | 40431938 | 41203085 | T: sphincsf256shake256simple |
47637483 | 48473432 | 49193072 | T: sphincsf128shake256robust |
48076239 | 48596733 | 49111814 | T: sphincsf192harakasimple |
51066396 | 51891656 | 52286987 | T: sphincsf256harakasimple |
52797816 | 52914233 | 53153906 | picnicl1ur |
58515518 | 59233340 | 60643535 | T: sphincsf128harakarobust |
60672621 | 60797161 | 61058451 | picnicl3full |
75945376 | 76731159 | 77573703 | T: sphincsf192shake256robust |
77127374 | 77899487 | 78780620 | T: sphincsf256shake256robust |
86450300 | 87179709 | 88320935 | T: luov4849242 |
90427969 | 90583611 | 90928750 | picnicl3fs |
93399979 | 94425803 | 95185758 | T: sphincsf192harakarobust |
97622751 | 97833939 | 98124927 | picnicl5full |
98003521 | 99070476 | 99934235 | T: sphincsf256harakarobust |
126183287 | 126582100 | 126806198 | T: luov890351 |
130123476 | 131667880 | 132817172 | T: mqdss48 |
132615701 | 132797518 | 133267832 | picnicl3ur |
157656826 | 157942544 | 158180690 | picnicl5fs |
179429454 | 179793851 | 180042745 | picnic3l1 |
224653317 | 224955455 | 225440716 | T: luov8117404 |
224877555 | 225123860 | 225293585 | picnicl5ur |
270539564 | 273112329 | 280724819 | T: luov6468330 |
398071448 | 398521659 | 398938287 | picnic3l3 |
403025393 | 405360380 | 408577015 | T: mqdss64 |
494826699 | 496591251 | 501432213 | T: luov8086399 |
606001566 | 606407285 | 607182017 | picnic3l5 |
918654883 | 919146523 | 919737099 | T: picnic2l1fs |
2078124956 | 2078841948 | 2080191955 | T: picnic2l3fs |
|
|
|