Test results for amd64, wooden, crypto_sign/falcon1024tree

[Page version: 20240912 08:47:51]

Measurements for amd64, wooden, crypto_sign Test results for amd64, wooden, crypto_sign Test results for crypto_sign/falcon1024tree

Computer: wooden
Microarchitecture: amd64; Goldmont (506c9)
Architecture: amd64
CPU ID: GenuineIntel-000506c9-1fc9cbf5
SUPERCOP version: 20240909
Operation: crypto_sign
Primitive: falcon1024tree

Time	Object size	Test size	Implementation	Compiler	Benchmark date	SUPERCOP version
2137194	133417 0 0	153215 808 1568	`T:fpu`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
2160668	127107 0 0	144639 808 1568	`T:fpu`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
2355454	155000 0 0	174615 768 1632	`T:fpu`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
2406118	77490 0 0	94197 792 1568	`T:fpu`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
2498092	140337 0 0	159287 808 1568	`T:fpu`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
2847120	87262 0 0	105815 768 1632	`T:fpu`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
2918276	70781 0 0	87519 760 1600	`T:fpu`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
2961106	81486 0 0	99623 768 1632	`T:fpu`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
4004838	84247 0 0	102261 792 1568	`T:fpu`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
22471184	137042 0 0	157087 800 1568	`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
22503484	145412 0 0	164303 800 1568	`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
22571024	132110 0 0	149767 800 1568	`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
23186510	144587 0 0	164295 768 1632	`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
23511670	85402 0 0	102381 792 1568	`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
23539512	93800 0 0	112391 768 1632	`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
24178916	89596 0 0	107759 768 1632	`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
24556562	77431 0 0	94279 760 1600	`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625
25308512	85694 0 0	103821 792 1568	`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240706	20240625

Test failure

error 111

Number of similar (implementation,compiler) pairs: 9, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`

Compiler output

api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:fpu`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon1024tree_avx2_timingleaks':
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |  int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                    ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |  int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                           ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |  int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                  ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |  int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |         ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:avx2`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`

Compiler output

api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:fpu`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon1024tree_fpu_timingleaks':
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |  int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                    ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |  int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                           ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |  int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                  ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |  int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |         ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:fpu`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:fpu`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:fpu`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:fpu`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`

Compiler output

api.c: api.c:107:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:107:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:107:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:107:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 5, namely:

Implementation	Compiler
`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon1024tree_ref_timingleaks':
api.c: api.c:107:36: warning: unused variable 'G' [-Wunused-variable]
api.c:   107 |  int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                    ^
api.c: api.c:107:27: warning: unused variable 'F' [-Wunused-variable]
api.c:   107 |  int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                           ^
api.c: api.c:107:18: warning: unused variable 'g' [-Wunused-variable]
api.c:   107 |  int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                  ^
api.c: api.c:107:9: warning: unused variable 'f' [-Wunused-variable]
api.c:   107 |  int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |         ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`