Test results for amd64, h8atom, crypto_sign/falcon1024tree

[Page version: 20241027 17:23:40]

Measurements for amd64, h8atom, crypto_sign Test results for amd64, h8atom, crypto_sign Test results for crypto_sign/falcon1024tree

Computer: h8atom
Microarchitecture: amd64; Bonnell (30661)
Architecture: amd64
CPU ID: GenuineIntel-00030661-bfebfbff
SUPERCOP version: 20241022
Operation: crypto_sign
Primitive: falcon1024tree

Time	Object size	Test size	Implementation	Compiler	Benchmark date	SUPERCOP version
4881086	77285 0 0	94136 824 1568	`T:fpu`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
4925599	131360 0 0	148574 832 1568	`T:fpu`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
4957435	92117 0 0	109614 832 1568	`T:fpu`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
4964652	142670 0 0	161086 832 1568	`T:fpu`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
5402964	173014 0 0	192760 792 1632	`T:fpu`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
5481315	164110 0 0	182750 840 1568	`T:fpu`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
5609625	83623 0 0	102160 792 1632	`T:fpu`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
5912151	71362 0 0	88352 784 1600	`T:fpu`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
6142759	78773 0 0	96912 792 1632	`T:fpu`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
37477076	148391 0 0	166782 832 1568	`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
37603909	138120 0 0	155350 832 1568	`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
38738224	100069 0 0	117886 832 1568	`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
40038376	85610 0 0	102704 824 1568	`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
42958265	162772 0 0	182664 792 1632	`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
44140362	165555 0 0	184142 832 1568	`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
44369101	89546 0 0	108088 792 1632	`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
45771432	77947 0 0	95040 784 1600	`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
49577549	86857 0 0	105048 792 1632	`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625

Test failure

error 111

Number of similar (implementation,compiler) pairs: 9, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:avx2`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:avx2`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:avx2`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`

Compiler output

api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:fpu`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:fpu`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon1024tree_avx2_timingleaks':
api.c: api.c:110:43: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                           ^
api.c: api.c:110:34: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                  ^
api.c: api.c:110:25: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                         ^
api.c: api.c:110:16: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:avx2`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:avx2`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:avx2`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:avx2`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`

Compiler output

api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon1024tree_fpu_timingleaks':
api.c: api.c:110:43: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                           ^
api.c: api.c:110:34: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                  ^
api.c: api.c:110:25: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                         ^
api.c: api.c:110:16: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:fpu`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:fpu`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:fpu`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:fpu`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`

Compiler output

api.c: api.c:107:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:107:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:107:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:107:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 5, namely:

Implementation	Compiler
`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon1024tree_ref_timingleaks':
api.c: api.c:107:43: warning: unused variable 'G' [-Wunused-variable]
api.c:   107 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                           ^
api.c: api.c:107:34: warning: unused variable 'F' [-Wunused-variable]
api.c:   107 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                  ^
api.c: api.c:107:25: warning: unused variable 'g' [-Wunused-variable]
api.c:   107 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                         ^
api.c: api.c:107:16: warning: unused variable 'f' [-Wunused-variable]
api.c:   107 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`