Test results for amd64, gemini, crypto_sign/falcon512tree

[Page version: 20241028 05:30:40]

Measurements for amd64, gemini, crypto_sign Test results for amd64, gemini, crypto_sign Test results for crypto_sign/falcon512tree

Computer: gemini
Microarchitecture: amd64; Goldmont Plus (706a8)
Architecture: amd64
CPU ID: GenuineIntel-000706a8-bfebfbff
SUPERCOP version: 20241022
Operation: crypto_sign
Primitive: falcon512tree

Time	Object size	Test size	Implementation	Compiler	Benchmark date	SUPERCOP version
1006478	133417 0 0	153686 836 1720	`T:fpu`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
1008492	127107 0 0	145046 836 1720	`T:fpu`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
1130497	77490 0 0	94668 820 1720	`T:fpu`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
1188626	140337 0 0	159758 836 1720	`T:fpu`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
1221862	155000 0 0	175010 796 1784	`T:fpu`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
1356004	70781 0 0	87978 788 1752	`T:fpu`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
1373259	87262 0 0	106210 796 1784	`T:fpu`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
1431071	81486 0 0	100082 796 1784	`T:fpu`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
2283147	84247 0 0	102668 820 1720	`T:fpu`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
10156216	145412 0 0	164774 828 1720	`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
10166455	137042 0 0	157494 828 1720	`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
10173924	132110 0 0	150238 828 1720	`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
10496771	144587 0 0	164754 796 1784	`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
10706293	93800 0 0	112786 796 1784	`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
10984749	89596 0 0	108218 796 1784	`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
11062225	77431 0 0	94738 788 1752	`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
11125612	85694 0 0	104228 820 1720	`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625
11401968	85402 0 0	102788 820 1720	`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240704	20240625

Test failure

error 111

Number of similar (implementation,compiler) pairs: 9, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`

Compiler output

api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:fpu`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:fpu`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:

Implementation	Compiler
`T:avx2`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:fpu`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon512tree_avx2_timingleaks':
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                                 ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                         ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                 ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |         ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:avx2`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`

Compiler output

api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon512tree_fpu_timingleaks':
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                                 ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                         ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                 ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |         ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:fpu`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:fpu`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:fpu`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:fpu`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`

Compiler output

api.c: api.c:107:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:107:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:107:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:107:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 5, namely:

Implementation	Compiler
`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon512tree_ref_timingleaks':
api.c: api.c:107:33: warning: unused variable 'G' [-Wunused-variable]
api.c:   107 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                                 ^
api.c: api.c:107:25: warning: unused variable 'F' [-Wunused-variable]
api.c:   107 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                         ^
api.c: api.c:107:17: warning: unused variable 'g' [-Wunused-variable]
api.c:   107 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                 ^
api.c: api.c:107:9: warning: unused variable 'f' [-Wunused-variable]
api.c:   107 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |         ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`