Test results for amd64, margaux, crypto_sign/falcon512tree

[Page version: 20241024 06:40:58]

Measurements for amd64, margaux, crypto_sign Test results for amd64, margaux, crypto_sign Test results for crypto_sign/falcon512tree
Computer: margaux
Microarchitecture: amd64; Core 2 65nm (6fb)
Architecture: amd64
CPU ID: GenuineIntel-000006fb-bfebfbff
SUPERCOP version: 20241022
Operation: crypto_sign
Primitive: falcon512tree
TimeObject sizeTest sizeImplementationCompilerBenchmark dateSUPERCOP version
1233024165608 0 0185647 820 1792T:fpugcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
1235474148826 0 0166533 868 1728T:fpuclang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
1260463164110 0 0183189 868 1728T:fpuclang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
126367976834 0 094047 852 1728T:fpuclang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
1264949164023 0 0182861 868 1728T:fpuclang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
126672893422 0 0111389 860 1728T:fpuclang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
131230083443 0 0102399 820 1792T:fpugcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
132278478891 0 097415 820 1792T:fpugcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
137316871348 0 088791 812 1760T:fpugcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
10841220165458 0 0184253 860 1728T:refclang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
10896983152493 0 0170221 860 1728T:refclang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
10976820101447 0 0119669 860 1728T:refclang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
1102981785049 0 0102543 852 1728T:refclang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
11039173165555 0 0184645 860 1728T:refclang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
12634116153511 0 0173687 820 1792T:refgcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
1266242686845 0 0105423 820 1792T:refgcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
1278593489323 0 0108327 820 1792T:refgcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070220240625
1294729677932 0 095479 812 1760T:refgcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070220240625

Test failure


error 111

Number of similar (implementation,compiler) pairs: 9, namely:
ImplementationCompiler
T:avx2clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)
T:avx2clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)
T:avx2clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)
T:avx2clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)
T:avx2clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)
T:avx2gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)
T:avx2gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)
T:avx2gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)
T:avx2gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)

Compiler output


api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:avx2clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)

Compiler output


api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:avx2clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)

Compiler output


api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:avx2clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)

Compiler output


api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:
ImplementationCompiler
T:avx2clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)
T:fpuclang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)

Compiler output


api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:avx2clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)

Compiler output


api.c: api.c: In function 'crypto_sign_falcon512tree_avx2_timingleaks':
api.c: api.c:110:40: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                                        ^
api.c: api.c:110:32: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                                ^
api.c: api.c:110:24: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                        ^
api.c: api.c:110:16: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                ^

Number of similar (implementation,compiler) pairs: 4, namely:
ImplementationCompiler
T:avx2gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)
T:avx2gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)
T:avx2gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)
T:avx2gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)

Compiler output


api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:fpuclang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)

Compiler output


api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:fpuclang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)

Compiler output


api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:fpuclang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)

Compiler output


api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:fpuclang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)

Compiler output


api.c: api.c: In function 'crypto_sign_falcon512tree_fpu_timingleaks':
api.c: api.c:110:40: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                                        ^
api.c: api.c:110:32: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                                ^
api.c: api.c:110:24: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                        ^
api.c: api.c:110:16: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                ^

Number of similar (implementation,compiler) pairs: 4, namely:
ImplementationCompiler
T:fpugcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)
T:fpugcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)
T:fpugcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)
T:fpugcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)

Compiler output


api.c: api.c:107:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:107:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:107:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:107:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 5, namely:
ImplementationCompiler
T:refclang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)
T:refclang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)
T:refclang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)
T:refclang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)
T:refclang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)

Compiler output


api.c: api.c: In function 'crypto_sign_falcon512tree_ref_timingleaks':
api.c: api.c:107:40: warning: unused variable 'G' [-Wunused-variable]
api.c:   107 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                                        ^
api.c: api.c:107:32: warning: unused variable 'F' [-Wunused-variable]
api.c:   107 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                                ^
api.c: api.c:107:24: warning: unused variable 'g' [-Wunused-variable]
api.c:   107 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                        ^
api.c: api.c:107:16: warning: unused variable 'f' [-Wunused-variable]
api.c:   107 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                ^

Number of similar (implementation,compiler) pairs: 4, namely:
ImplementationCompiler
T:refgcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)
T:refgcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)
T:refgcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)
T:refgcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)