Skip to content

Analyzers — v0.9.0

Each scorecard is one frozen report: one analyzer, one track, one score dimension, and one model profile. Scorecards remain independent populations. TPR and FPR are macro-averages over templates and semantic dimensions; inconclusive, unsupported, and runner-error remain coverage outcomes.

All 92 report partitions were freshly executed over the 1,108-case corpus. The result set contains 4,252 cells, including 216 Swift reference-adapter cells. The tables below are the authority for each analyzer’s rates, denominators, and capability boundaries.

bifrost-c-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-c-kernel-attempt-01/bifrost-c-kernel.json (1f3c41c99de0…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 56 21 21 14 0 0 100.0% 0.0%
c language-extension 2 1 0 1 0 0 100.0% n/a

bifrost-cpp-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-cpp-kernel-attempt-01/bifrost-cpp-kernel.json (2b3f61aa7e14…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 68 15 15 38 0 0 100.0% 0.0%

bifrost-csharp-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-csharp-kernel-attempt-01/bifrost-csharp-kernel.json (43ea30a59d2a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
csharp core 70 21 21 28 0 0 100.0% 0.0%

bifrost-go-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-go-kernel-attempt-01/bifrost-go-kernel.json (145eadb6759b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 70 21 21 28 0 0 100.0% 0.0%

bifrost-java-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-java-kernel-attempt-01/bifrost-java-kernel.json (42bb13e651ae…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 23 23 24 0 0 100.0% 0.0%

bifrost-java-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-java-modeling-attempt-01/bifrost-java-modeling.json (01efceea5efe…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 4 3 1 16 0 100.0% 0.0%

bifrost-java-native-taint-taint-tool-native

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-java-native-attempt-01/bifrost-java-native.json (37e712f3f2ca…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

bifrost-javascript-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-javascript-kernel-attempt-01/bifrost-javascript-kernel.json (c78ed45e2db5…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 70 24 24 22 0 0 100.0% 0.0%

bifrost-javascript-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-javascript-modeling-attempt-01/bifrost-javascript-modeling.json (e29d64ef432d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 2 2 4 16 0 100.0% 0.0%

bifrost-javascript-native-taint-taint-tool-native

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-javascript-native-attempt-01/bifrost-javascript-native.json (87401d1d6921…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

bifrost-kotlin-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-kotlin-kernel-attempt-01/bifrost-kotlin-kernel.json (085c86db9aa1…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 70 16 16 38 0 0 100.0% 0.0%

bifrost-php-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-php-kernel-attempt-01/bifrost-php-kernel.json (19b441599b9d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 70 17 17 36 0 0 100.0% 0.0%

bifrost-python-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-python-kernel-attempt-01/bifrost-python-kernel.json (48a001725cdd…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 70 21 21 28 0 0 100.0% 0.0%

bifrost-python-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-python-modeling-attempt-01/bifrost-python-modeling.json (4a0d2595ff9c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 4 3 1 16 0 100.0% 0.0%

bifrost-python-native-taint-taint-tool-native

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-python-native-attempt-01/bifrost-python-native.json (ffb01f7a6627…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 0 0 12 0 n/a n/a

bifrost-ruby-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-ruby-kernel-attempt-01/bifrost-ruby-kernel.json (2a4cb99b0d4f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 70 18 18 34 0 0 100.0% 0.0%

bifrost-rust-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-rust-kernel-attempt-01/bifrost-rust-kernel.json (50c723257f98…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 62 21 21 20 0 0 100.0% 0.0%
rust language-extension 2 0 0 2 0 0 n/a n/a

bifrost-scala-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-scala-kernel-attempt-01/bifrost-scala-kernel.json (fab916aaf850…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
scala core 70 21 21 28 0 0 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-smoke-attempt-01/bifrost-smoke.json (bdf965769125…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 2 1 1 0 0 0 100.0% 0.0%
cpp core 2 1 1 0 0 0 100.0% 0.0%
csharp core 2 1 1 0 0 0 100.0% 0.0%
go core 2 1 1 0 0 0 100.0% 0.0%
java calibration 2 1 0 0 1 0 not scored not scored
java core 32 16 16 0 0 0 100.0% 0.0%
javascript core 32 16 16 0 0 0 100.0% 0.0%
kotlin core 2 1 1 0 0 0 100.0% 0.0%
php core 2 1 1 0 0 0 100.0% 0.0%
python core 32 16 16 0 0 0 100.0% 0.0%
ruby core 2 1 1 0 0 0 100.0% 0.0%
rust core 2 1 1 0 0 0 100.0% 0.0%
scala core 2 1 1 0 0 0 100.0% 0.0%
typescript core 2 1 1 0 0 0 100.0% 0.0%

bifrost-typescript-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.12.0 (build 676def6c6615, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/bifrost-typescript-kernel-attempt-01/bifrost-typescript-kernel.json (9383ec9d3eae…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 70 23 23 24 0 0 100.0% 0.0%

codeql-c-kernel-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-c-kernel-attempt-01/codeql-c-kernel.json (bd964e541b1b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 56 28 27 1 0 0 76.8% 19.5%
c language-extension 2 2 0 0 0 0 100.0% n/a

codeql-cpp-kernel-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-cpp-kernel-attempt-01/codeql-cpp-kernel.json (c1f185afe04a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 68 25 42 1 0 0 57.3% 19.9%

codeql-csharp-kernel-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-csharp-kernel-attempt-01/codeql-csharp-kernel.json (28da895de872…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
csharp core 70 33 36 1 0 0 77.9% 28.5%

codeql-go-kernel-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-go-kernel-attempt-01/codeql-go-kernel.json (fdacf51005ab…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 70 31 39 0 0 0 67.3% 24.0%

codeql-java-kernel-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-java-kernel-attempt-01/codeql-java-kernel.json (01937e57f671…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 36 34 0 0 0 79.4% 26.9%

codeql-java-modeling-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-java-modeling-attempt-01/codeql-java-modeling.json (375d738de136…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-java-native-taint-taint-tool-native

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-java-native-attempt-01/codeql-java-native.json (c939ff5472f1…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 7 5 0 0 0 100.0% 29.2%

codeql-javascript-kernel-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-javascript-kernel-attempt-01/codeql-javascript-kernel.json (18e1381bb722…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 70 32 38 0 0 0 79.1% 24.1%

codeql-javascript-modeling-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-javascript-modeling-attempt-01/codeql-javascript-modeling.json (ae098ee34e54…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-javascript-native-taint-taint-tool-native

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-javascript-native-attempt-01/codeql-javascript-native.json (899bfe028394…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 7 5 0 0 0 70.8% 58.3%

codeql-kotlin-kernel-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-kotlin-kernel-attempt-01/codeql-kotlin-kernel.json (07e6255a2c05…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 70 32 38 0 0 0 69.2% 23.8%

codeql-python-kernel-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-python-kernel-attempt-01/codeql-python-kernel.json (2dff410bf650…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 70 32 37 1 0 0 79.1% 27.5%

codeql-python-modeling-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-python-modeling-attempt-01/codeql-python-modeling.json (550555da81c9…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-python-native-taint-taint-tool-native

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-python-native-attempt-01/codeql-python-native.json (402f18cd98ea…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 8 4 0 0 0 100.0% 58.3%

codeql-ruby-kernel-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-ruby-kernel-attempt-01/codeql-ruby-kernel.json (365b210c0e7f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 70 31 38 1 0 0 73.1% 24.8%

codeql-rust-kernel-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-rust-kernel-attempt-01/codeql-rust-kernel.json (a75f27e4e601…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 62 24 38 0 0 0 67.0% 8.1%
rust language-extension 2 0 2 0 0 0 0.0% 0.0%

codeql-typescript-kernel-taint-taint-benchmark-controlled

codeql 2.27.1 (build 938af3639d07, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-typescript-kernel-attempt-01/codeql-typescript-kernel.json (ff0513fe85a7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 70 32 38 0 0 0 79.1% 24.1%

flowdroid-java-kernel-taint-taint-benchmark-controlled

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/flowdroid-java-kernel-attempt-01/flowdroid-java-kernel.json (0d27b1a3cdda…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 34 36 0 0 0 86.8% 11.4%

flowdroid-java-modeling-taint-taint-benchmark-controlled

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/flowdroid-java-modeling-attempt-01/flowdroid-java-modeling.json (10245102e301…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 7 7 0 10 0 100.0% 0.0%

flowdroid-java-native-taint-taint-tool-native

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/flowdroid-java-native-attempt-01/flowdroid-java-native.json (e048d3e00a52…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

flowdroid-kotlin-kernel-taint-taint-benchmark-controlled

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/flowdroid-kotlin-kernel-attempt-01/flowdroid-kotlin-kernel.json (335028ae4abd…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 70 36 34 0 0 0 89.9% 17.9%

infer-c-kernel-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/infer-c-kernel-attempt-01/infer-c-kernel.json (f1181c1984d5…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 56 21 35 0 0 0 64.4% 7.3%

infer-cpp-kernel-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/infer-cpp-kernel-attempt-01/infer-cpp-kernel.json (923b49de71e2…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 68 19 49 0 0 0 44.6% 0.0%

infer-java-kernel-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/infer-java-kernel-attempt-01/infer-java-kernel.json (aca645f12c64…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 22 48 0 0 0 56.7% 0.0%

infer-java-modeling-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/infer-java-modeling-attempt-01/infer-java-modeling.json (325d56f4069a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 5 5 0 14 0 100.0% 0.0%

infer-java-native-taint-taint-tool-native

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/infer-java-native-attempt-01/infer-java-native.json (cba8a38eebd7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

joern-java-kernel-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-java-kernel-attempt-01/joern-java-kernel.json (db36ae8d1d8c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 32 38 0 0 0 74.2% 19.4%

joern-java-modeling-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-java-modeling-attempt-01/joern-java-modeling.json (aecb8fb31ace…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 6 10 0 8 0 50.0% 0.0%

joern-java-native-taint-taint-tool-native

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-java-native-attempt-01/joern-java-native.json (304eb5e86f0c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

joern-javascript-kernel-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-javascript-kernel-attempt-01/joern-javascript-kernel.json (7a94e664bfb6…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 70 32 38 0 0 0 71.0% 15.3%

joern-javascript-modeling-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-javascript-modeling-attempt-01/joern-javascript-modeling.json (d39c0404c5af…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 6 10 0 8 0 50.0% 0.0%

joern-javascript-native-taint-taint-tool-native

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-javascript-native-attempt-01/joern-javascript-native.json (616a6f6a3d5d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

joern-php-kernel-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-php-kernel-attempt-01/joern-php-kernel.json (11cfb0162bda…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 70 31 39 0 0 0 73.0% 17.5%

joern-python-kernel-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-python-kernel-attempt-01/joern-python-kernel.json (c02d8bb38a5a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 70 29 41 0 0 0 65.6% 12.5%

joern-python-modeling-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-python-modeling-attempt-01/joern-python-modeling.json (0a16dd739cf2…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 6 10 0 8 0 50.0% 0.0%

joern-python-native-taint-taint-tool-native

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-python-native-attempt-01/joern-python-native.json (a247643bc313…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 0 0 12 0 n/a n/a

joern-ruby-kernel-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-ruby-kernel-attempt-01/joern-ruby-kernel.json (8354a4fce495…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 70 35 35 0 0 0 64.5% 46.9%

joern-rust-kernel-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-rust-kernel-attempt-01/joern-rust-kernel.json (286567625014…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 62 24 38 0 0 0 66.2% 16.8%

opentaint-java-kernel-taint-taint-benchmark-controlled

opentaint v0.4.6 (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/opentaint-java-kernel-attempt-01/opentaint-java-kernel.json (af106d8a9cc9…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 36 34 0 0 0 79.8% 14.9%

opentaint-java-modeling-taint-taint-benchmark-controlled

opentaint v0.4.6 (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/opentaint-java-modeling-attempt-01/opentaint-java-modeling.json (948461bd2700…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 6 6 0 12 0 100.0% 0.0%

opentaint-java-native-taint-taint-tool-native

opentaint v0.4.6 (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/opentaint-java-native-attempt-01/opentaint-java-native.json (0fde5b9005e3…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

opentaint-kotlin-kernel-taint-taint-benchmark-controlled

opentaint v0.4.6 (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/opentaint-kotlin-kernel-attempt-01/opentaint-kotlin-kernel.json (b23ed71666d6…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 70 37 33 0 0 0 79.5% 20.1%

pysa-python-kernel-taint-taint-benchmark-controlled

pysa 0.10.0 (build pyre-check:0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/pysa-python-kernel-attempt-01/pysa-python-kernel.json (661f33a6c9cc…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 70 23 47 0 0 0 51.2% 5.7%

pysa-python-modeling-taint-taint-benchmark-controlled

pysa 0.10.0 (build pyre-check:0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/pysa-python-modeling-attempt-01/pysa-python-modeling.json (5a913ce61996…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 10 10 0 4 0 100.0% 0.0%

pysa-python-native-taint-taint-tool-native

pysa 0.10.0 (build pyre-check:0, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/pysa-python-native-attempt-01/pysa-python-native.json (72c41e47101e…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 12 0 0 0 0.0% 0.0%

semgrep-c-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-c-kernel-attempt-01/semgrep-c-kernel.json (4603d40444f2…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 56 9 5 0 42 0 100.0% 42.9%

semgrep-cpp-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-cpp-kernel-attempt-01/semgrep-cpp-kernel.json (32e39e52e037…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 68 9 5 0 54 0 100.0% 42.9%

semgrep-go-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-go-kernel-attempt-01/semgrep-go-kernel.json (20da30e837b7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 70 9 5 0 56 0 100.0% 42.9%

semgrep-java-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-java-kernel-attempt-01/semgrep-java-kernel.json (510c367061ff…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 9 5 0 56 0 100.0% 42.9%

semgrep-java-modeling-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-java-modeling-attempt-01/semgrep-java-modeling.json (27c2393988bb…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-java-native-taint-taint-tool-native

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-java-native-attempt-01/semgrep-java-native.json (a88b8bb55dfa…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

semgrep-javascript-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-javascript-kernel-attempt-01/semgrep-javascript-kernel.json (de6f2097ec39…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 70 9 5 0 56 0 100.0% 42.9%

semgrep-javascript-modeling-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-javascript-modeling-attempt-01/semgrep-javascript-modeling.json (f3a45927ab07…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-javascript-native-taint-taint-tool-native

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-javascript-native-attempt-01/semgrep-javascript-native.json (c0c832586170…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

semgrep-kotlin-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-kotlin-kernel-attempt-01/semgrep-kotlin-kernel.json (62876e3514cf…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 70 9 5 0 56 0 100.0% 42.9%

semgrep-php-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-php-kernel-attempt-01/semgrep-php-kernel.json (2b963198c149…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 70 9 5 0 56 0 100.0% 42.9%

semgrep-python-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-python-kernel-attempt-01/semgrep-python-kernel.json (5b56eba9a1b0…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 70 9 5 0 56 0 100.0% 42.9%

semgrep-python-modeling-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-python-modeling-attempt-01/semgrep-python-modeling.json (aae0cd301221…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-python-native-taint-taint-tool-native

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-python-native-attempt-01/semgrep-python-native.json (22012b9e6989…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 10 2 0 0 0 100.0% 91.7%

semgrep-ruby-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-ruby-kernel-attempt-01/semgrep-ruby-kernel.json (4544d4bff866…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 70 9 5 0 56 0 100.0% 42.9%

semgrep-rust-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-rust-kernel-attempt-01/semgrep-rust-kernel.json (557103313e53…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 62 9 5 0 48 0 100.0% 42.9%

semgrep-typescript-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/semgrep-typescript-kernel-attempt-01/semgrep-typescript-kernel.json (88cabd99661f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 70 9 5 0 56 0 100.0% 42.9%

joern-swift-core-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter joern-normal-v1) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-swift-common108-attempt-01/joern-swift-core.json (76f7f1e91268…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
swift core 66 0 0 66 0 0 n/a n/a

joern-swift-modeling-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter joern-normal-v1) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-swift-common108-attempt-01/joern-swift-modeling.json (8bc9bd91dbb7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
swift modeling 24 0 0 24 0 0 n/a n/a

joern-swift-calibration-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter joern-normal-v1) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-swift-common108-attempt-01/joern-swift-calibration.json (14309f833036…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
swift calibration 4 0 0 4 0 0 not scored not scored

joern-swift-native-taint-taint-tool-native

joern 4.0.628 (build joern-cli:4., adapter joern-normal-v1) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-swift-common108-attempt-01/joern-swift-native.json (63911a187877…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
swift modeling 12 0 0 0 12 0 n/a n/a

joern-swift-language-extension-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter joern-normal-v1) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/joern-swift-common108-attempt-01/joern-swift-language-extension.json (7237eb7e55d8…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
swift language-extension 2 0 0 2 0 0 n/a n/a

codeql-swift-core-taint-taint-benchmark-controlled

codeql 2.27.1 (build codeql:938af, adapter swift-normal-v1) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-swift-common108-attempt-01/codeql-swift-core.json (ad20aef88c0a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
swift core 66 0 0 65 0 1 n/a n/a

codeql-swift-modeling-taint-taint-benchmark-controlled

codeql 2.27.1 (build codeql:938af, adapter swift-normal-v1) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-swift-common108-attempt-01/codeql-swift-modeling.json (4d4329855d8c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
swift modeling 24 0 0 24 0 0 n/a n/a

codeql-swift-calibration-taint-taint-benchmark-controlled

codeql 2.27.1 (build codeql:938af, adapter swift-normal-v1) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-swift-common108-attempt-01/codeql-swift-calibration.json (548917a9fddd…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
swift calibration 4 0 0 4 0 0 not scored not scored

codeql-swift-native-taint-taint-tool-native

codeql 2.27.1 (build codeql:938af, adapter swift-normal-v1) — track taint, dimension taint, model profile tool-native. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-swift-common108-attempt-01/codeql-swift-native.json (2b83e2436da7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
swift modeling 12 0 0 12 0 0 n/a n/a

codeql-swift-language-extension-taint-taint-benchmark-controlled

codeql 2.27.1 (build codeql:938af, adapter swift-normal-v1) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/releases/v0.9.0/normal/attempts/codeql-swift-common108-attempt-01/codeql-swift-language-extension.json (c381ea80275c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
swift language-extension 2 0 0 2 0 0 n/a n/a

bifrost-c-kernel-taint-taint-benchmark-controlled — c, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 2 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 4 0 0 4 6 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 6 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 8 0 0 8 12 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 0 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-c-kernel-taint-taint-benchmark-controlled — c, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
flow-sensitivity 0 0 0 0 1 0 0 n/a n/a n/a n/a
heap-field-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
interprocedural-flow 0 0 0 0 1 0 0 n/a n/a n/a n/a
local-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a

bifrost-cpp-kernel-taint-taint-benchmark-controlled — cpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 12 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 4 0 0 4 18 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 26 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

bifrost-csharp-kernel-taint-taint-benchmark-controlled — csharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 14 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 9 0 0 9 16 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-go-kernel-taint-taint-benchmark-controlled — go, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 1 0 0 1 10 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 4 0 0 4 14 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 10 0 0 10 14 0 0 10/10 (100.0%) 0/10 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 8 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 0 0 4 2 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
dynamic-dispatch 1 0 0 1 12 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 4 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 9 0 0 9 12 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 1 1 0 0 2/2 (100.0%) 0/1 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-javascript-kernel-taint-taint-benchmark-controlled — javascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 1 0 0 1 10 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 4 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 7 0 0 7 10 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
interprocedural-flow 10 0 0 10 14 0 0 10/10 (100.0%) 0/10 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 4 0 0 4 4 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 0 0 0 0 4 0 0 n/a n/a n/a n/a
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-javascript-native-taint-taint-tool-native — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 26 0 0 n/a n/a n/a n/a
interprocedural-flow 9 0 0 9 20 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-php-kernel-taint-taint-benchmark-controlled — php, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 2 0 0 2 14 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 26 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 5 0 0 5 6 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

bifrost-python-kernel-taint-taint-benchmark-controlled — python, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 4 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 16 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 9 0 0 9 20 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-python-modeling-taint-taint-benchmark-controlled — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 1 1 0 0 2/2 (100.0%) 0/1 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-python-native-taint-taint-tool-native — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-ruby-kernel-taint-taint-benchmark-controlled — ruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 4 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 2 0 0 2 14 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 7 0 0 7 12 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 26 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 6 0 0 6 4 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
flow-sensitivity 5 0 0 5 4 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 9 0 0 9 10 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 0 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
heap-field-sensitivity 0 0 0 0 2 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-scala-kernel-taint-taint-benchmark-controlled — scala, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 4 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 16 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 9 0 0 9 20 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — c, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — cpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — csharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — go, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — javascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — kotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — php, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — python, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — ruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — rust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — scala, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — typescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-typescript-kernel-taint-taint-benchmark-controlled — typescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 1 0 0 1 10 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 12 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 10 0 0 10 14 0 0 10/10 (100.0%) 0/10 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 4 0 0 4 4 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

codeql-c-kernel-taint-taint-benchmark-controlled — c, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 1 0 4 0 0 0 3/4 (75.0%) 0/4 (0.0%) 75.0% 0.0%
dynamic-dispatch 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
heap-field-sensitivity 7 2 3 6 0 0 0 7/9 (77.8%) 3/9 (33.3%) 77.8% 33.3%
interprocedural-flow 11 3 1 13 0 0 0 11/14 (78.6%) 1/14 (7.1%) 78.6% 7.1%
local-flow 7 0 1 5 1 0 0 7/7 (100.0%) 1/6 (16.7%) 100.0% 16.7%
object-sensitivity 3 2 1 4 0 0 0 3/5 (60.0%) 1/5 (20.0%) 60.0% 20.0%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%

codeql-c-kernel-taint-taint-benchmark-controlled — c, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
flow-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
heap-field-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
interprocedural-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
local-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a

codeql-cpp-kernel-taint-taint-benchmark-controlled — cpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 3 0 5 0 0 0 2/5 (40.0%) 0/5 (0.0%) 40.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
exceptional-flow 1 2 1 2 0 0 0 1/3 (33.3%) 1/3 (33.3%) 33.3% 33.3%
flow-sensitivity 8 1 3 6 0 0 0 8/9 (88.9%) 3/9 (33.3%) 88.9% 33.3%
heap-field-sensitivity 5 8 3 10 0 0 0 5/13 (38.5%) 3/13 (23.1%) 38.5% 23.1%
interprocedural-flow 11 6 2 15 0 0 0 11/17 (64.7%) 2/17 (11.8%) 64.7% 11.8%
local-flow 7 1 1 6 1 0 0 7/8 (87.5%) 1/7 (14.3%) 87.5% 14.3%
object-sensitivity 1 4 0 5 0 0 0 1/5 (20.0%) 0/5 (0.0%) 20.0% 0.0%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%

codeql-csharp-kernel-taint-taint-benchmark-controlled — csharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 2 1 2 1 0 0 0 2/3 (66.7%) 2/3 (66.7%) 66.7% 66.7%
flow-sensitivity 9 0 4 5 0 0 0 9/9 (100.0%) 4/9 (44.4%) 100.0% 44.4%
heap-field-sensitivity 9 3 5 7 0 0 0 9/12 (75.0%) 5/12 (41.7%) 75.0% 41.7%
interprocedural-flow 14 3 3 14 0 0 0 14/17 (82.4%) 3/17 (17.6%) 82.4% 17.6%
local-flow 6 2 1 6 1 0 0 6/8 (75.0%) 1/7 (14.3%) 75.0% 14.3%
object-sensitivity 4 2 1 5 0 0 0 4/6 (66.7%) 1/6 (16.7%) 66.7% 16.7%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%

codeql-go-kernel-taint-taint-benchmark-controlled — go, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 1 5 0 6 0 0 0 1/6 (16.7%) 0/6 (0.0%) 16.7% 0.0%
exceptional-flow 1 2 1 2 0 0 0 1/3 (33.3%) 1/3 (33.3%) 33.3% 33.3%
flow-sensitivity 8 1 3 6 0 0 0 8/9 (88.9%) 3/9 (33.3%) 88.9% 33.3%
heap-field-sensitivity 8 3 4 7 0 0 0 8/11 (72.7%) 4/11 (36.4%) 72.7% 36.4%
interprocedural-flow 13 4 2 15 0 0 0 13/17 (76.5%) 2/17 (11.8%) 76.5% 11.8%
local-flow 6 2 2 6 0 0 0 6/8 (75.0%) 2/8 (25.0%) 75.0% 25.0%
object-sensitivity 4 2 1 5 0 0 0 4/6 (66.7%) 1/6 (16.7%) 66.7% 16.7%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 5 1 1 5 0 0 0 5/6 (83.3%) 1/6 (16.7%) 83.3% 16.7%

codeql-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 5 2 2 5 0 0 0 5/7 (71.4%) 2/7 (28.6%) 71.4% 28.6%
exceptional-flow 1 2 1 2 0 0 0 1/3 (33.3%) 1/3 (33.3%) 33.3% 33.3%
flow-sensitivity 8 1 3 6 0 0 0 8/9 (88.9%) 3/9 (33.3%) 88.9% 33.3%
heap-field-sensitivity 9 4 5 8 0 0 0 9/13 (69.2%) 5/13 (38.5%) 69.2% 38.5%
interprocedural-flow 14 1 2 13 0 0 0 14/15 (93.3%) 2/15 (13.3%) 93.3% 13.3%
local-flow 6 2 1 7 0 0 0 6/8 (75.0%) 1/8 (12.5%) 75.0% 12.5%
object-sensitivity 4 1 2 3 0 0 0 4/5 (80.0%) 2/5 (40.0%) 80.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 5 1 1 5 0 0 0 5/6 (83.3%) 1/6 (16.7%) 83.3% 16.7%

codeql-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 1 5 0 0 0 6/6 (100.0%) 1/6 (16.7%) 100.0% 16.7%
sanitizer 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-javascript-kernel-taint-taint-benchmark-controlled — javascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
flow-sensitivity 9 0 4 5 0 0 0 9/9 (100.0%) 4/9 (44.4%) 100.0% 44.4%
heap-field-sensitivity 9 3 4 8 0 0 0 9/12 (75.0%) 4/12 (33.3%) 75.0% 33.3%
interprocedural-flow 14 3 3 14 0 0 0 14/17 (82.4%) 3/17 (17.6%) 82.4% 17.6%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%

codeql-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-javascript-native-taint-taint-tool-native — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 1 0 0 0 0 0/1 (0.0%) 1/1 (100.0%) 0.0% 100.0%
local-flow 5 1 2 4 0 0 0 5/6 (83.3%) 2/6 (33.3%) 83.3% 33.3%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

codeql-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 2 5 1 6 0 0 0 2/7 (28.6%) 1/7 (14.3%) 28.6% 14.3%
exceptional-flow 1 2 1 2 0 0 0 1/3 (33.3%) 1/3 (33.3%) 33.3% 33.3%
flow-sensitivity 8 1 3 6 0 0 0 8/9 (88.9%) 3/9 (33.3%) 88.9% 33.3%
heap-field-sensitivity 9 4 5 8 0 0 0 9/13 (69.2%) 5/13 (38.5%) 69.2% 38.5%
interprocedural-flow 14 5 3 16 0 0 0 14/19 (73.7%) 3/19 (15.8%) 73.7% 15.8%
local-flow 6 2 1 7 0 0 0 6/8 (75.0%) 1/8 (12.5%) 75.0% 12.5%
object-sensitivity 4 1 2 3 0 0 0 4/5 (80.0%) 2/5 (40.0%) 80.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 5 1 1 5 0 0 0 5/6 (83.3%) 1/6 (16.7%) 83.3% 16.7%

codeql-python-kernel-taint-taint-benchmark-controlled — python, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 5 0 7 0 0 0 2/7 (28.6%) 0/7 (0.0%) 28.6% 0.0%
exceptional-flow 2 1 2 1 0 0 0 2/3 (66.7%) 2/3 (66.7%) 66.7% 66.7%
flow-sensitivity 9 0 4 5 0 0 0 9/9 (100.0%) 4/9 (44.4%) 100.0% 44.4%
heap-field-sensitivity 9 4 4 9 0 0 0 9/13 (69.2%) 4/13 (30.8%) 69.2% 30.8%
interprocedural-flow 15 4 3 16 0 0 0 15/19 (78.9%) 3/19 (15.8%) 78.9% 15.8%
local-flow 7 1 1 6 1 0 0 7/8 (87.5%) 1/7 (14.3%) 87.5% 14.3%
object-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%

codeql-python-modeling-taint-taint-benchmark-controlled — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-python-native-taint-taint-tool-native — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

codeql-ruby-kernel-taint-taint-benchmark-controlled — ruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 1 6 0 7 0 0 0 1/7 (14.3%) 0/7 (0.0%) 14.3% 0.0%
exceptional-flow 2 1 2 1 0 0 0 2/3 (66.7%) 2/3 (66.7%) 66.7% 66.7%
flow-sensitivity 9 0 4 5 0 0 0 9/9 (100.0%) 4/9 (44.4%) 100.0% 44.4%
heap-field-sensitivity 9 4 3 10 0 0 0 9/13 (69.2%) 3/13 (23.1%) 69.2% 23.1%
interprocedural-flow 14 5 3 16 0 0 0 14/19 (73.7%) 3/19 (15.8%) 73.7% 15.8%
local-flow 7 1 1 6 1 0 0 7/8 (87.5%) 1/7 (14.3%) 87.5% 14.3%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%

codeql-rust-kernel-taint-taint-benchmark-controlled — rust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
flow-sensitivity 6 1 1 6 0 0 0 6/7 (85.7%) 1/7 (14.3%) 85.7% 14.3%
heap-field-sensitivity 5 4 1 8 0 0 0 5/9 (55.6%) 1/9 (11.1%) 55.6% 11.1%
interprocedural-flow 10 4 0 14 0 0 0 10/14 (71.4%) 0/14 (0.0%) 71.4% 0.0%
local-flow 7 0 1 6 0 0 0 7/7 (100.0%) 1/7 (14.3%) 100.0% 14.3%
object-sensitivity 3 3 0 6 0 0 0 3/6 (50.0%) 0/6 (0.0%) 50.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%

codeql-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
heap-field-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

codeql-typescript-kernel-taint-taint-benchmark-controlled — typescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
flow-sensitivity 9 0 4 5 0 0 0 9/9 (100.0%) 4/9 (44.4%) 100.0% 44.4%
heap-field-sensitivity 9 3 4 8 0 0 0 9/12 (75.0%) 4/12 (33.3%) 75.0% 33.3%
interprocedural-flow 14 3 3 14 0 0 0 14/17 (82.4%) 3/17 (17.6%) 82.4% 17.6%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%

flowdroid-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 5 1 6 0 0 0 2/7 (28.6%) 1/7 (14.3%) 28.6% 14.3%
exceptional-flow 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
flow-sensitivity 9 0 1 8 0 0 0 9/9 (100.0%) 1/9 (11.1%) 100.0% 11.1%
heap-field-sensitivity 12 1 3 10 0 0 0 12/13 (92.3%) 3/13 (23.1%) 92.3% 23.1%
interprocedural-flow 13 2 0 15 0 0 0 13/15 (86.7%) 0/15 (0.0%) 86.7% 0.0%
local-flow 8 0 1 7 0 0 0 8/8 (100.0%) 1/8 (12.5%) 100.0% 12.5%
object-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%

flowdroid-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 4 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

flowdroid-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

flowdroid-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 2 5 0 0 0 3/7 (42.9%) 2/7 (28.6%) 42.9% 28.6%
exceptional-flow 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
flow-sensitivity 9 0 1 8 0 0 0 9/9 (100.0%) 1/9 (11.1%) 100.0% 11.1%
heap-field-sensitivity 12 1 3 10 0 0 0 12/13 (92.3%) 3/13 (23.1%) 92.3% 23.1%
interprocedural-flow 16 3 2 17 0 0 0 16/19 (84.2%) 2/19 (10.5%) 84.2% 10.5%
local-flow 8 0 1 7 0 0 0 8/8 (100.0%) 1/8 (12.5%) 100.0% 12.5%
object-sensitivity 5 0 2 3 0 0 0 5/5 (100.0%) 2/5 (40.0%) 100.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%

infer-c-kernel-taint-taint-benchmark-controlled — c, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 0 1 3 0 0 0 4/4 (100.0%) 1/4 (25.0%) 100.0% 25.0%
dynamic-dispatch 2 1 1 2 0 0 0 2/3 (66.7%) 1/3 (33.3%) 66.7% 33.3%
flow-sensitivity 2 5 0 7 0 0 0 2/7 (28.6%) 0/7 (0.0%) 28.6% 0.0%
heap-field-sensitivity 8 1 0 9 0 0 0 8/9 (88.9%) 0/9 (0.0%) 88.9% 0.0%
interprocedural-flow 8 6 1 13 0 0 0 8/14 (57.1%) 1/14 (7.1%) 57.1% 7.1%
local-flow 5 2 0 7 0 0 0 5/7 (71.4%) 0/7 (0.0%) 71.4% 0.0%
object-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
path-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
recursion 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%

infer-cpp-kernel-taint-taint-benchmark-controlled — cpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 3 0 5 0 0 0 2/5 (40.0%) 0/5 (0.0%) 40.0% 0.0%
exceptional-flow 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 2 7 0 9 0 0 0 2/9 (22.2%) 0/9 (0.0%) 22.2% 0.0%
heap-field-sensitivity 7 6 0 13 0 0 0 7/13 (53.8%) 0/13 (0.0%) 53.8% 0.0%
interprocedural-flow 7 10 0 17 0 0 0 7/17 (41.2%) 0/17 (0.0%) 41.2% 0.0%
local-flow 5 3 0 8 0 0 0 5/8 (62.5%) 0/8 (0.0%) 62.5% 0.0%
object-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
path-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
recursion 0 6 0 6 0 0 0 0/6 (0.0%) 0/6 (0.0%) 0.0% 0.0%

infer-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 3 4 0 7 0 0 0 3/7 (42.9%) 0/7 (0.0%) 42.9% 0.0%
exceptional-flow 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
flow-sensitivity 3 6 0 9 0 0 0 3/9 (33.3%) 0/9 (0.0%) 33.3% 0.0%
heap-field-sensitivity 9 4 0 13 0 0 0 9/13 (69.2%) 0/13 (0.0%) 69.2% 0.0%
interprocedural-flow 8 7 0 15 0 0 0 8/15 (53.3%) 0/15 (0.0%) 53.3% 0.0%
local-flow 6 2 0 8 0 0 0 6/8 (75.0%) 0/8 (0.0%) 75.0% 0.0%
object-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
path-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
recursion 0 6 0 6 0 0 0 0/6 (0.0%) 0/6 (0.0%) 0.0% 0.0%

infer-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 1 0 0 1 0 10 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

infer-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 2 5 0 0 0 3/7 (42.9%) 2/7 (28.6%) 42.9% 28.6%
exceptional-flow 1 2 0 3 0 0 0 1/3 (33.3%) 0/3 (0.0%) 33.3% 0.0%
flow-sensitivity 8 1 2 7 0 0 0 8/9 (88.9%) 2/9 (22.2%) 88.9% 22.2%
heap-field-sensitivity 9 4 1 12 0 0 0 9/13 (69.2%) 1/13 (7.7%) 69.2% 7.7%
interprocedural-flow 12 3 1 14 0 0 0 12/15 (80.0%) 1/15 (6.7%) 80.0% 6.7%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 6 0 1 5 0 0 0 6/6 (100.0%) 1/6 (16.7%) 100.0% 16.7%

joern-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-javascript-kernel-taint-taint-benchmark-controlled — javascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 1 2 0 3 0 0 0 1/3 (33.3%) 0/3 (0.0%) 33.3% 0.0%
flow-sensitivity 8 1 1 8 0 0 0 8/9 (88.9%) 1/9 (11.1%) 88.9% 11.1%
heap-field-sensitivity 8 4 4 8 0 0 0 8/12 (66.7%) 4/12 (33.3%) 66.7% 33.3%
interprocedural-flow 12 5 0 17 0 0 0 12/17 (70.6%) 0/17 (0.0%) 70.6% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 3 1 5 0 0 0 3/6 (50.0%) 1/6 (16.7%) 50.0% 16.7%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%

joern-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-javascript-native-taint-taint-tool-native — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-php-kernel-taint-taint-benchmark-controlled — php, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 1 6 0 0 0 3/7 (42.9%) 1/7 (14.3%) 42.9% 14.3%
exceptional-flow 1 2 0 3 0 0 0 1/3 (33.3%) 0/3 (0.0%) 33.3% 0.0%
flow-sensitivity 8 1 2 7 0 0 0 8/9 (88.9%) 2/9 (22.2%) 88.9% 22.2%
heap-field-sensitivity 9 4 0 13 0 0 0 9/13 (69.2%) 0/13 (0.0%) 69.2% 0.0%
interprocedural-flow 13 6 2 17 0 0 0 13/19 (68.4%) 2/19 (10.5%) 68.4% 10.5%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 6 0 1 5 0 0 0 6/6 (100.0%) 1/6 (16.7%) 100.0% 16.7%

joern-python-kernel-taint-taint-benchmark-controlled — python, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 3 4 1 6 0 0 0 3/7 (42.9%) 1/7 (14.3%) 42.9% 14.3%
exceptional-flow 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 7 2 1 8 0 0 0 7/9 (77.8%) 1/9 (11.1%) 77.8% 11.1%
heap-field-sensitivity 8 5 1 12 0 0 0 8/13 (61.5%) 1/13 (7.7%) 61.5% 7.7%
interprocedural-flow 12 7 0 19 0 0 0 12/19 (63.2%) 0/19 (0.0%) 63.2% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 5 1 0 6 0 0 0 5/6 (83.3%) 0/6 (0.0%) 83.3% 0.0%

joern-python-modeling-taint-taint-benchmark-controlled — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-python-native-taint-taint-tool-native — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-ruby-kernel-taint-taint-benchmark-controlled — ruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 3 2 3 0 0 0 2/5 (40.0%) 2/5 (40.0%) 40.0% 40.0%
dynamic-dispatch 1 6 1 6 0 0 0 1/7 (14.3%) 1/7 (14.3%) 14.3% 14.3%
exceptional-flow 2 1 2 1 0 0 0 2/3 (66.7%) 2/3 (66.7%) 66.7% 66.7%
flow-sensitivity 9 0 7 2 0 0 0 9/9 (100.0%) 7/9 (77.8%) 100.0% 77.8%
heap-field-sensitivity 7 6 4 9 0 0 0 7/13 (53.8%) 4/13 (30.8%) 53.8% 30.8%
interprocedural-flow 12 7 9 10 0 0 0 12/19 (63.2%) 9/19 (47.4%) 63.2% 47.4%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 1 4 0 5 0 0 0 1/5 (20.0%) 0/5 (0.0%) 20.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 6 0 6 0 0 0 0 6/6 (100.0%) 6/6 (100.0%) 100.0% 100.0%

joern-rust-kernel-taint-taint-benchmark-controlled — rust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
flow-sensitivity 6 1 2 5 0 0 0 6/7 (85.7%) 2/7 (28.6%) 85.7% 28.6%
heap-field-sensitivity 5 4 0 9 0 0 0 5/9 (55.6%) 0/9 (0.0%) 55.6% 0.0%
interprocedural-flow 9 5 1 13 0 0 0 9/14 (64.3%) 1/14 (7.1%) 64.3% 7.1%
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 3 3 0 6 0 0 0 3/6 (50.0%) 0/6 (0.0%) 50.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%

opentaint-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 6 1 2 5 0 0 0 6/7 (85.7%) 2/7 (28.6%) 85.7% 28.6%
exceptional-flow 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 7 2 1 8 0 0 0 7/9 (77.8%) 1/9 (11.1%) 77.8% 11.1%
heap-field-sensitivity 10 3 3 10 0 0 0 10/13 (76.9%) 3/13 (23.1%) 76.9% 23.1%
interprocedural-flow 13 2 0 15 0 0 0 13/15 (86.7%) 0/15 (0.0%) 86.7% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 5 1 0 6 0 0 0 5/6 (83.3%) 0/6 (0.0%) 83.3% 0.0%

opentaint-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 2 0 0 2 0 8 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

opentaint-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

opentaint-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 6 1 3 4 0 0 0 6/7 (85.7%) 3/7 (42.9%) 85.7% 42.9%
exceptional-flow 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 7 2 1 8 0 0 0 7/9 (77.8%) 1/9 (11.1%) 77.8% 11.1%
heap-field-sensitivity 10 3 4 9 0 0 0 10/13 (76.9%) 4/13 (30.8%) 76.9% 30.8%
interprocedural-flow 16 3 2 17 0 0 0 16/19 (84.2%) 2/19 (10.5%) 84.2% 10.5%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 5 0 2 3 0 0 0 5/5 (100.0%) 2/5 (40.0%) 100.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 5 1 0 6 0 0 0 5/6 (83.3%) 0/6 (0.0%) 83.3% 0.0%

pysa-python-kernel-taint-taint-benchmark-controlled — python, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 7 0 7 0 0 0 0/7 (0.0%) 0/7 (0.0%) 0.0% 0.0%
exceptional-flow 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 6 3 1 8 0 0 0 6/9 (66.7%) 1/9 (11.1%) 66.7% 11.1%
heap-field-sensitivity 5 8 0 13 0 0 0 5/13 (38.5%) 0/13 (0.0%) 38.5% 0.0%
interprocedural-flow 10 9 0 19 0 0 0 10/19 (52.6%) 0/19 (0.0%) 52.6% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 3 0 5 0 0 0 2/5 (40.0%) 0/5 (0.0%) 40.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 4 2 0 6 0 0 0 4/6 (66.7%) 0/6 (0.0%) 66.7% 0.0%

pysa-python-modeling-taint-taint-benchmark-controlled — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 4 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

pysa-python-native-taint-taint-tool-native — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 2 0 2 0 0 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
local-flow 0 6 0 6 0 0 0 0/6 (0.0%) 0/6 (0.0%) 0.0% 0.0%
sanitizer 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

semgrep-c-kernel-taint-taint-benchmark-controlled — c, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 8 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 8 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 18 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 28 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 10 0 n/a n/a n/a n/a

semgrep-cpp-kernel-taint-taint-benchmark-controlled — cpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 10 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 26 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 34 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-go-kernel-taint-taint-benchmark-controlled — go, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 22 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 34 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 26 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 30 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-javascript-kernel-taint-taint-benchmark-controlled — javascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 24 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 34 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-javascript-native-taint-taint-tool-native — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 26 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 38 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-php-kernel-taint-taint-benchmark-controlled — php, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 26 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 38 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-python-kernel-taint-taint-benchmark-controlled — python, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 26 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 38 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-python-modeling-taint-taint-benchmark-controlled — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-python-native-taint-taint-tool-native — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 2 0 0 0 0 2/2 (100.0%) 2/2 (100.0%) 100.0% 100.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 4 2 0 0 0 6/6 (100.0%) 4/6 (66.7%) 100.0% 66.7%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

semgrep-ruby-kernel-taint-taint-benchmark-controlled — ruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 26 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 38 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-rust-kernel-taint-taint-benchmark-controlled — rust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 10 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 8 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 18 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 28 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 10 0 n/a n/a n/a n/a

semgrep-typescript-kernel-taint-taint-benchmark-controlled — typescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 24 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 34 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

joern-swift-core-taint-taint-benchmark-controlled — swift, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 8 0 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 0 0 0 0 18 0 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 26 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 34 0 0 n/a n/a n/a n/a
local-flow 0 0 0 0 16 0 0 n/a n/a n/a n/a
object-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
path-sensitivity 0 0 0 0 6 0 0 n/a n/a n/a n/a
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

joern-swift-modeling-taint-taint-benchmark-controlled — swift, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 8 0 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 4 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 12 0 0 n/a n/a n/a n/a
local-flow 0 0 0 0 4 0 0 n/a n/a n/a n/a
object-sensitivity 0 0 0 0 2 0 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 4 0 0 n/a n/a n/a n/a

joern-swift-native-taint-taint-tool-native — swift, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-swift-language-extension-taint-taint-benchmark-controlled — swift, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
heap-field-sensitivity 0 0 0 0 2 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a

codeql-swift-core-taint-taint-benchmark-controlled — swift, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 8 0 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 0 0 0 0 18 0 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 26 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 34 0 0 n/a n/a n/a n/a
local-flow 0 0 0 0 15 0 1 n/a n/a n/a n/a
object-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
path-sensitivity 0 0 0 0 5 0 1 n/a n/a n/a n/a
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

codeql-swift-modeling-taint-taint-benchmark-controlled — swift, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 8 0 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 4 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 12 0 0 n/a n/a n/a n/a
local-flow 0 0 0 0 4 0 0 n/a n/a n/a n/a
object-sensitivity 0 0 0 0 2 0 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 4 0 0 n/a n/a n/a n/a

codeql-swift-native-taint-taint-tool-native — swift, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 4 0 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 2 0 0 n/a n/a n/a n/a
local-flow 0 0 0 0 12 0 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 2 0 0 n/a n/a n/a n/a

codeql-swift-language-extension-taint-taint-benchmark-controlled — swift, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
heap-field-sensitivity 0 0 0 0 2 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a