Skip to content

Analyzers — v0.8.0

Each scorecard is one frozen report: one analyzer, one track, one score dimension, and one model profile. Scorecards remain independent populations. TPR and FPR are macro-averages over templates and semantic dimensions; inconclusive, unsupported, and runner-error remain coverage outcomes.

All 82 reports were rerun over the expanded 1,000-case corpus. The result set contains 4,036 cells, including 556 cells introduced by the new kernels. The tables below are the authority for each analyzer’s rates, denominators, and capability boundaries.

bifrost-c-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-c-kernel.json (ae4c70293d2e…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 56 21 21 14 0 0 100.0% 0.0%
c language-extension 2 1 0 1 0 0 100.0% n/a

bifrost-cpp-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-cpp-kernel.json (7f04a24e2793…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 68 15 15 38 0 0 100.0% 0.0%

bifrost-csharp-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-csharp-kernel.json (14fe93453fd6…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
csharp core 70 18 18 34 0 0 100.0% 0.0%

bifrost-go-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-go-kernel.json (eae8dc5da282…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 70 20 20 30 0 0 100.0% 0.0%

bifrost-java-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-java-kernel.json (e43d83e7ba89…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 23 23 24 0 0 100.0% 0.0%

bifrost-java-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-java-modeling.json (55105ad6a155…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 4 3 1 16 0 100.0% 0.0%

bifrost-java-native-taint-taint-tool-native

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/bifrost-java-native.json (8a54dfb974cc…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

bifrost-javascript-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-javascript-kernel.json (f882345ed20b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 70 20 20 30 0 0 100.0% 0.0%

bifrost-javascript-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-javascript-modeling.json (662d2650e2f1…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 2 2 4 16 0 100.0% 0.0%

bifrost-javascript-native-taint-taint-tool-native

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/bifrost-javascript-native.json (722f1407989d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

bifrost-kotlin-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-kotlin-kernel.json (736f93afb9c3…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 70 16 16 38 0 0 100.0% 0.0%

bifrost-php-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-php-kernel.json (aaadb2814a7a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 70 17 17 36 0 0 100.0% 0.0%

bifrost-python-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-python-kernel.json (b7a84985c737…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 70 18 18 34 0 0 100.0% 0.0%

bifrost-python-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-python-modeling.json (7a1152378263…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 4 3 1 16 0 100.0% 0.0%

bifrost-python-native-taint-taint-tool-native

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/bifrost-python-native.json (d230d03d85f1…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 0 0 12 0 n/a n/a

bifrost-ruby-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-ruby-kernel.json (0735867664a3…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 70 18 18 34 0 0 100.0% 0.0%

bifrost-rust-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-rust-kernel.json (9fccc5326494…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 62 21 21 20 0 0 100.0% 0.0%
rust language-extension 2 0 0 2 0 0 n/a n/a

bifrost-scala-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-scala-kernel.json (bd6d591df86b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
scala core 70 21 21 28 0 0 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-smoke.json (a81a64ccd798…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 2 1 1 0 0 0 100.0% 0.0%
cpp core 2 1 1 0 0 0 100.0% 0.0%
csharp core 2 1 1 0 0 0 100.0% 0.0%
go core 2 1 1 0 0 0 100.0% 0.0%
java calibration 2 1 0 0 1 0 not scored not scored
java core 32 16 16 0 0 0 100.0% 0.0%
javascript core 32 16 16 0 0 0 100.0% 0.0%
kotlin core 2 1 1 0 0 0 100.0% 0.0%
php core 2 1 1 0 0 0 100.0% 0.0%
python core 32 16 16 0 0 0 100.0% 0.0%
ruby core 2 1 1 0 0 0 100.0% 0.0%
rust core 2 1 1 0 0 0 100.0% 0.0%
scala core 2 1 1 0 0 0 100.0% 0.0%
typescript core 2 1 1 0 0 0 100.0% 0.0%

bifrost-typescript-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.4 (build 015ee1f76b04, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-typescript-kernel.json (c5f7d564d016…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 70 19 19 32 0 0 100.0% 0.0%

codeql-c-kernel-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-c-kernel.json (e12a3deb6c98…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 56 0 0 56 0 0 n/a n/a
c language-extension 2 0 0 2 0 0 n/a n/a

codeql-cpp-kernel-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-cpp-kernel.json (f3b049e5365e…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 68 0 0 68 0 0 n/a n/a

codeql-csharp-kernel-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-csharp-kernel.json (87e0df8a950b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
csharp core 70 33 36 1 0 0 77.9% 28.5%

codeql-go-kernel-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-go-kernel.json (89041091c2dd…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 70 31 39 0 0 0 67.3% 24.0%

codeql-java-kernel-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-java-kernel.json (de4dc44d333e…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 36 34 0 0 0 79.4% 26.9%

codeql-java-modeling-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-java-modeling.json (666e913802d2…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-java-native-taint-taint-tool-native

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/codeql-java-native.json (39c69006aa21…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 7 5 0 0 0 100.0% 29.2%

codeql-javascript-kernel-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-javascript-kernel.json (d9ea78eb6484…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 70 32 38 0 0 0 79.1% 24.1%

codeql-javascript-modeling-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-javascript-modeling.json (8a2e516b91eb…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-javascript-native-taint-taint-tool-native

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/codeql-javascript-native.json (b02fb1211af1…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 7 5 0 0 0 70.8% 58.3%

codeql-kotlin-kernel-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-kotlin-kernel.json (83290f0a1f4a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 70 32 38 0 0 0 69.2% 23.8%

codeql-python-kernel-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-python-kernel.json (9d5b5ee5c1c2…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 70 32 37 1 0 0 79.1% 27.5%

codeql-python-modeling-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-python-modeling.json (9a60d102412a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-python-native-taint-taint-tool-native

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/codeql-python-native.json (22e0792a471b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 8 4 0 0 0 100.0% 58.3%

codeql-ruby-kernel-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-ruby-kernel.json (83c4090b11b7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 70 31 38 1 0 0 73.1% 24.8%

codeql-rust-kernel-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-rust-kernel.json (da6772c638a4…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 62 24 38 0 0 0 67.0% 8.1%
rust language-extension 2 0 2 0 0 0 0.0% 0.0%

codeql-typescript-kernel-taint-taint-benchmark-controlled

codeql 2.27.0 (build b47b3e59262c, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-typescript-kernel.json (e71500a35ea7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 70 32 38 0 0 0 79.1% 24.1%

flowdroid-java-kernel-taint-taint-benchmark-controlled

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/flowdroid-java-kernel.json (97fd50bc5541…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 34 36 0 0 0 86.8% 11.4%

flowdroid-java-modeling-taint-taint-benchmark-controlled

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/flowdroid-java-modeling.json (27e1eae52940…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 7 7 0 10 0 100.0% 0.0%

flowdroid-java-native-taint-taint-tool-native

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/flowdroid-java-native.json (d90111f7bb8b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

flowdroid-kotlin-kernel-taint-taint-benchmark-controlled

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/flowdroid-kotlin-kernel.json (efa07c7d2c11…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 70 36 34 0 0 0 89.9% 17.9%

infer-c-kernel-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/infer-c-kernel.json (e241db2aace9…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 56 21 35 0 0 0 64.4% 7.3%

infer-cpp-kernel-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/infer-cpp-kernel.json (ca7ccf79c7b1…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 68 19 49 0 0 0 44.6% 0.0%

infer-java-kernel-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/infer-java-kernel.json (86fb25a6358f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 22 48 0 0 0 56.7% 0.0%

infer-java-modeling-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/infer-java-modeling.json (27592a1298c7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 5 5 0 14 0 100.0% 0.0%

infer-java-native-taint-taint-tool-native

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/infer-java-native.json (c5d70401f184…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

joern-java-kernel-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-java-kernel.json (56a37aad5051…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 32 38 0 0 0 74.2% 19.4%

joern-java-modeling-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-java-modeling.json (1c789f3f3b15…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 6 10 0 8 0 50.0% 0.0%

joern-java-native-taint-taint-tool-native

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/joern-java-native.json (03e3afa6dbdc…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

joern-javascript-kernel-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-javascript-kernel.json (401fdd7bfe2f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 70 32 38 0 0 0 71.0% 15.3%

joern-javascript-modeling-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-javascript-modeling.json (1268dceb8ab1…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 6 10 0 8 0 50.0% 0.0%

joern-javascript-native-taint-taint-tool-native

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/joern-javascript-native.json (3ed903e2d29a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

joern-php-kernel-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-php-kernel.json (7549768d8dd4…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 70 31 39 0 0 0 73.0% 17.5%

joern-python-kernel-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-python-kernel.json (b63865c1aeb2…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 70 29 41 0 0 0 65.6% 12.5%

joern-python-modeling-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-python-modeling.json (1e09345fcf8c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 6 10 0 8 0 50.0% 0.0%

joern-python-native-taint-taint-tool-native

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/joern-python-native.json (3acc8c28a788…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 0 0 12 0 n/a n/a

joern-ruby-kernel-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-ruby-kernel.json (2ea6f41c0383…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 70 35 35 0 0 0 64.5% 46.9%

joern-rust-kernel-taint-taint-benchmark-controlled

joern 4.0.628 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-rust-kernel.json (154cfb92070c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 62 24 38 0 0 0 66.2% 16.8%

opentaint-java-kernel-taint-taint-benchmark-controlled

opentaint v0.4.6 (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/opentaint-java-kernel.json (ddd80129ac50…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 36 34 0 0 0 79.8% 14.9%

opentaint-java-modeling-taint-taint-benchmark-controlled

opentaint v0.4.6 (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/opentaint-java-modeling.json (10405df56b06…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 6 6 0 12 0 100.0% 0.0%

opentaint-java-native-taint-taint-tool-native

opentaint v0.4.6 (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/opentaint-java-native.json (2078837d5b4a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

opentaint-kotlin-kernel-taint-taint-benchmark-controlled

opentaint v0.4.6 (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/opentaint-kotlin-kernel.json (8bf36cd12fcd…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 70 37 33 0 0 0 79.5% 20.1%

pysa-python-kernel-taint-taint-benchmark-controlled

pysa 0.10.0 (build pyre-check:0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/pysa-python-kernel.json (082262d3599d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 70 23 47 0 0 0 51.2% 5.7%

pysa-python-modeling-taint-taint-benchmark-controlled

pysa 0.10.0 (build pyre-check:0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/pysa-python-modeling.json (57fd9e95e58c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 10 10 0 4 0 100.0% 0.0%

pysa-python-native-taint-taint-tool-native

pysa 0.10.0 (build pyre-check:0, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/pysa-python-native.json (13a3091432ec…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 12 0 0 0 0.0% 0.0%

semgrep-c-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-c-kernel.json (4c63e7cd8beb…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 56 9 5 0 42 0 100.0% 42.9%

semgrep-cpp-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-cpp-kernel.json (e534cce9f363…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 68 9 5 0 54 0 100.0% 42.9%

semgrep-go-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-go-kernel.json (e293544a09ff…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 70 9 5 0 56 0 100.0% 42.9%

semgrep-java-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-java-kernel.json (b9535716ec34…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 70 9 5 0 56 0 100.0% 42.9%

semgrep-java-modeling-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-java-modeling.json (35588fe1195f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-java-native-taint-taint-tool-native

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/semgrep-java-native.json (39991c700f6b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

semgrep-javascript-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-javascript-kernel.json (12227cb1b098…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 70 9 5 0 56 0 100.0% 42.9%

semgrep-javascript-modeling-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-javascript-modeling.json (7f5ee098b46a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-javascript-native-taint-taint-tool-native

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/semgrep-javascript-native.json (5bebf3998de2…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

semgrep-kotlin-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-kotlin-kernel.json (1106051ae161…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 70 9 5 0 56 0 100.0% 42.9%

semgrep-php-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-php-kernel.json (7e8bd0f19b69…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 70 9 5 0 56 0 100.0% 42.9%

semgrep-python-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-python-kernel.json (9da217953be5…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 70 9 5 0 56 0 100.0% 42.9%

semgrep-python-modeling-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-python-modeling.json (f1bfa6e777fb…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-python-native-taint-taint-tool-native

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/semgrep-python-native.json (c6ee8d2e41c0…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 10 2 0 0 0 100.0% 91.7%

semgrep-ruby-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-ruby-kernel.json (d516a6c31277…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 70 9 5 0 56 0 100.0% 42.9%

semgrep-rust-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-rust-kernel.json (6136d6785166…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 62 9 5 0 48 0 100.0% 42.9%

semgrep-typescript-kernel-taint-taint-benchmark-controlled

semgrep 1.177.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-typescript-kernel.json (d0aafc38938d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 70 9 5 0 56 0 100.0% 42.9%

bifrost-c-kernel-taint-taint-benchmark-controlled — c, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 2 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 4 0 0 4 6 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 6 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 8 0 0 8 12 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 0 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-c-kernel-taint-taint-benchmark-controlled — c, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
flow-sensitivity 0 0 0 0 1 0 0 n/a n/a n/a n/a
heap-field-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
interprocedural-flow 0 0 0 0 1 0 0 n/a n/a n/a n/a
local-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a

bifrost-cpp-kernel-taint-taint-benchmark-controlled — cpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 12 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 4 0 0 4 18 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 26 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

bifrost-csharp-kernel-taint-taint-benchmark-controlled — csharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 12 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 14 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 22 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

bifrost-go-kernel-taint-taint-benchmark-controlled — go, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 4 0 0 4 14 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 9 0 0 9 16 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 8 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 0 0 4 2 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
dynamic-dispatch 1 0 0 1 12 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 4 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 9 0 0 9 12 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 1 1 0 0 2/2 (100.0%) 0/1 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-javascript-kernel-taint-taint-benchmark-controlled — javascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 4 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 12 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 7 0 0 7 10 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 22 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 4 0 0 4 4 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

bifrost-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 0 0 0 0 4 0 0 n/a n/a n/a n/a
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-javascript-native-taint-taint-tool-native — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 26 0 0 n/a n/a n/a n/a
interprocedural-flow 9 0 0 9 20 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-php-kernel-taint-taint-benchmark-controlled — php, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 2 0 0 2 14 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 26 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 5 0 0 5 6 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

bifrost-python-kernel-taint-taint-benchmark-controlled — python, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 4 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 12 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 16 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 26 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

bifrost-python-modeling-taint-taint-benchmark-controlled — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 1 1 0 0 2/2 (100.0%) 0/1 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-python-native-taint-taint-tool-native — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-ruby-kernel-taint-taint-benchmark-controlled — ruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 4 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 2 0 0 2 14 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 7 0 0 7 12 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 26 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 6 0 0 6 4 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
flow-sensitivity 5 0 0 5 4 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 9 0 0 9 10 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 0 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
heap-field-sensitivity 0 0 0 0 2 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-scala-kernel-taint-taint-benchmark-controlled — scala, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 4 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 16 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 9 0 0 9 20 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — c, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — cpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — csharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — go, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — javascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — kotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — php, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — python, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — ruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — rust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — scala, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled — typescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-typescript-kernel-taint-taint-benchmark-controlled — typescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 12 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 12 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 22 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 4 0 0 4 4 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

codeql-c-kernel-taint-taint-benchmark-controlled — c, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 8 0 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 0 0 0 0 14 0 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 18 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 28 0 0 n/a n/a n/a n/a
local-flow 0 0 0 0 14 0 0 n/a n/a n/a n/a
object-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
path-sensitivity 0 0 0 0 6 0 0 n/a n/a n/a n/a
recursion 0 0 0 0 10 0 0 n/a n/a n/a n/a

codeql-c-kernel-taint-taint-benchmark-controlled — c, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
flow-sensitivity 0 0 0 0 1 0 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 1 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 1 0 0 n/a n/a n/a n/a
local-flow 0 0 0 0 1 0 0 n/a n/a n/a n/a

codeql-cpp-kernel-taint-taint-benchmark-controlled — cpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 0 0 0 0 18 0 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 26 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 34 0 0 n/a n/a n/a n/a
local-flow 0 0 0 0 16 0 0 n/a n/a n/a n/a
object-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
path-sensitivity 0 0 0 0 6 0 0 n/a n/a n/a n/a
recursion 0 0 0 0 12 0 0 n/a n/a n/a n/a

codeql-csharp-kernel-taint-taint-benchmark-controlled — csharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 2 1 2 1 0 0 0 2/3 (66.7%) 2/3 (66.7%) 66.7% 66.7%
flow-sensitivity 9 0 4 5 0 0 0 9/9 (100.0%) 4/9 (44.4%) 100.0% 44.4%
heap-field-sensitivity 9 3 5 7 0 0 0 9/12 (75.0%) 5/12 (41.7%) 75.0% 41.7%
interprocedural-flow 14 3 3 14 0 0 0 14/17 (82.4%) 3/17 (17.6%) 82.4% 17.6%
local-flow 6 2 1 6 1 0 0 6/8 (75.0%) 1/7 (14.3%) 75.0% 14.3%
object-sensitivity 4 2 1 5 0 0 0 4/6 (66.7%) 1/6 (16.7%) 66.7% 16.7%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%

codeql-go-kernel-taint-taint-benchmark-controlled — go, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 1 5 0 6 0 0 0 1/6 (16.7%) 0/6 (0.0%) 16.7% 0.0%
exceptional-flow 1 2 1 2 0 0 0 1/3 (33.3%) 1/3 (33.3%) 33.3% 33.3%
flow-sensitivity 8 1 3 6 0 0 0 8/9 (88.9%) 3/9 (33.3%) 88.9% 33.3%
heap-field-sensitivity 8 3 4 7 0 0 0 8/11 (72.7%) 4/11 (36.4%) 72.7% 36.4%
interprocedural-flow 13 4 2 15 0 0 0 13/17 (76.5%) 2/17 (11.8%) 76.5% 11.8%
local-flow 6 2 2 6 0 0 0 6/8 (75.0%) 2/8 (25.0%) 75.0% 25.0%
object-sensitivity 4 2 1 5 0 0 0 4/6 (66.7%) 1/6 (16.7%) 66.7% 16.7%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 5 1 1 5 0 0 0 5/6 (83.3%) 1/6 (16.7%) 83.3% 16.7%

codeql-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 5 2 2 5 0 0 0 5/7 (71.4%) 2/7 (28.6%) 71.4% 28.6%
exceptional-flow 1 2 1 2 0 0 0 1/3 (33.3%) 1/3 (33.3%) 33.3% 33.3%
flow-sensitivity 8 1 3 6 0 0 0 8/9 (88.9%) 3/9 (33.3%) 88.9% 33.3%
heap-field-sensitivity 9 4 5 8 0 0 0 9/13 (69.2%) 5/13 (38.5%) 69.2% 38.5%
interprocedural-flow 14 1 2 13 0 0 0 14/15 (93.3%) 2/15 (13.3%) 93.3% 13.3%
local-flow 6 2 1 7 0 0 0 6/8 (75.0%) 1/8 (12.5%) 75.0% 12.5%
object-sensitivity 4 1 2 3 0 0 0 4/5 (80.0%) 2/5 (40.0%) 80.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 5 1 1 5 0 0 0 5/6 (83.3%) 1/6 (16.7%) 83.3% 16.7%

codeql-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 1 5 0 0 0 6/6 (100.0%) 1/6 (16.7%) 100.0% 16.7%
sanitizer 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-javascript-kernel-taint-taint-benchmark-controlled — javascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
flow-sensitivity 9 0 4 5 0 0 0 9/9 (100.0%) 4/9 (44.4%) 100.0% 44.4%
heap-field-sensitivity 9 3 4 8 0 0 0 9/12 (75.0%) 4/12 (33.3%) 75.0% 33.3%
interprocedural-flow 14 3 3 14 0 0 0 14/17 (82.4%) 3/17 (17.6%) 82.4% 17.6%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%

codeql-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-javascript-native-taint-taint-tool-native — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 1 0 0 0 0 0/1 (0.0%) 1/1 (100.0%) 0.0% 100.0%
local-flow 5 1 2 4 0 0 0 5/6 (83.3%) 2/6 (33.3%) 83.3% 33.3%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

codeql-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 2 5 1 6 0 0 0 2/7 (28.6%) 1/7 (14.3%) 28.6% 14.3%
exceptional-flow 1 2 1 2 0 0 0 1/3 (33.3%) 1/3 (33.3%) 33.3% 33.3%
flow-sensitivity 8 1 3 6 0 0 0 8/9 (88.9%) 3/9 (33.3%) 88.9% 33.3%
heap-field-sensitivity 9 4 5 8 0 0 0 9/13 (69.2%) 5/13 (38.5%) 69.2% 38.5%
interprocedural-flow 14 5 3 16 0 0 0 14/19 (73.7%) 3/19 (15.8%) 73.7% 15.8%
local-flow 6 2 1 7 0 0 0 6/8 (75.0%) 1/8 (12.5%) 75.0% 12.5%
object-sensitivity 4 1 2 3 0 0 0 4/5 (80.0%) 2/5 (40.0%) 80.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 5 1 1 5 0 0 0 5/6 (83.3%) 1/6 (16.7%) 83.3% 16.7%

codeql-python-kernel-taint-taint-benchmark-controlled — python, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 5 0 7 0 0 0 2/7 (28.6%) 0/7 (0.0%) 28.6% 0.0%
exceptional-flow 2 1 2 1 0 0 0 2/3 (66.7%) 2/3 (66.7%) 66.7% 66.7%
flow-sensitivity 9 0 4 5 0 0 0 9/9 (100.0%) 4/9 (44.4%) 100.0% 44.4%
heap-field-sensitivity 9 4 4 9 0 0 0 9/13 (69.2%) 4/13 (30.8%) 69.2% 30.8%
interprocedural-flow 15 4 3 16 0 0 0 15/19 (78.9%) 3/19 (15.8%) 78.9% 15.8%
local-flow 7 1 1 6 1 0 0 7/8 (87.5%) 1/7 (14.3%) 87.5% 14.3%
object-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%

codeql-python-modeling-taint-taint-benchmark-controlled — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-python-native-taint-taint-tool-native — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

codeql-ruby-kernel-taint-taint-benchmark-controlled — ruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 1 6 0 7 0 0 0 1/7 (14.3%) 0/7 (0.0%) 14.3% 0.0%
exceptional-flow 2 1 2 1 0 0 0 2/3 (66.7%) 2/3 (66.7%) 66.7% 66.7%
flow-sensitivity 9 0 4 5 0 0 0 9/9 (100.0%) 4/9 (44.4%) 100.0% 44.4%
heap-field-sensitivity 9 4 3 10 0 0 0 9/13 (69.2%) 3/13 (23.1%) 69.2% 23.1%
interprocedural-flow 14 5 3 16 0 0 0 14/19 (73.7%) 3/19 (15.8%) 73.7% 15.8%
local-flow 7 1 1 6 1 0 0 7/8 (87.5%) 1/7 (14.3%) 87.5% 14.3%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%

codeql-rust-kernel-taint-taint-benchmark-controlled — rust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
flow-sensitivity 6 1 1 6 0 0 0 6/7 (85.7%) 1/7 (14.3%) 85.7% 14.3%
heap-field-sensitivity 5 4 1 8 0 0 0 5/9 (55.6%) 1/9 (11.1%) 55.6% 11.1%
interprocedural-flow 10 4 0 14 0 0 0 10/14 (71.4%) 0/14 (0.0%) 71.4% 0.0%
local-flow 7 0 1 6 0 0 0 7/7 (100.0%) 1/7 (14.3%) 100.0% 14.3%
object-sensitivity 3 3 0 6 0 0 0 3/6 (50.0%) 0/6 (0.0%) 50.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%

codeql-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
heap-field-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

codeql-typescript-kernel-taint-taint-benchmark-controlled — typescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
flow-sensitivity 9 0 4 5 0 0 0 9/9 (100.0%) 4/9 (44.4%) 100.0% 44.4%
heap-field-sensitivity 9 3 4 8 0 0 0 9/12 (75.0%) 4/12 (33.3%) 75.0% 33.3%
interprocedural-flow 14 3 3 14 0 0 0 14/17 (82.4%) 3/17 (17.6%) 82.4% 17.6%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%

flowdroid-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 5 1 6 0 0 0 2/7 (28.6%) 1/7 (14.3%) 28.6% 14.3%
exceptional-flow 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
flow-sensitivity 9 0 1 8 0 0 0 9/9 (100.0%) 1/9 (11.1%) 100.0% 11.1%
heap-field-sensitivity 12 1 3 10 0 0 0 12/13 (92.3%) 3/13 (23.1%) 92.3% 23.1%
interprocedural-flow 13 2 0 15 0 0 0 13/15 (86.7%) 0/15 (0.0%) 86.7% 0.0%
local-flow 8 0 1 7 0 0 0 8/8 (100.0%) 1/8 (12.5%) 100.0% 12.5%
object-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%

flowdroid-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 4 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

flowdroid-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

flowdroid-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 2 5 0 0 0 3/7 (42.9%) 2/7 (28.6%) 42.9% 28.6%
exceptional-flow 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
flow-sensitivity 9 0 1 8 0 0 0 9/9 (100.0%) 1/9 (11.1%) 100.0% 11.1%
heap-field-sensitivity 12 1 3 10 0 0 0 12/13 (92.3%) 3/13 (23.1%) 92.3% 23.1%
interprocedural-flow 16 3 2 17 0 0 0 16/19 (84.2%) 2/19 (10.5%) 84.2% 10.5%
local-flow 8 0 1 7 0 0 0 8/8 (100.0%) 1/8 (12.5%) 100.0% 12.5%
object-sensitivity 5 0 2 3 0 0 0 5/5 (100.0%) 2/5 (40.0%) 100.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%

infer-c-kernel-taint-taint-benchmark-controlled — c, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 0 1 3 0 0 0 4/4 (100.0%) 1/4 (25.0%) 100.0% 25.0%
dynamic-dispatch 2 1 1 2 0 0 0 2/3 (66.7%) 1/3 (33.3%) 66.7% 33.3%
flow-sensitivity 2 5 0 7 0 0 0 2/7 (28.6%) 0/7 (0.0%) 28.6% 0.0%
heap-field-sensitivity 8 1 0 9 0 0 0 8/9 (88.9%) 0/9 (0.0%) 88.9% 0.0%
interprocedural-flow 8 6 1 13 0 0 0 8/14 (57.1%) 1/14 (7.1%) 57.1% 7.1%
local-flow 5 2 0 7 0 0 0 5/7 (71.4%) 0/7 (0.0%) 71.4% 0.0%
object-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
path-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
recursion 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%

infer-cpp-kernel-taint-taint-benchmark-controlled — cpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 3 0 5 0 0 0 2/5 (40.0%) 0/5 (0.0%) 40.0% 0.0%
exceptional-flow 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 2 7 0 9 0 0 0 2/9 (22.2%) 0/9 (0.0%) 22.2% 0.0%
heap-field-sensitivity 7 6 0 13 0 0 0 7/13 (53.8%) 0/13 (0.0%) 53.8% 0.0%
interprocedural-flow 7 10 0 17 0 0 0 7/17 (41.2%) 0/17 (0.0%) 41.2% 0.0%
local-flow 5 3 0 8 0 0 0 5/8 (62.5%) 0/8 (0.0%) 62.5% 0.0%
object-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
path-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
recursion 0 6 0 6 0 0 0 0/6 (0.0%) 0/6 (0.0%) 0.0% 0.0%

infer-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 3 4 0 7 0 0 0 3/7 (42.9%) 0/7 (0.0%) 42.9% 0.0%
exceptional-flow 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
flow-sensitivity 3 6 0 9 0 0 0 3/9 (33.3%) 0/9 (0.0%) 33.3% 0.0%
heap-field-sensitivity 9 4 0 13 0 0 0 9/13 (69.2%) 0/13 (0.0%) 69.2% 0.0%
interprocedural-flow 8 7 0 15 0 0 0 8/15 (53.3%) 0/15 (0.0%) 53.3% 0.0%
local-flow 6 2 0 8 0 0 0 6/8 (75.0%) 0/8 (0.0%) 75.0% 0.0%
object-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
path-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
recursion 0 6 0 6 0 0 0 0/6 (0.0%) 0/6 (0.0%) 0.0% 0.0%

infer-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 1 0 0 1 0 10 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

infer-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 2 5 0 0 0 3/7 (42.9%) 2/7 (28.6%) 42.9% 28.6%
exceptional-flow 1 2 0 3 0 0 0 1/3 (33.3%) 0/3 (0.0%) 33.3% 0.0%
flow-sensitivity 8 1 2 7 0 0 0 8/9 (88.9%) 2/9 (22.2%) 88.9% 22.2%
heap-field-sensitivity 9 4 1 12 0 0 0 9/13 (69.2%) 1/13 (7.7%) 69.2% 7.7%
interprocedural-flow 12 3 1 14 0 0 0 12/15 (80.0%) 1/15 (6.7%) 80.0% 6.7%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 6 0 1 5 0 0 0 6/6 (100.0%) 1/6 (16.7%) 100.0% 16.7%

joern-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-javascript-kernel-taint-taint-benchmark-controlled — javascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 1 2 0 3 0 0 0 1/3 (33.3%) 0/3 (0.0%) 33.3% 0.0%
flow-sensitivity 8 1 1 8 0 0 0 8/9 (88.9%) 1/9 (11.1%) 88.9% 11.1%
heap-field-sensitivity 8 4 4 8 0 0 0 8/12 (66.7%) 4/12 (33.3%) 66.7% 33.3%
interprocedural-flow 12 5 0 17 0 0 0 12/17 (70.6%) 0/17 (0.0%) 70.6% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 3 1 5 0 0 0 3/6 (50.0%) 1/6 (16.7%) 50.0% 16.7%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%

joern-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-javascript-native-taint-taint-tool-native — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-php-kernel-taint-taint-benchmark-controlled — php, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 1 6 0 0 0 3/7 (42.9%) 1/7 (14.3%) 42.9% 14.3%
exceptional-flow 1 2 0 3 0 0 0 1/3 (33.3%) 0/3 (0.0%) 33.3% 0.0%
flow-sensitivity 8 1 2 7 0 0 0 8/9 (88.9%) 2/9 (22.2%) 88.9% 22.2%
heap-field-sensitivity 9 4 0 13 0 0 0 9/13 (69.2%) 0/13 (0.0%) 69.2% 0.0%
interprocedural-flow 13 6 2 17 0 0 0 13/19 (68.4%) 2/19 (10.5%) 68.4% 10.5%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 6 0 1 5 0 0 0 6/6 (100.0%) 1/6 (16.7%) 100.0% 16.7%

joern-python-kernel-taint-taint-benchmark-controlled — python, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 3 4 1 6 0 0 0 3/7 (42.9%) 1/7 (14.3%) 42.9% 14.3%
exceptional-flow 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 7 2 1 8 0 0 0 7/9 (77.8%) 1/9 (11.1%) 77.8% 11.1%
heap-field-sensitivity 8 5 1 12 0 0 0 8/13 (61.5%) 1/13 (7.7%) 61.5% 7.7%
interprocedural-flow 12 7 0 19 0 0 0 12/19 (63.2%) 0/19 (0.0%) 63.2% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 5 1 0 6 0 0 0 5/6 (83.3%) 0/6 (0.0%) 83.3% 0.0%

joern-python-modeling-taint-taint-benchmark-controlled — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-python-native-taint-taint-tool-native — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-ruby-kernel-taint-taint-benchmark-controlled — ruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 3 2 3 0 0 0 2/5 (40.0%) 2/5 (40.0%) 40.0% 40.0%
dynamic-dispatch 1 6 1 6 0 0 0 1/7 (14.3%) 1/7 (14.3%) 14.3% 14.3%
exceptional-flow 2 1 2 1 0 0 0 2/3 (66.7%) 2/3 (66.7%) 66.7% 66.7%
flow-sensitivity 9 0 7 2 0 0 0 9/9 (100.0%) 7/9 (77.8%) 100.0% 77.8%
heap-field-sensitivity 7 6 4 9 0 0 0 7/13 (53.8%) 4/13 (30.8%) 53.8% 30.8%
interprocedural-flow 12 7 9 10 0 0 0 12/19 (63.2%) 9/19 (47.4%) 63.2% 47.4%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 1 4 0 5 0 0 0 1/5 (20.0%) 0/5 (0.0%) 20.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 6 0 6 0 0 0 0 6/6 (100.0%) 6/6 (100.0%) 100.0% 100.0%

joern-rust-kernel-taint-taint-benchmark-controlled — rust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
flow-sensitivity 6 1 2 5 0 0 0 6/7 (85.7%) 2/7 (28.6%) 85.7% 28.6%
heap-field-sensitivity 5 4 0 9 0 0 0 5/9 (55.6%) 0/9 (0.0%) 55.6% 0.0%
interprocedural-flow 9 5 1 13 0 0 0 9/14 (64.3%) 1/14 (7.1%) 64.3% 7.1%
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 3 3 0 6 0 0 0 3/6 (50.0%) 0/6 (0.0%) 50.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%

opentaint-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 6 1 2 5 0 0 0 6/7 (85.7%) 2/7 (28.6%) 85.7% 28.6%
exceptional-flow 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 7 2 1 8 0 0 0 7/9 (77.8%) 1/9 (11.1%) 77.8% 11.1%
heap-field-sensitivity 10 3 3 10 0 0 0 10/13 (76.9%) 3/13 (23.1%) 76.9% 23.1%
interprocedural-flow 13 2 0 15 0 0 0 13/15 (86.7%) 0/15 (0.0%) 86.7% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 5 1 0 6 0 0 0 5/6 (83.3%) 0/6 (0.0%) 83.3% 0.0%

opentaint-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 2 0 0 2 0 8 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

opentaint-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

opentaint-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 6 1 3 4 0 0 0 6/7 (85.7%) 3/7 (42.9%) 85.7% 42.9%
exceptional-flow 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 7 2 1 8 0 0 0 7/9 (77.8%) 1/9 (11.1%) 77.8% 11.1%
heap-field-sensitivity 10 3 4 9 0 0 0 10/13 (76.9%) 4/13 (30.8%) 76.9% 30.8%
interprocedural-flow 16 3 2 17 0 0 0 16/19 (84.2%) 2/19 (10.5%) 84.2% 10.5%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 5 0 2 3 0 0 0 5/5 (100.0%) 2/5 (40.0%) 100.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 5 1 0 6 0 0 0 5/6 (83.3%) 0/6 (0.0%) 83.3% 0.0%

pysa-python-kernel-taint-taint-benchmark-controlled — python, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 7 0 7 0 0 0 0/7 (0.0%) 0/7 (0.0%) 0.0% 0.0%
exceptional-flow 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 6 3 1 8 0 0 0 6/9 (66.7%) 1/9 (11.1%) 66.7% 11.1%
heap-field-sensitivity 5 8 0 13 0 0 0 5/13 (38.5%) 0/13 (0.0%) 38.5% 0.0%
interprocedural-flow 10 9 0 19 0 0 0 10/19 (52.6%) 0/19 (0.0%) 52.6% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 3 0 5 0 0 0 2/5 (40.0%) 0/5 (0.0%) 40.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 4 2 0 6 0 0 0 4/6 (66.7%) 0/6 (0.0%) 66.7% 0.0%

pysa-python-modeling-taint-taint-benchmark-controlled — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 4 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

pysa-python-native-taint-taint-tool-native — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 2 0 2 0 0 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
local-flow 0 6 0 6 0 0 0 0/6 (0.0%) 0/6 (0.0%) 0.0% 0.0%
sanitizer 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

semgrep-c-kernel-taint-taint-benchmark-controlled — c, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 8 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 8 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 18 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 28 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 10 0 n/a n/a n/a n/a

semgrep-cpp-kernel-taint-taint-benchmark-controlled — cpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 10 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 26 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 34 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-go-kernel-taint-taint-benchmark-controlled — go, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 22 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 34 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-java-kernel-taint-taint-benchmark-controlled — java, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 26 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 30 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-java-modeling-taint-taint-benchmark-controlled — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-java-native-taint-taint-tool-native — java, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-javascript-kernel-taint-taint-benchmark-controlled — javascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 24 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 34 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-javascript-native-taint-taint-tool-native — javascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 26 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 38 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-php-kernel-taint-taint-benchmark-controlled — php, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 26 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 38 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-python-kernel-taint-taint-benchmark-controlled — python, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 26 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 38 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-python-modeling-taint-taint-benchmark-controlled — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-python-native-taint-taint-tool-native — python, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 2 0 0 0 0 2/2 (100.0%) 2/2 (100.0%) 100.0% 100.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 4 2 0 0 0 6/6 (100.0%) 4/6 (66.7%) 100.0% 66.7%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

semgrep-ruby-kernel-taint-taint-benchmark-controlled — ruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 26 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 38 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a

semgrep-rust-kernel-taint-taint-benchmark-controlled — rust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 10 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 8 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 18 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 28 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 10 0 n/a n/a n/a n/a

semgrep-typescript-kernel-taint-taint-benchmark-controlled — typescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 12 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 24 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 34 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 12 0 n/a n/a n/a n/a