Analyzers — v0.8.0
Each scorecard is one frozen report: one analyzer, one track, one score
dimension, and one model profile. Scorecards remain independent populations.
TPR and FPR are macro-averages over templates and semantic dimensions;
inconclusive, unsupported, and runner-error remain coverage outcomes.
All 82 reports were rerun over the expanded 1,000-case corpus. The result set contains 4,036 cells, including 556 cells introduced by the new kernels. The tables below are the authority for each analyzer’s rates, denominators, and capability boundaries.
bifrost-c-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-c-kernel.json
(ae4c70293d2e…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 56 | 21 | 21 | 14 | 0 | 0 | 100.0% | 0.0% |
c | language-extension | 2 | 1 | 0 | 1 | 0 | 0 | 100.0% | n/a |
bifrost-cpp-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-cpp-kernel.json
(7f04a24e2793…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 68 | 15 | 15 | 38 | 0 | 0 | 100.0% | 0.0% |
bifrost-csharp-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-csharp-kernel.json
(14fe93453fd6…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
csharp | core | 70 | 18 | 18 | 34 | 0 | 0 | 100.0% | 0.0% |
bifrost-go-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-go-kernel.json
(eae8dc5da282…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 70 | 20 | 20 | 30 | 0 | 0 | 100.0% | 0.0% |
bifrost-java-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-java-kernel.json
(e43d83e7ba89…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 23 | 23 | 24 | 0 | 0 | 100.0% | 0.0% |
bifrost-java-modeling-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-java-modeling.json
(55105ad6a155…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 4 | 3 | 1 | 16 | 0 | 100.0% | 0.0% |
bifrost-java-native-taint-taint-tool-native
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/bifrost-java-native.json
(8a54dfb974cc…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
bifrost-javascript-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-javascript-kernel.json
(f882345ed20b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 70 | 20 | 20 | 30 | 0 | 0 | 100.0% | 0.0% |
bifrost-javascript-modeling-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-javascript-modeling.json
(662d2650e2f1…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 2 | 2 | 4 | 16 | 0 | 100.0% | 0.0% |
bifrost-javascript-native-taint-taint-tool-native
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/bifrost-javascript-native.json
(722f1407989d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
bifrost-kotlin-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-kotlin-kernel.json
(736f93afb9c3…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 70 | 16 | 16 | 38 | 0 | 0 | 100.0% | 0.0% |
bifrost-php-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-php-kernel.json
(aaadb2814a7a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 70 | 17 | 17 | 36 | 0 | 0 | 100.0% | 0.0% |
bifrost-python-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-python-kernel.json
(b7a84985c737…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 70 | 18 | 18 | 34 | 0 | 0 | 100.0% | 0.0% |
bifrost-python-modeling-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-python-modeling.json
(7a1152378263…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 4 | 3 | 1 | 16 | 0 | 100.0% | 0.0% |
bifrost-python-native-taint-taint-tool-native
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/bifrost-python-native.json
(d230d03d85f1…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
bifrost-ruby-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-ruby-kernel.json
(0735867664a3…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 70 | 18 | 18 | 34 | 0 | 0 | 100.0% | 0.0% |
bifrost-rust-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-rust-kernel.json
(9fccc5326494…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 62 | 21 | 21 | 20 | 0 | 0 | 100.0% | 0.0% |
rust | language-extension | 2 | 0 | 0 | 2 | 0 | 0 | n/a | n/a |
bifrost-scala-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-scala-kernel.json
(bd6d591df86b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
scala | core | 70 | 21 | 21 | 28 | 0 | 0 | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-smoke.json
(a81a64ccd798…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
cpp | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
csharp | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
go | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
java | calibration | 2 | 1 | 0 | 0 | 1 | 0 | not scored | not scored |
java | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
javascript | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
kotlin | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
php | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
python | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
ruby | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
rust | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
scala | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
typescript | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
bifrost-typescript-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.4 (build
015ee1f76b04, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-typescript-kernel.json
(c5f7d564d016…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 70 | 19 | 19 | 32 | 0 | 0 | 100.0% | 0.0% |
codeql-c-kernel-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-c-kernel.json
(e12a3deb6c98…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 56 | 0 | 0 | 56 | 0 | 0 | n/a | n/a |
c | language-extension | 2 | 0 | 0 | 2 | 0 | 0 | n/a | n/a |
codeql-cpp-kernel-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-cpp-kernel.json
(f3b049e5365e…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 68 | 0 | 0 | 68 | 0 | 0 | n/a | n/a |
codeql-csharp-kernel-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-csharp-kernel.json
(87e0df8a950b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
csharp | core | 70 | 33 | 36 | 1 | 0 | 0 | 77.9% | 28.5% |
codeql-go-kernel-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-go-kernel.json
(89041091c2dd…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 70 | 31 | 39 | 0 | 0 | 0 | 67.3% | 24.0% |
codeql-java-kernel-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-java-kernel.json
(de4dc44d333e…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 36 | 34 | 0 | 0 | 0 | 79.4% | 26.9% |
codeql-java-modeling-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-java-modeling.json
(666e913802d2…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 12 | 12 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-java-native-taint-taint-tool-native
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/codeql-java-native.json
(39c69006aa21…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 7 | 5 | 0 | 0 | 0 | 100.0% | 29.2% |
codeql-javascript-kernel-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-javascript-kernel.json
(d9ea78eb6484…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 70 | 32 | 38 | 0 | 0 | 0 | 79.1% | 24.1% |
codeql-javascript-modeling-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-javascript-modeling.json
(8a2e516b91eb…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 12 | 12 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-javascript-native-taint-taint-tool-native
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/codeql-javascript-native.json
(b02fb1211af1…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 7 | 5 | 0 | 0 | 0 | 70.8% | 58.3% |
codeql-kotlin-kernel-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-kotlin-kernel.json
(83290f0a1f4a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 70 | 32 | 38 | 0 | 0 | 0 | 69.2% | 23.8% |
codeql-python-kernel-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-python-kernel.json
(9d5b5ee5c1c2…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 70 | 32 | 37 | 1 | 0 | 0 | 79.1% | 27.5% |
codeql-python-modeling-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-python-modeling.json
(9a60d102412a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 12 | 12 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-python-native-taint-taint-tool-native
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/codeql-python-native.json
(22e0792a471b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 8 | 4 | 0 | 0 | 0 | 100.0% | 58.3% |
codeql-ruby-kernel-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-ruby-kernel.json
(83c4090b11b7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 70 | 31 | 38 | 1 | 0 | 0 | 73.1% | 24.8% |
codeql-rust-kernel-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-rust-kernel.json
(da6772c638a4…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 62 | 24 | 38 | 0 | 0 | 0 | 67.0% | 8.1% |
rust | language-extension | 2 | 0 | 2 | 0 | 0 | 0 | 0.0% | 0.0% |
codeql-typescript-kernel-taint-taint-benchmark-controlled
codeql 2.27.0 (build
b47b3e59262c, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-typescript-kernel.json
(e71500a35ea7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 70 | 32 | 38 | 0 | 0 | 0 | 79.1% | 24.1% |
flowdroid-java-kernel-taint-taint-benchmark-controlled
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/flowdroid-java-kernel.json
(97fd50bc5541…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 34 | 36 | 0 | 0 | 0 | 86.8% | 11.4% |
flowdroid-java-modeling-taint-taint-benchmark-controlled
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/flowdroid-java-modeling.json
(27e1eae52940…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 7 | 7 | 0 | 10 | 0 | 100.0% | 0.0% |
flowdroid-java-native-taint-taint-tool-native
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/flowdroid-java-native.json
(d90111f7bb8b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
flowdroid-kotlin-kernel-taint-taint-benchmark-controlled
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/flowdroid-kotlin-kernel.json
(efa07c7d2c11…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 70 | 36 | 34 | 0 | 0 | 0 | 89.9% | 17.9% |
infer-c-kernel-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/infer-c-kernel.json
(e241db2aace9…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 56 | 21 | 35 | 0 | 0 | 0 | 64.4% | 7.3% |
infer-cpp-kernel-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/infer-cpp-kernel.json
(ca7ccf79c7b1…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 68 | 19 | 49 | 0 | 0 | 0 | 44.6% | 0.0% |
infer-java-kernel-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/infer-java-kernel.json
(86fb25a6358f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 22 | 48 | 0 | 0 | 0 | 56.7% | 0.0% |
infer-java-modeling-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/infer-java-modeling.json
(27592a1298c7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
infer-java-native-taint-taint-tool-native
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/infer-java-native.json
(c5d70401f184…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-java-kernel-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-java-kernel.json
(56a37aad5051…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 32 | 38 | 0 | 0 | 0 | 74.2% | 19.4% |
joern-java-modeling-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-java-modeling.json
(1c789f3f3b15…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 6 | 10 | 0 | 8 | 0 | 50.0% | 0.0% |
joern-java-native-taint-taint-tool-native
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/joern-java-native.json
(03e3afa6dbdc…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-javascript-kernel-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-javascript-kernel.json
(401fdd7bfe2f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 70 | 32 | 38 | 0 | 0 | 0 | 71.0% | 15.3% |
joern-javascript-modeling-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-javascript-modeling.json
(1268dceb8ab1…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 6 | 10 | 0 | 8 | 0 | 50.0% | 0.0% |
joern-javascript-native-taint-taint-tool-native
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/joern-javascript-native.json
(3ed903e2d29a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-php-kernel-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-php-kernel.json
(7549768d8dd4…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 70 | 31 | 39 | 0 | 0 | 0 | 73.0% | 17.5% |
joern-python-kernel-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-python-kernel.json
(b63865c1aeb2…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 70 | 29 | 41 | 0 | 0 | 0 | 65.6% | 12.5% |
joern-python-modeling-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-python-modeling.json
(1e09345fcf8c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 6 | 10 | 0 | 8 | 0 | 50.0% | 0.0% |
joern-python-native-taint-taint-tool-native
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/joern-python-native.json
(3acc8c28a788…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-ruby-kernel-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-ruby-kernel.json
(2ea6f41c0383…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 70 | 35 | 35 | 0 | 0 | 0 | 64.5% | 46.9% |
joern-rust-kernel-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-rust-kernel.json
(154cfb92070c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 62 | 24 | 38 | 0 | 0 | 0 | 66.2% | 16.8% |
opentaint-java-kernel-taint-taint-benchmark-controlled
opentaint v0.4.6 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/opentaint-java-kernel.json
(ddd80129ac50…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 36 | 34 | 0 | 0 | 0 | 79.8% | 14.9% |
opentaint-java-modeling-taint-taint-benchmark-controlled
opentaint v0.4.6 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/opentaint-java-modeling.json
(10405df56b06…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 6 | 6 | 0 | 12 | 0 | 100.0% | 0.0% |
opentaint-java-native-taint-taint-tool-native
opentaint v0.4.6 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/opentaint-java-native.json
(2078837d5b4a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
opentaint-kotlin-kernel-taint-taint-benchmark-controlled
opentaint v0.4.6 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/opentaint-kotlin-kernel.json
(8bf36cd12fcd…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 70 | 37 | 33 | 0 | 0 | 0 | 79.5% | 20.1% |
pysa-python-kernel-taint-taint-benchmark-controlled
pysa 0.10.0 (build
pyre-check:0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/pysa-python-kernel.json
(082262d3599d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 70 | 23 | 47 | 0 | 0 | 0 | 51.2% | 5.7% |
pysa-python-modeling-taint-taint-benchmark-controlled
pysa 0.10.0 (build
pyre-check:0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/pysa-python-modeling.json
(57fd9e95e58c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 10 | 10 | 0 | 4 | 0 | 100.0% | 0.0% |
pysa-python-native-taint-taint-tool-native
pysa 0.10.0 (build
pyre-check:0, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/pysa-python-native.json
(13a3091432ec…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 0 | 12 | 0 | 0 | 0 | 0.0% | 0.0% |
semgrep-c-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-c-kernel.json
(4c63e7cd8beb…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 56 | 9 | 5 | 0 | 42 | 0 | 100.0% | 42.9% |
semgrep-cpp-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-cpp-kernel.json
(e534cce9f363…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 68 | 9 | 5 | 0 | 54 | 0 | 100.0% | 42.9% |
semgrep-go-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-go-kernel.json
(e293544a09ff…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-java-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-java-kernel.json
(b9535716ec34…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-java-modeling-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-java-modeling.json
(35588fe1195f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
semgrep-java-native-taint-taint-tool-native
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/semgrep-java-native.json
(39991c700f6b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
semgrep-javascript-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-javascript-kernel.json
(12227cb1b098…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-javascript-modeling-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-javascript-modeling.json
(7f5ee098b46a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
semgrep-javascript-native-taint-taint-tool-native
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/semgrep-javascript-native.json
(5bebf3998de2…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
semgrep-kotlin-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-kotlin-kernel.json
(1106051ae161…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-php-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-php-kernel.json
(7e8bd0f19b69…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-python-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-python-kernel.json
(9da217953be5…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-python-modeling-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-python-modeling.json
(f1bfa6e777fb…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
semgrep-python-native-taint-taint-tool-native
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/semgrep-python-native.json
(c6ee8d2e41c0…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 10 | 2 | 0 | 0 | 0 | 100.0% | 91.7% |
semgrep-ruby-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-ruby-kernel.json
(d516a6c31277…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-rust-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-rust-kernel.json
(6136d6785166…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 62 | 9 | 5 | 0 | 48 | 0 | 100.0% | 42.9% |
semgrep-typescript-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-typescript-kernel.json
(d0aafc38938d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
Semantic dimension detail
Section titled “Semantic dimension detail”bifrost-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 2 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 4 | 0 | 0 | 4 | 6 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 6 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 8 | 0 | 0 | 8 | 12 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 0 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-c-kernel-taint-taint-benchmark-controlled — c, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
flow-sensitivity | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
bifrost-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 12 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 4 | 0 | 0 | 4 | 18 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 26 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-csharp-kernel-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 12 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 14 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 22 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 4 | 0 | 0 | 4 | 14 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 16 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 8 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 0 | 0 | 4 | 2 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 1 | 0 | 0 | 1 | 12 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 4 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 14 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 12 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 1 | 1 | 0 | 0 | 2/2 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
bifrost-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 4 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 12 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 7 | 0 | 0 | 7 | 10 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 22 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 4 | 0 | 0 | 4 | 4 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
bifrost-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 26 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 9 | 0 | 0 | 9 | 20 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 2 | 0 | 0 | 2 | 14 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 14 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 26 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 5 | 0 | 0 | 5 | 6 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 4 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 12 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 16 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 26 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 1 | 1 | 0 | 0 | 2/2 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
bifrost-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 4 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 2 | 0 | 0 | 2 | 14 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 7 | 0 | 0 | 7 | 12 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 26 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 6 | 0 | 0 | 6 | 4 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 5 | 0 | 0 | 5 | 4 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 10 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 0 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
heap-field-sensitivity | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-scala-kernel-taint-taint-benchmark-controlled — scala, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 4 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 16 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 20 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — scala, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 12 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 12 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 22 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 4 | 0 | 0 | 4 | 4 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
codeql-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 8 | 0 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 18 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 28 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
recursion | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
codeql-c-kernel-taint-taint-benchmark-controlled — c, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
flow-sensitivity | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
codeql-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 0 | 0 | 0 | 0 | 18 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 26 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 34 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 16 | 0 | 0 | n/a | n/a | n/a | n/a |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
codeql-csharp-kernel-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 2 | 1 | 2 | 1 | 0 | 0 | 0 | 2/3 (66.7%) | 2/3 (66.7%) | 66.7% | 66.7% |
flow-sensitivity | 9 | 0 | 4 | 5 | 0 | 0 | 0 | 9/9 (100.0%) | 4/9 (44.4%) | 100.0% | 44.4% |
heap-field-sensitivity | 9 | 3 | 5 | 7 | 0 | 0 | 0 | 9/12 (75.0%) | 5/12 (41.7%) | 75.0% | 41.7% |
interprocedural-flow | 14 | 3 | 3 | 14 | 0 | 0 | 0 | 14/17 (82.4%) | 3/17 (17.6%) | 82.4% | 17.6% |
local-flow | 6 | 2 | 1 | 6 | 1 | 0 | 0 | 6/8 (75.0%) | 1/7 (14.3%) | 75.0% | 14.3% |
object-sensitivity | 4 | 2 | 1 | 5 | 0 | 0 | 0 | 4/6 (66.7%) | 1/6 (16.7%) | 66.7% | 16.7% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
codeql-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 1 | 5 | 0 | 6 | 0 | 0 | 0 | 1/6 (16.7%) | 0/6 (0.0%) | 16.7% | 0.0% |
exceptional-flow | 1 | 2 | 1 | 2 | 0 | 0 | 0 | 1/3 (33.3%) | 1/3 (33.3%) | 33.3% | 33.3% |
flow-sensitivity | 8 | 1 | 3 | 6 | 0 | 0 | 0 | 8/9 (88.9%) | 3/9 (33.3%) | 88.9% | 33.3% |
heap-field-sensitivity | 8 | 3 | 4 | 7 | 0 | 0 | 0 | 8/11 (72.7%) | 4/11 (36.4%) | 72.7% | 36.4% |
interprocedural-flow | 13 | 4 | 2 | 15 | 0 | 0 | 0 | 13/17 (76.5%) | 2/17 (11.8%) | 76.5% | 11.8% |
local-flow | 6 | 2 | 2 | 6 | 0 | 0 | 0 | 6/8 (75.0%) | 2/8 (25.0%) | 75.0% | 25.0% |
object-sensitivity | 4 | 2 | 1 | 5 | 0 | 0 | 0 | 4/6 (66.7%) | 1/6 (16.7%) | 66.7% | 16.7% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 5 | 1 | 1 | 5 | 0 | 0 | 0 | 5/6 (83.3%) | 1/6 (16.7%) | 83.3% | 16.7% |
codeql-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 5 | 2 | 2 | 5 | 0 | 0 | 0 | 5/7 (71.4%) | 2/7 (28.6%) | 71.4% | 28.6% |
exceptional-flow | 1 | 2 | 1 | 2 | 0 | 0 | 0 | 1/3 (33.3%) | 1/3 (33.3%) | 33.3% | 33.3% |
flow-sensitivity | 8 | 1 | 3 | 6 | 0 | 0 | 0 | 8/9 (88.9%) | 3/9 (33.3%) | 88.9% | 33.3% |
heap-field-sensitivity | 9 | 4 | 5 | 8 | 0 | 0 | 0 | 9/13 (69.2%) | 5/13 (38.5%) | 69.2% | 38.5% |
interprocedural-flow | 14 | 1 | 2 | 13 | 0 | 0 | 0 | 14/15 (93.3%) | 2/15 (13.3%) | 93.3% | 13.3% |
local-flow | 6 | 2 | 1 | 7 | 0 | 0 | 0 | 6/8 (75.0%) | 1/8 (12.5%) | 75.0% | 12.5% |
object-sensitivity | 4 | 1 | 2 | 3 | 0 | 0 | 0 | 4/5 (80.0%) | 2/5 (40.0%) | 80.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 5 | 1 | 1 | 5 | 0 | 0 | 0 | 5/6 (83.3%) | 1/6 (16.7%) | 83.3% | 16.7% |
codeql-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
codeql-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
local-flow | 6 | 0 | 1 | 5 | 0 | 0 | 0 | 6/6 (100.0%) | 1/6 (16.7%) | 100.0% | 16.7% |
sanitizer | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
flow-sensitivity | 9 | 0 | 4 | 5 | 0 | 0 | 0 | 9/9 (100.0%) | 4/9 (44.4%) | 100.0% | 44.4% |
heap-field-sensitivity | 9 | 3 | 4 | 8 | 0 | 0 | 0 | 9/12 (75.0%) | 4/12 (33.3%) | 75.0% | 33.3% |
interprocedural-flow | 14 | 3 | 3 | 14 | 0 | 0 | 0 | 14/17 (82.4%) | 3/17 (17.6%) | 82.4% | 17.6% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
codeql-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
codeql-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0/1 (0.0%) | 1/1 (100.0%) | 0.0% | 100.0% |
local-flow | 5 | 1 | 2 | 4 | 0 | 0 | 0 | 5/6 (83.3%) | 2/6 (33.3%) | 83.3% | 33.3% |
sanitizer | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
codeql-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 1 | 6 | 0 | 0 | 0 | 2/7 (28.6%) | 1/7 (14.3%) | 28.6% | 14.3% |
exceptional-flow | 1 | 2 | 1 | 2 | 0 | 0 | 0 | 1/3 (33.3%) | 1/3 (33.3%) | 33.3% | 33.3% |
flow-sensitivity | 8 | 1 | 3 | 6 | 0 | 0 | 0 | 8/9 (88.9%) | 3/9 (33.3%) | 88.9% | 33.3% |
heap-field-sensitivity | 9 | 4 | 5 | 8 | 0 | 0 | 0 | 9/13 (69.2%) | 5/13 (38.5%) | 69.2% | 38.5% |
interprocedural-flow | 14 | 5 | 3 | 16 | 0 | 0 | 0 | 14/19 (73.7%) | 3/19 (15.8%) | 73.7% | 15.8% |
local-flow | 6 | 2 | 1 | 7 | 0 | 0 | 0 | 6/8 (75.0%) | 1/8 (12.5%) | 75.0% | 12.5% |
object-sensitivity | 4 | 1 | 2 | 3 | 0 | 0 | 0 | 4/5 (80.0%) | 2/5 (40.0%) | 80.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 5 | 1 | 1 | 5 | 0 | 0 | 0 | 5/6 (83.3%) | 1/6 (16.7%) | 83.3% | 16.7% |
codeql-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 0 | 7 | 0 | 0 | 0 | 2/7 (28.6%) | 0/7 (0.0%) | 28.6% | 0.0% |
exceptional-flow | 2 | 1 | 2 | 1 | 0 | 0 | 0 | 2/3 (66.7%) | 2/3 (66.7%) | 66.7% | 66.7% |
flow-sensitivity | 9 | 0 | 4 | 5 | 0 | 0 | 0 | 9/9 (100.0%) | 4/9 (44.4%) | 100.0% | 44.4% |
heap-field-sensitivity | 9 | 4 | 4 | 9 | 0 | 0 | 0 | 9/13 (69.2%) | 4/13 (30.8%) | 69.2% | 30.8% |
interprocedural-flow | 15 | 4 | 3 | 16 | 0 | 0 | 0 | 15/19 (78.9%) | 3/19 (15.8%) | 78.9% | 15.8% |
local-flow | 7 | 1 | 1 | 6 | 1 | 0 | 0 | 7/8 (87.5%) | 1/7 (14.3%) | 87.5% | 14.3% |
object-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
codeql-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
codeql-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
local-flow | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
sanitizer | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
codeql-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 1 | 6 | 0 | 7 | 0 | 0 | 0 | 1/7 (14.3%) | 0/7 (0.0%) | 14.3% | 0.0% |
exceptional-flow | 2 | 1 | 2 | 1 | 0 | 0 | 0 | 2/3 (66.7%) | 2/3 (66.7%) | 66.7% | 66.7% |
flow-sensitivity | 9 | 0 | 4 | 5 | 0 | 0 | 0 | 9/9 (100.0%) | 4/9 (44.4%) | 100.0% | 44.4% |
heap-field-sensitivity | 9 | 4 | 3 | 10 | 0 | 0 | 0 | 9/13 (69.2%) | 3/13 (23.1%) | 69.2% | 23.1% |
interprocedural-flow | 14 | 5 | 3 | 16 | 0 | 0 | 0 | 14/19 (73.7%) | 3/19 (15.8%) | 73.7% | 15.8% |
local-flow | 7 | 1 | 1 | 6 | 1 | 0 | 0 | 7/8 (87.5%) | 1/7 (14.3%) | 87.5% | 14.3% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
codeql-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 6 | 1 | 1 | 6 | 0 | 0 | 0 | 6/7 (85.7%) | 1/7 (14.3%) | 85.7% | 14.3% |
heap-field-sensitivity | 5 | 4 | 1 | 8 | 0 | 0 | 0 | 5/9 (55.6%) | 1/9 (11.1%) | 55.6% | 11.1% |
interprocedural-flow | 10 | 4 | 0 | 14 | 0 | 0 | 0 | 10/14 (71.4%) | 0/14 (0.0%) | 71.4% | 0.0% |
local-flow | 7 | 0 | 1 | 6 | 0 | 0 | 0 | 7/7 (100.0%) | 1/7 (14.3%) | 100.0% | 14.3% |
object-sensitivity | 3 | 3 | 0 | 6 | 0 | 0 | 0 | 3/6 (50.0%) | 0/6 (0.0%) | 50.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
codeql-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
codeql-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
flow-sensitivity | 9 | 0 | 4 | 5 | 0 | 0 | 0 | 9/9 (100.0%) | 4/9 (44.4%) | 100.0% | 44.4% |
heap-field-sensitivity | 9 | 3 | 4 | 8 | 0 | 0 | 0 | 9/12 (75.0%) | 4/12 (33.3%) | 75.0% | 33.3% |
interprocedural-flow | 14 | 3 | 3 | 14 | 0 | 0 | 0 | 14/17 (82.4%) | 3/17 (17.6%) | 82.4% | 17.6% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
flowdroid-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 1 | 6 | 0 | 0 | 0 | 2/7 (28.6%) | 1/7 (14.3%) | 28.6% | 14.3% |
exceptional-flow | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 9 | 0 | 1 | 8 | 0 | 0 | 0 | 9/9 (100.0%) | 1/9 (11.1%) | 100.0% | 11.1% |
heap-field-sensitivity | 12 | 1 | 3 | 10 | 0 | 0 | 0 | 12/13 (92.3%) | 3/13 (23.1%) | 92.3% | 23.1% |
interprocedural-flow | 13 | 2 | 0 | 15 | 0 | 0 | 0 | 13/15 (86.7%) | 0/15 (0.0%) | 86.7% | 0.0% |
local-flow | 8 | 0 | 1 | 7 | 0 | 0 | 0 | 8/8 (100.0%) | 1/8 (12.5%) | 100.0% | 12.5% |
object-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
flowdroid-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 4 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flowdroid-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flowdroid-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 2 | 5 | 0 | 0 | 0 | 3/7 (42.9%) | 2/7 (28.6%) | 42.9% | 28.6% |
exceptional-flow | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 9 | 0 | 1 | 8 | 0 | 0 | 0 | 9/9 (100.0%) | 1/9 (11.1%) | 100.0% | 11.1% |
heap-field-sensitivity | 12 | 1 | 3 | 10 | 0 | 0 | 0 | 12/13 (92.3%) | 3/13 (23.1%) | 92.3% | 23.1% |
interprocedural-flow | 16 | 3 | 2 | 17 | 0 | 0 | 0 | 16/19 (84.2%) | 2/19 (10.5%) | 84.2% | 10.5% |
local-flow | 8 | 0 | 1 | 7 | 0 | 0 | 0 | 8/8 (100.0%) | 1/8 (12.5%) | 100.0% | 12.5% |
object-sensitivity | 5 | 0 | 2 | 3 | 0 | 0 | 0 | 5/5 (100.0%) | 2/5 (40.0%) | 100.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
infer-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 0 | 1 | 3 | 0 | 0 | 0 | 4/4 (100.0%) | 1/4 (25.0%) | 100.0% | 25.0% |
dynamic-dispatch | 2 | 1 | 1 | 2 | 0 | 0 | 0 | 2/3 (66.7%) | 1/3 (33.3%) | 66.7% | 33.3% |
flow-sensitivity | 2 | 5 | 0 | 7 | 0 | 0 | 0 | 2/7 (28.6%) | 0/7 (0.0%) | 28.6% | 0.0% |
heap-field-sensitivity | 8 | 1 | 0 | 9 | 0 | 0 | 0 | 8/9 (88.9%) | 0/9 (0.0%) | 88.9% | 0.0% |
interprocedural-flow | 8 | 6 | 1 | 13 | 0 | 0 | 0 | 8/14 (57.1%) | 1/14 (7.1%) | 57.1% | 7.1% |
local-flow | 5 | 2 | 0 | 7 | 0 | 0 | 0 | 5/7 (71.4%) | 0/7 (0.0%) | 71.4% | 0.0% |
object-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
recursion | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
infer-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 2/5 (40.0%) | 0/5 (0.0%) | 40.0% | 0.0% |
exceptional-flow | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 2 | 7 | 0 | 9 | 0 | 0 | 0 | 2/9 (22.2%) | 0/9 (0.0%) | 22.2% | 0.0% |
heap-field-sensitivity | 7 | 6 | 0 | 13 | 0 | 0 | 0 | 7/13 (53.8%) | 0/13 (0.0%) | 53.8% | 0.0% |
interprocedural-flow | 7 | 10 | 0 | 17 | 0 | 0 | 0 | 7/17 (41.2%) | 0/17 (0.0%) | 41.2% | 0.0% |
local-flow | 5 | 3 | 0 | 8 | 0 | 0 | 0 | 5/8 (62.5%) | 0/8 (0.0%) | 62.5% | 0.0% |
object-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
path-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
recursion | 0 | 6 | 0 | 6 | 0 | 0 | 0 | 0/6 (0.0%) | 0/6 (0.0%) | 0.0% | 0.0% |
infer-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 3 | 4 | 0 | 7 | 0 | 0 | 0 | 3/7 (42.9%) | 0/7 (0.0%) | 42.9% | 0.0% |
exceptional-flow | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
flow-sensitivity | 3 | 6 | 0 | 9 | 0 | 0 | 0 | 3/9 (33.3%) | 0/9 (0.0%) | 33.3% | 0.0% |
heap-field-sensitivity | 9 | 4 | 0 | 13 | 0 | 0 | 0 | 9/13 (69.2%) | 0/13 (0.0%) | 69.2% | 0.0% |
interprocedural-flow | 8 | 7 | 0 | 15 | 0 | 0 | 0 | 8/15 (53.3%) | 0/15 (0.0%) | 53.3% | 0.0% |
local-flow | 6 | 2 | 0 | 8 | 0 | 0 | 0 | 6/8 (75.0%) | 0/8 (0.0%) | 75.0% | 0.0% |
object-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
path-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
recursion | 0 | 6 | 0 | 6 | 0 | 0 | 0 | 0/6 (0.0%) | 0/6 (0.0%) | 0.0% | 0.0% |
infer-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 1 | 0 | 0 | 1 | 0 | 10 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
infer-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 2 | 5 | 0 | 0 | 0 | 3/7 (42.9%) | 2/7 (28.6%) | 42.9% | 28.6% |
exceptional-flow | 1 | 2 | 0 | 3 | 0 | 0 | 0 | 1/3 (33.3%) | 0/3 (0.0%) | 33.3% | 0.0% |
flow-sensitivity | 8 | 1 | 2 | 7 | 0 | 0 | 0 | 8/9 (88.9%) | 2/9 (22.2%) | 88.9% | 22.2% |
heap-field-sensitivity | 9 | 4 | 1 | 12 | 0 | 0 | 0 | 9/13 (69.2%) | 1/13 (7.7%) | 69.2% | 7.7% |
interprocedural-flow | 12 | 3 | 1 | 14 | 0 | 0 | 0 | 12/15 (80.0%) | 1/15 (6.7%) | 80.0% | 6.7% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 6 | 0 | 1 | 5 | 0 | 0 | 0 | 6/6 (100.0%) | 1/6 (16.7%) | 100.0% | 16.7% |
joern-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 2 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 2 | 0 | 2 | 0 | 8 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
joern-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 1 | 2 | 0 | 3 | 0 | 0 | 0 | 1/3 (33.3%) | 0/3 (0.0%) | 33.3% | 0.0% |
flow-sensitivity | 8 | 1 | 1 | 8 | 0 | 0 | 0 | 8/9 (88.9%) | 1/9 (11.1%) | 88.9% | 11.1% |
heap-field-sensitivity | 8 | 4 | 4 | 8 | 0 | 0 | 0 | 8/12 (66.7%) | 4/12 (33.3%) | 66.7% | 33.3% |
interprocedural-flow | 12 | 5 | 0 | 17 | 0 | 0 | 0 | 12/17 (70.6%) | 0/17 (0.0%) | 70.6% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 3 | 1 | 5 | 0 | 0 | 0 | 3/6 (50.0%) | 1/6 (16.7%) | 50.0% | 16.7% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
joern-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 2 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 2 | 0 | 2 | 0 | 8 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
joern-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 1 | 6 | 0 | 0 | 0 | 3/7 (42.9%) | 1/7 (14.3%) | 42.9% | 14.3% |
exceptional-flow | 1 | 2 | 0 | 3 | 0 | 0 | 0 | 1/3 (33.3%) | 0/3 (0.0%) | 33.3% | 0.0% |
flow-sensitivity | 8 | 1 | 2 | 7 | 0 | 0 | 0 | 8/9 (88.9%) | 2/9 (22.2%) | 88.9% | 22.2% |
heap-field-sensitivity | 9 | 4 | 0 | 13 | 0 | 0 | 0 | 9/13 (69.2%) | 0/13 (0.0%) | 69.2% | 0.0% |
interprocedural-flow | 13 | 6 | 2 | 17 | 0 | 0 | 0 | 13/19 (68.4%) | 2/19 (10.5%) | 68.4% | 10.5% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 6 | 0 | 1 | 5 | 0 | 0 | 0 | 6/6 (100.0%) | 1/6 (16.7%) | 100.0% | 16.7% |
joern-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 3 | 4 | 1 | 6 | 0 | 0 | 0 | 3/7 (42.9%) | 1/7 (14.3%) | 42.9% | 14.3% |
exceptional-flow | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 7 | 2 | 1 | 8 | 0 | 0 | 0 | 7/9 (77.8%) | 1/9 (11.1%) | 77.8% | 11.1% |
heap-field-sensitivity | 8 | 5 | 1 | 12 | 0 | 0 | 0 | 8/13 (61.5%) | 1/13 (7.7%) | 61.5% | 7.7% |
interprocedural-flow | 12 | 7 | 0 | 19 | 0 | 0 | 0 | 12/19 (63.2%) | 0/19 (0.0%) | 63.2% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 5 | 1 | 0 | 6 | 0 | 0 | 0 | 5/6 (83.3%) | 0/6 (0.0%) | 83.3% | 0.0% |
joern-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 2 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 2 | 0 | 2 | 0 | 8 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
joern-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 3 | 2 | 3 | 0 | 0 | 0 | 2/5 (40.0%) | 2/5 (40.0%) | 40.0% | 40.0% |
dynamic-dispatch | 1 | 6 | 1 | 6 | 0 | 0 | 0 | 1/7 (14.3%) | 1/7 (14.3%) | 14.3% | 14.3% |
exceptional-flow | 2 | 1 | 2 | 1 | 0 | 0 | 0 | 2/3 (66.7%) | 2/3 (66.7%) | 66.7% | 66.7% |
flow-sensitivity | 9 | 0 | 7 | 2 | 0 | 0 | 0 | 9/9 (100.0%) | 7/9 (77.8%) | 100.0% | 77.8% |
heap-field-sensitivity | 7 | 6 | 4 | 9 | 0 | 0 | 0 | 7/13 (53.8%) | 4/13 (30.8%) | 53.8% | 30.8% |
interprocedural-flow | 12 | 7 | 9 | 10 | 0 | 0 | 0 | 12/19 (63.2%) | 9/19 (47.4%) | 63.2% | 47.4% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 1 | 4 | 0 | 5 | 0 | 0 | 0 | 1/5 (20.0%) | 0/5 (0.0%) | 20.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 6 | 0 | 6 | 0 | 0 | 0 | 0 | 6/6 (100.0%) | 6/6 (100.0%) | 100.0% | 100.0% |
joern-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 6 | 1 | 2 | 5 | 0 | 0 | 0 | 6/7 (85.7%) | 2/7 (28.6%) | 85.7% | 28.6% |
heap-field-sensitivity | 5 | 4 | 0 | 9 | 0 | 0 | 0 | 5/9 (55.6%) | 0/9 (0.0%) | 55.6% | 0.0% |
interprocedural-flow | 9 | 5 | 1 | 13 | 0 | 0 | 0 | 9/14 (64.3%) | 1/14 (7.1%) | 64.3% | 7.1% |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 3 | 3 | 0 | 6 | 0 | 0 | 0 | 3/6 (50.0%) | 0/6 (0.0%) | 50.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
opentaint-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 6 | 1 | 2 | 5 | 0 | 0 | 0 | 6/7 (85.7%) | 2/7 (28.6%) | 85.7% | 28.6% |
exceptional-flow | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 7 | 2 | 1 | 8 | 0 | 0 | 0 | 7/9 (77.8%) | 1/9 (11.1%) | 77.8% | 11.1% |
heap-field-sensitivity | 10 | 3 | 3 | 10 | 0 | 0 | 0 | 10/13 (76.9%) | 3/13 (23.1%) | 76.9% | 23.1% |
interprocedural-flow | 13 | 2 | 0 | 15 | 0 | 0 | 0 | 13/15 (86.7%) | 0/15 (0.0%) | 86.7% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 5 | 1 | 0 | 6 | 0 | 0 | 0 | 5/6 (83.3%) | 0/6 (0.0%) | 83.3% | 0.0% |
opentaint-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 2 | 0 | 0 | 2 | 0 | 8 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
opentaint-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
opentaint-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 6 | 1 | 3 | 4 | 0 | 0 | 0 | 6/7 (85.7%) | 3/7 (42.9%) | 85.7% | 42.9% |
exceptional-flow | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 7 | 2 | 1 | 8 | 0 | 0 | 0 | 7/9 (77.8%) | 1/9 (11.1%) | 77.8% | 11.1% |
heap-field-sensitivity | 10 | 3 | 4 | 9 | 0 | 0 | 0 | 10/13 (76.9%) | 4/13 (30.8%) | 76.9% | 30.8% |
interprocedural-flow | 16 | 3 | 2 | 17 | 0 | 0 | 0 | 16/19 (84.2%) | 2/19 (10.5%) | 84.2% | 10.5% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 5 | 0 | 2 | 3 | 0 | 0 | 0 | 5/5 (100.0%) | 2/5 (40.0%) | 100.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 5 | 1 | 0 | 6 | 0 | 0 | 0 | 5/6 (83.3%) | 0/6 (0.0%) | 83.3% | 0.0% |
pysa-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 7 | 0 | 7 | 0 | 0 | 0 | 0/7 (0.0%) | 0/7 (0.0%) | 0.0% | 0.0% |
exceptional-flow | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 6 | 3 | 1 | 8 | 0 | 0 | 0 | 6/9 (66.7%) | 1/9 (11.1%) | 66.7% | 11.1% |
heap-field-sensitivity | 5 | 8 | 0 | 13 | 0 | 0 | 0 | 5/13 (38.5%) | 0/13 (0.0%) | 38.5% | 0.0% |
interprocedural-flow | 10 | 9 | 0 | 19 | 0 | 0 | 0 | 10/19 (52.6%) | 0/19 (0.0%) | 52.6% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 2/5 (40.0%) | 0/5 (0.0%) | 40.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 4 | 2 | 0 | 6 | 0 | 0 | 0 | 4/6 (66.7%) | 0/6 (0.0%) | 66.7% | 0.0% |
pysa-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 4 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
pysa-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 2 | 0 | 2 | 0 | 0 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
local-flow | 0 | 6 | 0 | 6 | 0 | 0 | 0 | 0/6 (0.0%) | 0/6 (0.0%) | 0.0% | 0.0% |
sanitizer | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
semgrep-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 8 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 28 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
semgrep-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 34 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 34 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 30 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 24 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 34 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 38 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 38 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 38 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 2 | 0 | 0 | 0 | 0 | 2/2 (100.0%) | 2/2 (100.0%) | 100.0% | 100.0% |
heap-field-sensitivity | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
local-flow | 6 | 0 | 4 | 2 | 0 | 0 | 0 | 6/6 (100.0%) | 4/6 (66.7%) | 100.0% | 66.7% |
sanitizer | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
semgrep-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 38 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 8 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 28 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
semgrep-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 24 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 34 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |