Analyzers — v0.9.0
Each scorecard is one frozen report: one analyzer, one track, one score
dimension, and one model profile. Scorecards remain independent populations.
TPR and FPR are macro-averages over templates and semantic dimensions;
inconclusive, unsupported, and runner-error remain coverage outcomes.
All 92 report partitions were freshly executed over the 1,108-case corpus. The result set contains 4,252 cells, including 216 Swift reference-adapter cells. The tables below are the authority for each analyzer’s rates, denominators, and capability boundaries.
bifrost-c-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-c-kernel-attempt-01/bifrost-c-kernel.json
(1f3c41c99de0…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 56 | 21 | 21 | 14 | 0 | 0 | 100.0% | 0.0% |
c | language-extension | 2 | 1 | 0 | 1 | 0 | 0 | 100.0% | n/a |
bifrost-cpp-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-cpp-kernel-attempt-01/bifrost-cpp-kernel.json
(2b3f61aa7e14…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 68 | 15 | 15 | 38 | 0 | 0 | 100.0% | 0.0% |
bifrost-csharp-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-csharp-kernel-attempt-01/bifrost-csharp-kernel.json
(43ea30a59d2a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
csharp | core | 70 | 21 | 21 | 28 | 0 | 0 | 100.0% | 0.0% |
bifrost-go-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-go-kernel-attempt-01/bifrost-go-kernel.json
(145eadb6759b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 70 | 21 | 21 | 28 | 0 | 0 | 100.0% | 0.0% |
bifrost-java-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-java-kernel-attempt-01/bifrost-java-kernel.json
(42bb13e651ae…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 23 | 23 | 24 | 0 | 0 | 100.0% | 0.0% |
bifrost-java-modeling-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-java-modeling-attempt-01/bifrost-java-modeling.json
(01efceea5efe…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 4 | 3 | 1 | 16 | 0 | 100.0% | 0.0% |
bifrost-java-native-taint-taint-tool-native
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-java-native-attempt-01/bifrost-java-native.json
(37e712f3f2ca…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
bifrost-javascript-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-javascript-kernel-attempt-01/bifrost-javascript-kernel.json
(c78ed45e2db5…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 70 | 24 | 24 | 22 | 0 | 0 | 100.0% | 0.0% |
bifrost-javascript-modeling-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-javascript-modeling-attempt-01/bifrost-javascript-modeling.json
(e29d64ef432d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 2 | 2 | 4 | 16 | 0 | 100.0% | 0.0% |
bifrost-javascript-native-taint-taint-tool-native
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-javascript-native-attempt-01/bifrost-javascript-native.json
(87401d1d6921…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
bifrost-kotlin-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-kotlin-kernel-attempt-01/bifrost-kotlin-kernel.json
(085c86db9aa1…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 70 | 16 | 16 | 38 | 0 | 0 | 100.0% | 0.0% |
bifrost-php-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-php-kernel-attempt-01/bifrost-php-kernel.json
(19b441599b9d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 70 | 17 | 17 | 36 | 0 | 0 | 100.0% | 0.0% |
bifrost-python-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-python-kernel-attempt-01/bifrost-python-kernel.json
(48a001725cdd…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 70 | 21 | 21 | 28 | 0 | 0 | 100.0% | 0.0% |
bifrost-python-modeling-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-python-modeling-attempt-01/bifrost-python-modeling.json
(4a0d2595ff9c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 4 | 3 | 1 | 16 | 0 | 100.0% | 0.0% |
bifrost-python-native-taint-taint-tool-native
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-python-native-attempt-01/bifrost-python-native.json
(ffb01f7a6627…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
bifrost-ruby-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-ruby-kernel-attempt-01/bifrost-ruby-kernel.json
(2a4cb99b0d4f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 70 | 18 | 18 | 34 | 0 | 0 | 100.0% | 0.0% |
bifrost-rust-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-rust-kernel-attempt-01/bifrost-rust-kernel.json
(50c723257f98…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 62 | 21 | 21 | 20 | 0 | 0 | 100.0% | 0.0% |
rust | language-extension | 2 | 0 | 0 | 2 | 0 | 0 | n/a | n/a |
bifrost-scala-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-scala-kernel-attempt-01/bifrost-scala-kernel.json
(fab916aaf850…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
scala | core | 70 | 21 | 21 | 28 | 0 | 0 | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-smoke-attempt-01/bifrost-smoke.json
(bdf965769125…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
cpp | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
csharp | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
go | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
java | calibration | 2 | 1 | 0 | 0 | 1 | 0 | not scored | not scored |
java | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
javascript | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
kotlin | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
php | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
python | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
ruby | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
rust | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
scala | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
typescript | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
bifrost-typescript-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.12.0 (build
676def6c6615, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/bifrost-typescript-kernel-attempt-01/bifrost-typescript-kernel.json
(9383ec9d3eae…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 70 | 23 | 23 | 24 | 0 | 0 | 100.0% | 0.0% |
codeql-c-kernel-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-c-kernel-attempt-01/codeql-c-kernel.json
(bd964e541b1b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 56 | 28 | 27 | 1 | 0 | 0 | 76.8% | 19.5% |
c | language-extension | 2 | 2 | 0 | 0 | 0 | 0 | 100.0% | n/a |
codeql-cpp-kernel-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-cpp-kernel-attempt-01/codeql-cpp-kernel.json
(c1f185afe04a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 68 | 25 | 42 | 1 | 0 | 0 | 57.3% | 19.9% |
codeql-csharp-kernel-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-csharp-kernel-attempt-01/codeql-csharp-kernel.json
(28da895de872…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
csharp | core | 70 | 33 | 36 | 1 | 0 | 0 | 77.9% | 28.5% |
codeql-go-kernel-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-go-kernel-attempt-01/codeql-go-kernel.json
(fdacf51005ab…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 70 | 31 | 39 | 0 | 0 | 0 | 67.3% | 24.0% |
codeql-java-kernel-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-java-kernel-attempt-01/codeql-java-kernel.json
(01937e57f671…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 36 | 34 | 0 | 0 | 0 | 79.4% | 26.9% |
codeql-java-modeling-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-java-modeling-attempt-01/codeql-java-modeling.json
(375d738de136…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 12 | 12 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-java-native-taint-taint-tool-native
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-java-native-attempt-01/codeql-java-native.json
(c939ff5472f1…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 7 | 5 | 0 | 0 | 0 | 100.0% | 29.2% |
codeql-javascript-kernel-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-javascript-kernel-attempt-01/codeql-javascript-kernel.json
(18e1381bb722…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 70 | 32 | 38 | 0 | 0 | 0 | 79.1% | 24.1% |
codeql-javascript-modeling-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-javascript-modeling-attempt-01/codeql-javascript-modeling.json
(ae098ee34e54…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 12 | 12 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-javascript-native-taint-taint-tool-native
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-javascript-native-attempt-01/codeql-javascript-native.json
(899bfe028394…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 7 | 5 | 0 | 0 | 0 | 70.8% | 58.3% |
codeql-kotlin-kernel-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-kotlin-kernel-attempt-01/codeql-kotlin-kernel.json
(07e6255a2c05…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 70 | 32 | 38 | 0 | 0 | 0 | 69.2% | 23.8% |
codeql-python-kernel-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-python-kernel-attempt-01/codeql-python-kernel.json
(2dff410bf650…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 70 | 32 | 37 | 1 | 0 | 0 | 79.1% | 27.5% |
codeql-python-modeling-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-python-modeling-attempt-01/codeql-python-modeling.json
(550555da81c9…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 12 | 12 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-python-native-taint-taint-tool-native
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-python-native-attempt-01/codeql-python-native.json
(402f18cd98ea…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 8 | 4 | 0 | 0 | 0 | 100.0% | 58.3% |
codeql-ruby-kernel-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-ruby-kernel-attempt-01/codeql-ruby-kernel.json
(365b210c0e7f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 70 | 31 | 38 | 1 | 0 | 0 | 73.1% | 24.8% |
codeql-rust-kernel-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-rust-kernel-attempt-01/codeql-rust-kernel.json
(a75f27e4e601…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 62 | 24 | 38 | 0 | 0 | 0 | 67.0% | 8.1% |
rust | language-extension | 2 | 0 | 2 | 0 | 0 | 0 | 0.0% | 0.0% |
codeql-typescript-kernel-taint-taint-benchmark-controlled
codeql 2.27.1 (build
938af3639d07, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-typescript-kernel-attempt-01/codeql-typescript-kernel.json
(ff0513fe85a7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 70 | 32 | 38 | 0 | 0 | 0 | 79.1% | 24.1% |
flowdroid-java-kernel-taint-taint-benchmark-controlled
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/flowdroid-java-kernel-attempt-01/flowdroid-java-kernel.json
(0d27b1a3cdda…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 34 | 36 | 0 | 0 | 0 | 86.8% | 11.4% |
flowdroid-java-modeling-taint-taint-benchmark-controlled
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/flowdroid-java-modeling-attempt-01/flowdroid-java-modeling.json
(10245102e301…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 7 | 7 | 0 | 10 | 0 | 100.0% | 0.0% |
flowdroid-java-native-taint-taint-tool-native
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/flowdroid-java-native-attempt-01/flowdroid-java-native.json
(e048d3e00a52…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
flowdroid-kotlin-kernel-taint-taint-benchmark-controlled
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/flowdroid-kotlin-kernel-attempt-01/flowdroid-kotlin-kernel.json
(335028ae4abd…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 70 | 36 | 34 | 0 | 0 | 0 | 89.9% | 17.9% |
infer-c-kernel-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/infer-c-kernel-attempt-01/infer-c-kernel.json
(f1181c1984d5…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 56 | 21 | 35 | 0 | 0 | 0 | 64.4% | 7.3% |
infer-cpp-kernel-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/infer-cpp-kernel-attempt-01/infer-cpp-kernel.json
(923b49de71e2…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 68 | 19 | 49 | 0 | 0 | 0 | 44.6% | 0.0% |
infer-java-kernel-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/infer-java-kernel-attempt-01/infer-java-kernel.json
(aca645f12c64…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 22 | 48 | 0 | 0 | 0 | 56.7% | 0.0% |
infer-java-modeling-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/infer-java-modeling-attempt-01/infer-java-modeling.json
(325d56f4069a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
infer-java-native-taint-taint-tool-native
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/infer-java-native-attempt-01/infer-java-native.json
(cba8a38eebd7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-java-kernel-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-java-kernel-attempt-01/joern-java-kernel.json
(db36ae8d1d8c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 32 | 38 | 0 | 0 | 0 | 74.2% | 19.4% |
joern-java-modeling-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-java-modeling-attempt-01/joern-java-modeling.json
(aecb8fb31ace…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 6 | 10 | 0 | 8 | 0 | 50.0% | 0.0% |
joern-java-native-taint-taint-tool-native
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-java-native-attempt-01/joern-java-native.json
(304eb5e86f0c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-javascript-kernel-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-javascript-kernel-attempt-01/joern-javascript-kernel.json
(7a94e664bfb6…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 70 | 32 | 38 | 0 | 0 | 0 | 71.0% | 15.3% |
joern-javascript-modeling-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-javascript-modeling-attempt-01/joern-javascript-modeling.json
(d39c0404c5af…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 6 | 10 | 0 | 8 | 0 | 50.0% | 0.0% |
joern-javascript-native-taint-taint-tool-native
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-javascript-native-attempt-01/joern-javascript-native.json
(616a6f6a3d5d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-php-kernel-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-php-kernel-attempt-01/joern-php-kernel.json
(11cfb0162bda…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 70 | 31 | 39 | 0 | 0 | 0 | 73.0% | 17.5% |
joern-python-kernel-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-python-kernel-attempt-01/joern-python-kernel.json
(c02d8bb38a5a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 70 | 29 | 41 | 0 | 0 | 0 | 65.6% | 12.5% |
joern-python-modeling-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-python-modeling-attempt-01/joern-python-modeling.json
(0a16dd739cf2…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 6 | 10 | 0 | 8 | 0 | 50.0% | 0.0% |
joern-python-native-taint-taint-tool-native
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-python-native-attempt-01/joern-python-native.json
(a247643bc313…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-ruby-kernel-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-ruby-kernel-attempt-01/joern-ruby-kernel.json
(8354a4fce495…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 70 | 35 | 35 | 0 | 0 | 0 | 64.5% | 46.9% |
joern-rust-kernel-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-rust-kernel-attempt-01/joern-rust-kernel.json
(286567625014…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 62 | 24 | 38 | 0 | 0 | 0 | 66.2% | 16.8% |
opentaint-java-kernel-taint-taint-benchmark-controlled
opentaint v0.4.6 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/opentaint-java-kernel-attempt-01/opentaint-java-kernel.json
(af106d8a9cc9…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 36 | 34 | 0 | 0 | 0 | 79.8% | 14.9% |
opentaint-java-modeling-taint-taint-benchmark-controlled
opentaint v0.4.6 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/opentaint-java-modeling-attempt-01/opentaint-java-modeling.json
(948461bd2700…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 6 | 6 | 0 | 12 | 0 | 100.0% | 0.0% |
opentaint-java-native-taint-taint-tool-native
opentaint v0.4.6 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/opentaint-java-native-attempt-01/opentaint-java-native.json
(0fde5b9005e3…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
opentaint-kotlin-kernel-taint-taint-benchmark-controlled
opentaint v0.4.6 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/opentaint-kotlin-kernel-attempt-01/opentaint-kotlin-kernel.json
(b23ed71666d6…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 70 | 37 | 33 | 0 | 0 | 0 | 79.5% | 20.1% |
pysa-python-kernel-taint-taint-benchmark-controlled
pysa 0.10.0 (build
pyre-check:0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/pysa-python-kernel-attempt-01/pysa-python-kernel.json
(661f33a6c9cc…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 70 | 23 | 47 | 0 | 0 | 0 | 51.2% | 5.7% |
pysa-python-modeling-taint-taint-benchmark-controlled
pysa 0.10.0 (build
pyre-check:0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/pysa-python-modeling-attempt-01/pysa-python-modeling.json
(5a913ce61996…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 10 | 10 | 0 | 4 | 0 | 100.0% | 0.0% |
pysa-python-native-taint-taint-tool-native
pysa 0.10.0 (build
pyre-check:0, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/pysa-python-native-attempt-01/pysa-python-native.json
(72c41e47101e…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 0 | 12 | 0 | 0 | 0 | 0.0% | 0.0% |
semgrep-c-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-c-kernel-attempt-01/semgrep-c-kernel.json
(4603d40444f2…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 56 | 9 | 5 | 0 | 42 | 0 | 100.0% | 42.9% |
semgrep-cpp-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-cpp-kernel-attempt-01/semgrep-cpp-kernel.json
(32e39e52e037…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 68 | 9 | 5 | 0 | 54 | 0 | 100.0% | 42.9% |
semgrep-go-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-go-kernel-attempt-01/semgrep-go-kernel.json
(20da30e837b7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-java-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-java-kernel-attempt-01/semgrep-java-kernel.json
(510c367061ff…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-java-modeling-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-java-modeling-attempt-01/semgrep-java-modeling.json
(27c2393988bb…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
semgrep-java-native-taint-taint-tool-native
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-java-native-attempt-01/semgrep-java-native.json
(a88b8bb55dfa…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
semgrep-javascript-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-javascript-kernel-attempt-01/semgrep-javascript-kernel.json
(de6f2097ec39…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-javascript-modeling-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-javascript-modeling-attempt-01/semgrep-javascript-modeling.json
(f3a45927ab07…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
semgrep-javascript-native-taint-taint-tool-native
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-javascript-native-attempt-01/semgrep-javascript-native.json
(c0c832586170…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
semgrep-kotlin-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-kotlin-kernel-attempt-01/semgrep-kotlin-kernel.json
(62876e3514cf…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-php-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-php-kernel-attempt-01/semgrep-php-kernel.json
(2b963198c149…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-python-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-python-kernel-attempt-01/semgrep-python-kernel.json
(5b56eba9a1b0…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-python-modeling-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-python-modeling-attempt-01/semgrep-python-modeling.json
(aae0cd301221…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
semgrep-python-native-taint-taint-tool-native
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-python-native-attempt-01/semgrep-python-native.json
(22012b9e6989…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 10 | 2 | 0 | 0 | 0 | 100.0% | 91.7% |
semgrep-ruby-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-ruby-kernel-attempt-01/semgrep-ruby-kernel.json
(4544d4bff866…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
semgrep-rust-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-rust-kernel-attempt-01/semgrep-rust-kernel.json
(557103313e53…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 62 | 9 | 5 | 0 | 48 | 0 | 100.0% | 42.9% |
semgrep-typescript-kernel-taint-taint-benchmark-controlled
semgrep 1.177.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/semgrep-typescript-kernel-attempt-01/semgrep-typescript-kernel.json
(88cabd99661f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 70 | 9 | 5 | 0 | 56 | 0 | 100.0% | 42.9% |
joern-swift-core-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
joern-normal-v1) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-swift-common108-attempt-01/joern-swift-core.json
(76f7f1e91268…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
swift | core | 66 | 0 | 0 | 66 | 0 | 0 | n/a | n/a |
joern-swift-modeling-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
joern-normal-v1) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-swift-common108-attempt-01/joern-swift-modeling.json
(8bc9bd91dbb7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
swift | modeling | 24 | 0 | 0 | 24 | 0 | 0 | n/a | n/a |
joern-swift-calibration-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
joern-normal-v1) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-swift-common108-attempt-01/joern-swift-calibration.json
(14309f833036…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
swift | calibration | 4 | 0 | 0 | 4 | 0 | 0 | not scored | not scored |
joern-swift-native-taint-taint-tool-native
joern 4.0.628 (build
joern-cli:4., adapter
joern-normal-v1) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-swift-common108-attempt-01/joern-swift-native.json
(63911a187877…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
swift | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-swift-language-extension-taint-taint-benchmark-controlled
joern 4.0.628 (build
joern-cli:4., adapter
joern-normal-v1) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/joern-swift-common108-attempt-01/joern-swift-language-extension.json
(7237eb7e55d8…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
swift | language-extension | 2 | 0 | 0 | 2 | 0 | 0 | n/a | n/a |
codeql-swift-core-taint-taint-benchmark-controlled
codeql 2.27.1 (build
codeql:938af, adapter
swift-normal-v1) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-swift-common108-attempt-01/codeql-swift-core.json
(ad20aef88c0a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
swift | core | 66 | 0 | 0 | 65 | 0 | 1 | n/a | n/a |
codeql-swift-modeling-taint-taint-benchmark-controlled
codeql 2.27.1 (build
codeql:938af, adapter
swift-normal-v1) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-swift-common108-attempt-01/codeql-swift-modeling.json
(4d4329855d8c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
swift | modeling | 24 | 0 | 0 | 24 | 0 | 0 | n/a | n/a |
codeql-swift-calibration-taint-taint-benchmark-controlled
codeql 2.27.1 (build
codeql:938af, adapter
swift-normal-v1) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-swift-common108-attempt-01/codeql-swift-calibration.json
(548917a9fddd…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
swift | calibration | 4 | 0 | 0 | 4 | 0 | 0 | not scored | not scored |
codeql-swift-native-taint-taint-tool-native
codeql 2.27.1 (build
codeql:938af, adapter
swift-normal-v1) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-swift-common108-attempt-01/codeql-swift-native.json
(2b83e2436da7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
swift | modeling | 12 | 0 | 0 | 12 | 0 | 0 | n/a | n/a |
codeql-swift-language-extension-taint-taint-benchmark-controlled
codeql 2.27.1 (build
codeql:938af, adapter
swift-normal-v1) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/releases/v0.9.0/normal/attempts/codeql-swift-common108-attempt-01/codeql-swift-language-extension.json
(c381ea80275c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
swift | language-extension | 2 | 0 | 0 | 2 | 0 | 0 | n/a | n/a |
Semantic dimension detail
Section titled “Semantic dimension detail”bifrost-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 2 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 4 | 0 | 0 | 4 | 6 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 6 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 8 | 0 | 0 | 8 | 12 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 0 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-c-kernel-taint-taint-benchmark-controlled — c, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
flow-sensitivity | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
bifrost-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 12 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 4 | 0 | 0 | 4 | 18 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 26 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-csharp-kernel-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 14 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 16 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 1 | 0 | 0 | 1 | 10 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 4 | 0 | 0 | 4 | 14 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 10 | 0 | 0 | 10 | 14 | 0 | 0 | 10/10 (100.0%) | 0/10 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 8 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 0 | 0 | 4 | 2 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 1 | 0 | 0 | 1 | 12 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 4 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 14 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 12 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 1 | 1 | 0 | 0 | 2/2 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
bifrost-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 1 | 0 | 0 | 1 | 10 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 4 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 7 | 0 | 0 | 7 | 10 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 10 | 0 | 0 | 10 | 14 | 0 | 0 | 10/10 (100.0%) | 0/10 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 4 | 0 | 0 | 4 | 4 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
bifrost-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 26 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 9 | 0 | 0 | 9 | 20 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 2 | 0 | 0 | 2 | 14 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 14 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 26 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 5 | 0 | 0 | 5 | 6 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 4 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 16 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 20 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 1 | 1 | 0 | 0 | 2/2 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
bifrost-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 4 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 2 | 0 | 0 | 2 | 14 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 7 | 0 | 0 | 7 | 12 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 26 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 6 | 0 | 0 | 6 | 4 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 5 | 0 | 0 | 5 | 4 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 10 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 0 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
heap-field-sensitivity | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-scala-kernel-taint-taint-benchmark-controlled — scala, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 4 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 16 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 20 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — scala, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 1 | 0 | 0 | 1 | 10 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 12 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 10 | 0 | 0 | 10 | 14 | 0 | 0 | 10/10 (100.0%) | 0/10 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 4 | 0 | 0 | 4 | 4 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
codeql-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 1 | 0 | 4 | 0 | 0 | 0 | 3/4 (75.0%) | 0/4 (0.0%) | 75.0% | 0.0% |
dynamic-dispatch | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
heap-field-sensitivity | 7 | 2 | 3 | 6 | 0 | 0 | 0 | 7/9 (77.8%) | 3/9 (33.3%) | 77.8% | 33.3% |
interprocedural-flow | 11 | 3 | 1 | 13 | 0 | 0 | 0 | 11/14 (78.6%) | 1/14 (7.1%) | 78.6% | 7.1% |
local-flow | 7 | 0 | 1 | 5 | 1 | 0 | 0 | 7/7 (100.0%) | 1/6 (16.7%) | 100.0% | 16.7% |
object-sensitivity | 3 | 2 | 1 | 4 | 0 | 0 | 0 | 3/5 (60.0%) | 1/5 (20.0%) | 60.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
codeql-c-kernel-taint-taint-benchmark-controlled — c, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
flow-sensitivity | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
heap-field-sensitivity | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
interprocedural-flow | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
local-flow | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
codeql-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 2/5 (40.0%) | 0/5 (0.0%) | 40.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
exceptional-flow | 1 | 2 | 1 | 2 | 0 | 0 | 0 | 1/3 (33.3%) | 1/3 (33.3%) | 33.3% | 33.3% |
flow-sensitivity | 8 | 1 | 3 | 6 | 0 | 0 | 0 | 8/9 (88.9%) | 3/9 (33.3%) | 88.9% | 33.3% |
heap-field-sensitivity | 5 | 8 | 3 | 10 | 0 | 0 | 0 | 5/13 (38.5%) | 3/13 (23.1%) | 38.5% | 23.1% |
interprocedural-flow | 11 | 6 | 2 | 15 | 0 | 0 | 0 | 11/17 (64.7%) | 2/17 (11.8%) | 64.7% | 11.8% |
local-flow | 7 | 1 | 1 | 6 | 1 | 0 | 0 | 7/8 (87.5%) | 1/7 (14.3%) | 87.5% | 14.3% |
object-sensitivity | 1 | 4 | 0 | 5 | 0 | 0 | 0 | 1/5 (20.0%) | 0/5 (0.0%) | 20.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
codeql-csharp-kernel-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 2 | 1 | 2 | 1 | 0 | 0 | 0 | 2/3 (66.7%) | 2/3 (66.7%) | 66.7% | 66.7% |
flow-sensitivity | 9 | 0 | 4 | 5 | 0 | 0 | 0 | 9/9 (100.0%) | 4/9 (44.4%) | 100.0% | 44.4% |
heap-field-sensitivity | 9 | 3 | 5 | 7 | 0 | 0 | 0 | 9/12 (75.0%) | 5/12 (41.7%) | 75.0% | 41.7% |
interprocedural-flow | 14 | 3 | 3 | 14 | 0 | 0 | 0 | 14/17 (82.4%) | 3/17 (17.6%) | 82.4% | 17.6% |
local-flow | 6 | 2 | 1 | 6 | 1 | 0 | 0 | 6/8 (75.0%) | 1/7 (14.3%) | 75.0% | 14.3% |
object-sensitivity | 4 | 2 | 1 | 5 | 0 | 0 | 0 | 4/6 (66.7%) | 1/6 (16.7%) | 66.7% | 16.7% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
codeql-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 1 | 5 | 0 | 6 | 0 | 0 | 0 | 1/6 (16.7%) | 0/6 (0.0%) | 16.7% | 0.0% |
exceptional-flow | 1 | 2 | 1 | 2 | 0 | 0 | 0 | 1/3 (33.3%) | 1/3 (33.3%) | 33.3% | 33.3% |
flow-sensitivity | 8 | 1 | 3 | 6 | 0 | 0 | 0 | 8/9 (88.9%) | 3/9 (33.3%) | 88.9% | 33.3% |
heap-field-sensitivity | 8 | 3 | 4 | 7 | 0 | 0 | 0 | 8/11 (72.7%) | 4/11 (36.4%) | 72.7% | 36.4% |
interprocedural-flow | 13 | 4 | 2 | 15 | 0 | 0 | 0 | 13/17 (76.5%) | 2/17 (11.8%) | 76.5% | 11.8% |
local-flow | 6 | 2 | 2 | 6 | 0 | 0 | 0 | 6/8 (75.0%) | 2/8 (25.0%) | 75.0% | 25.0% |
object-sensitivity | 4 | 2 | 1 | 5 | 0 | 0 | 0 | 4/6 (66.7%) | 1/6 (16.7%) | 66.7% | 16.7% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 5 | 1 | 1 | 5 | 0 | 0 | 0 | 5/6 (83.3%) | 1/6 (16.7%) | 83.3% | 16.7% |
codeql-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 5 | 2 | 2 | 5 | 0 | 0 | 0 | 5/7 (71.4%) | 2/7 (28.6%) | 71.4% | 28.6% |
exceptional-flow | 1 | 2 | 1 | 2 | 0 | 0 | 0 | 1/3 (33.3%) | 1/3 (33.3%) | 33.3% | 33.3% |
flow-sensitivity | 8 | 1 | 3 | 6 | 0 | 0 | 0 | 8/9 (88.9%) | 3/9 (33.3%) | 88.9% | 33.3% |
heap-field-sensitivity | 9 | 4 | 5 | 8 | 0 | 0 | 0 | 9/13 (69.2%) | 5/13 (38.5%) | 69.2% | 38.5% |
interprocedural-flow | 14 | 1 | 2 | 13 | 0 | 0 | 0 | 14/15 (93.3%) | 2/15 (13.3%) | 93.3% | 13.3% |
local-flow | 6 | 2 | 1 | 7 | 0 | 0 | 0 | 6/8 (75.0%) | 1/8 (12.5%) | 75.0% | 12.5% |
object-sensitivity | 4 | 1 | 2 | 3 | 0 | 0 | 0 | 4/5 (80.0%) | 2/5 (40.0%) | 80.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 5 | 1 | 1 | 5 | 0 | 0 | 0 | 5/6 (83.3%) | 1/6 (16.7%) | 83.3% | 16.7% |
codeql-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
codeql-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
local-flow | 6 | 0 | 1 | 5 | 0 | 0 | 0 | 6/6 (100.0%) | 1/6 (16.7%) | 100.0% | 16.7% |
sanitizer | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
flow-sensitivity | 9 | 0 | 4 | 5 | 0 | 0 | 0 | 9/9 (100.0%) | 4/9 (44.4%) | 100.0% | 44.4% |
heap-field-sensitivity | 9 | 3 | 4 | 8 | 0 | 0 | 0 | 9/12 (75.0%) | 4/12 (33.3%) | 75.0% | 33.3% |
interprocedural-flow | 14 | 3 | 3 | 14 | 0 | 0 | 0 | 14/17 (82.4%) | 3/17 (17.6%) | 82.4% | 17.6% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
codeql-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
codeql-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0/1 (0.0%) | 1/1 (100.0%) | 0.0% | 100.0% |
local-flow | 5 | 1 | 2 | 4 | 0 | 0 | 0 | 5/6 (83.3%) | 2/6 (33.3%) | 83.3% | 33.3% |
sanitizer | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
codeql-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 1 | 6 | 0 | 0 | 0 | 2/7 (28.6%) | 1/7 (14.3%) | 28.6% | 14.3% |
exceptional-flow | 1 | 2 | 1 | 2 | 0 | 0 | 0 | 1/3 (33.3%) | 1/3 (33.3%) | 33.3% | 33.3% |
flow-sensitivity | 8 | 1 | 3 | 6 | 0 | 0 | 0 | 8/9 (88.9%) | 3/9 (33.3%) | 88.9% | 33.3% |
heap-field-sensitivity | 9 | 4 | 5 | 8 | 0 | 0 | 0 | 9/13 (69.2%) | 5/13 (38.5%) | 69.2% | 38.5% |
interprocedural-flow | 14 | 5 | 3 | 16 | 0 | 0 | 0 | 14/19 (73.7%) | 3/19 (15.8%) | 73.7% | 15.8% |
local-flow | 6 | 2 | 1 | 7 | 0 | 0 | 0 | 6/8 (75.0%) | 1/8 (12.5%) | 75.0% | 12.5% |
object-sensitivity | 4 | 1 | 2 | 3 | 0 | 0 | 0 | 4/5 (80.0%) | 2/5 (40.0%) | 80.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 5 | 1 | 1 | 5 | 0 | 0 | 0 | 5/6 (83.3%) | 1/6 (16.7%) | 83.3% | 16.7% |
codeql-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 0 | 7 | 0 | 0 | 0 | 2/7 (28.6%) | 0/7 (0.0%) | 28.6% | 0.0% |
exceptional-flow | 2 | 1 | 2 | 1 | 0 | 0 | 0 | 2/3 (66.7%) | 2/3 (66.7%) | 66.7% | 66.7% |
flow-sensitivity | 9 | 0 | 4 | 5 | 0 | 0 | 0 | 9/9 (100.0%) | 4/9 (44.4%) | 100.0% | 44.4% |
heap-field-sensitivity | 9 | 4 | 4 | 9 | 0 | 0 | 0 | 9/13 (69.2%) | 4/13 (30.8%) | 69.2% | 30.8% |
interprocedural-flow | 15 | 4 | 3 | 16 | 0 | 0 | 0 | 15/19 (78.9%) | 3/19 (15.8%) | 78.9% | 15.8% |
local-flow | 7 | 1 | 1 | 6 | 1 | 0 | 0 | 7/8 (87.5%) | 1/7 (14.3%) | 87.5% | 14.3% |
object-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
codeql-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
codeql-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
local-flow | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
sanitizer | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
codeql-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 1 | 6 | 0 | 7 | 0 | 0 | 0 | 1/7 (14.3%) | 0/7 (0.0%) | 14.3% | 0.0% |
exceptional-flow | 2 | 1 | 2 | 1 | 0 | 0 | 0 | 2/3 (66.7%) | 2/3 (66.7%) | 66.7% | 66.7% |
flow-sensitivity | 9 | 0 | 4 | 5 | 0 | 0 | 0 | 9/9 (100.0%) | 4/9 (44.4%) | 100.0% | 44.4% |
heap-field-sensitivity | 9 | 4 | 3 | 10 | 0 | 0 | 0 | 9/13 (69.2%) | 3/13 (23.1%) | 69.2% | 23.1% |
interprocedural-flow | 14 | 5 | 3 | 16 | 0 | 0 | 0 | 14/19 (73.7%) | 3/19 (15.8%) | 73.7% | 15.8% |
local-flow | 7 | 1 | 1 | 6 | 1 | 0 | 0 | 7/8 (87.5%) | 1/7 (14.3%) | 87.5% | 14.3% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
codeql-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 6 | 1 | 1 | 6 | 0 | 0 | 0 | 6/7 (85.7%) | 1/7 (14.3%) | 85.7% | 14.3% |
heap-field-sensitivity | 5 | 4 | 1 | 8 | 0 | 0 | 0 | 5/9 (55.6%) | 1/9 (11.1%) | 55.6% | 11.1% |
interprocedural-flow | 10 | 4 | 0 | 14 | 0 | 0 | 0 | 10/14 (71.4%) | 0/14 (0.0%) | 71.4% | 0.0% |
local-flow | 7 | 0 | 1 | 6 | 0 | 0 | 0 | 7/7 (100.0%) | 1/7 (14.3%) | 100.0% | 14.3% |
object-sensitivity | 3 | 3 | 0 | 6 | 0 | 0 | 0 | 3/6 (50.0%) | 0/6 (0.0%) | 50.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
codeql-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
codeql-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
flow-sensitivity | 9 | 0 | 4 | 5 | 0 | 0 | 0 | 9/9 (100.0%) | 4/9 (44.4%) | 100.0% | 44.4% |
heap-field-sensitivity | 9 | 3 | 4 | 8 | 0 | 0 | 0 | 9/12 (75.0%) | 4/12 (33.3%) | 75.0% | 33.3% |
interprocedural-flow | 14 | 3 | 3 | 14 | 0 | 0 | 0 | 14/17 (82.4%) | 3/17 (17.6%) | 82.4% | 17.6% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
flowdroid-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 1 | 6 | 0 | 0 | 0 | 2/7 (28.6%) | 1/7 (14.3%) | 28.6% | 14.3% |
exceptional-flow | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 9 | 0 | 1 | 8 | 0 | 0 | 0 | 9/9 (100.0%) | 1/9 (11.1%) | 100.0% | 11.1% |
heap-field-sensitivity | 12 | 1 | 3 | 10 | 0 | 0 | 0 | 12/13 (92.3%) | 3/13 (23.1%) | 92.3% | 23.1% |
interprocedural-flow | 13 | 2 | 0 | 15 | 0 | 0 | 0 | 13/15 (86.7%) | 0/15 (0.0%) | 86.7% | 0.0% |
local-flow | 8 | 0 | 1 | 7 | 0 | 0 | 0 | 8/8 (100.0%) | 1/8 (12.5%) | 100.0% | 12.5% |
object-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
flowdroid-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 4 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flowdroid-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flowdroid-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 2 | 5 | 0 | 0 | 0 | 3/7 (42.9%) | 2/7 (28.6%) | 42.9% | 28.6% |
exceptional-flow | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 9 | 0 | 1 | 8 | 0 | 0 | 0 | 9/9 (100.0%) | 1/9 (11.1%) | 100.0% | 11.1% |
heap-field-sensitivity | 12 | 1 | 3 | 10 | 0 | 0 | 0 | 12/13 (92.3%) | 3/13 (23.1%) | 92.3% | 23.1% |
interprocedural-flow | 16 | 3 | 2 | 17 | 0 | 0 | 0 | 16/19 (84.2%) | 2/19 (10.5%) | 84.2% | 10.5% |
local-flow | 8 | 0 | 1 | 7 | 0 | 0 | 0 | 8/8 (100.0%) | 1/8 (12.5%) | 100.0% | 12.5% |
object-sensitivity | 5 | 0 | 2 | 3 | 0 | 0 | 0 | 5/5 (100.0%) | 2/5 (40.0%) | 100.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
infer-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 0 | 1 | 3 | 0 | 0 | 0 | 4/4 (100.0%) | 1/4 (25.0%) | 100.0% | 25.0% |
dynamic-dispatch | 2 | 1 | 1 | 2 | 0 | 0 | 0 | 2/3 (66.7%) | 1/3 (33.3%) | 66.7% | 33.3% |
flow-sensitivity | 2 | 5 | 0 | 7 | 0 | 0 | 0 | 2/7 (28.6%) | 0/7 (0.0%) | 28.6% | 0.0% |
heap-field-sensitivity | 8 | 1 | 0 | 9 | 0 | 0 | 0 | 8/9 (88.9%) | 0/9 (0.0%) | 88.9% | 0.0% |
interprocedural-flow | 8 | 6 | 1 | 13 | 0 | 0 | 0 | 8/14 (57.1%) | 1/14 (7.1%) | 57.1% | 7.1% |
local-flow | 5 | 2 | 0 | 7 | 0 | 0 | 0 | 5/7 (71.4%) | 0/7 (0.0%) | 71.4% | 0.0% |
object-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
recursion | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
infer-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 2/5 (40.0%) | 0/5 (0.0%) | 40.0% | 0.0% |
exceptional-flow | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 2 | 7 | 0 | 9 | 0 | 0 | 0 | 2/9 (22.2%) | 0/9 (0.0%) | 22.2% | 0.0% |
heap-field-sensitivity | 7 | 6 | 0 | 13 | 0 | 0 | 0 | 7/13 (53.8%) | 0/13 (0.0%) | 53.8% | 0.0% |
interprocedural-flow | 7 | 10 | 0 | 17 | 0 | 0 | 0 | 7/17 (41.2%) | 0/17 (0.0%) | 41.2% | 0.0% |
local-flow | 5 | 3 | 0 | 8 | 0 | 0 | 0 | 5/8 (62.5%) | 0/8 (0.0%) | 62.5% | 0.0% |
object-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
path-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
recursion | 0 | 6 | 0 | 6 | 0 | 0 | 0 | 0/6 (0.0%) | 0/6 (0.0%) | 0.0% | 0.0% |
infer-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 3 | 4 | 0 | 7 | 0 | 0 | 0 | 3/7 (42.9%) | 0/7 (0.0%) | 42.9% | 0.0% |
exceptional-flow | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
flow-sensitivity | 3 | 6 | 0 | 9 | 0 | 0 | 0 | 3/9 (33.3%) | 0/9 (0.0%) | 33.3% | 0.0% |
heap-field-sensitivity | 9 | 4 | 0 | 13 | 0 | 0 | 0 | 9/13 (69.2%) | 0/13 (0.0%) | 69.2% | 0.0% |
interprocedural-flow | 8 | 7 | 0 | 15 | 0 | 0 | 0 | 8/15 (53.3%) | 0/15 (0.0%) | 53.3% | 0.0% |
local-flow | 6 | 2 | 0 | 8 | 0 | 0 | 0 | 6/8 (75.0%) | 0/8 (0.0%) | 75.0% | 0.0% |
object-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
path-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
recursion | 0 | 6 | 0 | 6 | 0 | 0 | 0 | 0/6 (0.0%) | 0/6 (0.0%) | 0.0% | 0.0% |
infer-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 1 | 0 | 0 | 1 | 0 | 10 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
infer-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 2 | 5 | 0 | 0 | 0 | 3/7 (42.9%) | 2/7 (28.6%) | 42.9% | 28.6% |
exceptional-flow | 1 | 2 | 0 | 3 | 0 | 0 | 0 | 1/3 (33.3%) | 0/3 (0.0%) | 33.3% | 0.0% |
flow-sensitivity | 8 | 1 | 2 | 7 | 0 | 0 | 0 | 8/9 (88.9%) | 2/9 (22.2%) | 88.9% | 22.2% |
heap-field-sensitivity | 9 | 4 | 1 | 12 | 0 | 0 | 0 | 9/13 (69.2%) | 1/13 (7.7%) | 69.2% | 7.7% |
interprocedural-flow | 12 | 3 | 1 | 14 | 0 | 0 | 0 | 12/15 (80.0%) | 1/15 (6.7%) | 80.0% | 6.7% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 6 | 0 | 1 | 5 | 0 | 0 | 0 | 6/6 (100.0%) | 1/6 (16.7%) | 100.0% | 16.7% |
joern-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 2 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 2 | 0 | 2 | 0 | 8 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
joern-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 1 | 2 | 0 | 3 | 0 | 0 | 0 | 1/3 (33.3%) | 0/3 (0.0%) | 33.3% | 0.0% |
flow-sensitivity | 8 | 1 | 1 | 8 | 0 | 0 | 0 | 8/9 (88.9%) | 1/9 (11.1%) | 88.9% | 11.1% |
heap-field-sensitivity | 8 | 4 | 4 | 8 | 0 | 0 | 0 | 8/12 (66.7%) | 4/12 (33.3%) | 66.7% | 33.3% |
interprocedural-flow | 12 | 5 | 0 | 17 | 0 | 0 | 0 | 12/17 (70.6%) | 0/17 (0.0%) | 70.6% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 3 | 1 | 5 | 0 | 0 | 0 | 3/6 (50.0%) | 1/6 (16.7%) | 50.0% | 16.7% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
joern-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 2 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 2 | 0 | 2 | 0 | 8 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
joern-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 1 | 6 | 0 | 0 | 0 | 3/7 (42.9%) | 1/7 (14.3%) | 42.9% | 14.3% |
exceptional-flow | 1 | 2 | 0 | 3 | 0 | 0 | 0 | 1/3 (33.3%) | 0/3 (0.0%) | 33.3% | 0.0% |
flow-sensitivity | 8 | 1 | 2 | 7 | 0 | 0 | 0 | 8/9 (88.9%) | 2/9 (22.2%) | 88.9% | 22.2% |
heap-field-sensitivity | 9 | 4 | 0 | 13 | 0 | 0 | 0 | 9/13 (69.2%) | 0/13 (0.0%) | 69.2% | 0.0% |
interprocedural-flow | 13 | 6 | 2 | 17 | 0 | 0 | 0 | 13/19 (68.4%) | 2/19 (10.5%) | 68.4% | 10.5% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 6 | 0 | 1 | 5 | 0 | 0 | 0 | 6/6 (100.0%) | 1/6 (16.7%) | 100.0% | 16.7% |
joern-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 3 | 4 | 1 | 6 | 0 | 0 | 0 | 3/7 (42.9%) | 1/7 (14.3%) | 42.9% | 14.3% |
exceptional-flow | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 7 | 2 | 1 | 8 | 0 | 0 | 0 | 7/9 (77.8%) | 1/9 (11.1%) | 77.8% | 11.1% |
heap-field-sensitivity | 8 | 5 | 1 | 12 | 0 | 0 | 0 | 8/13 (61.5%) | 1/13 (7.7%) | 61.5% | 7.7% |
interprocedural-flow | 12 | 7 | 0 | 19 | 0 | 0 | 0 | 12/19 (63.2%) | 0/19 (0.0%) | 63.2% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 5 | 1 | 0 | 6 | 0 | 0 | 0 | 5/6 (83.3%) | 0/6 (0.0%) | 83.3% | 0.0% |
joern-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 2 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 2 | 0 | 2 | 0 | 8 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
joern-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 3 | 2 | 3 | 0 | 0 | 0 | 2/5 (40.0%) | 2/5 (40.0%) | 40.0% | 40.0% |
dynamic-dispatch | 1 | 6 | 1 | 6 | 0 | 0 | 0 | 1/7 (14.3%) | 1/7 (14.3%) | 14.3% | 14.3% |
exceptional-flow | 2 | 1 | 2 | 1 | 0 | 0 | 0 | 2/3 (66.7%) | 2/3 (66.7%) | 66.7% | 66.7% |
flow-sensitivity | 9 | 0 | 7 | 2 | 0 | 0 | 0 | 9/9 (100.0%) | 7/9 (77.8%) | 100.0% | 77.8% |
heap-field-sensitivity | 7 | 6 | 4 | 9 | 0 | 0 | 0 | 7/13 (53.8%) | 4/13 (30.8%) | 53.8% | 30.8% |
interprocedural-flow | 12 | 7 | 9 | 10 | 0 | 0 | 0 | 12/19 (63.2%) | 9/19 (47.4%) | 63.2% | 47.4% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 1 | 4 | 0 | 5 | 0 | 0 | 0 | 1/5 (20.0%) | 0/5 (0.0%) | 20.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 6 | 0 | 6 | 0 | 0 | 0 | 0 | 6/6 (100.0%) | 6/6 (100.0%) | 100.0% | 100.0% |
joern-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 6 | 1 | 2 | 5 | 0 | 0 | 0 | 6/7 (85.7%) | 2/7 (28.6%) | 85.7% | 28.6% |
heap-field-sensitivity | 5 | 4 | 0 | 9 | 0 | 0 | 0 | 5/9 (55.6%) | 0/9 (0.0%) | 55.6% | 0.0% |
interprocedural-flow | 9 | 5 | 1 | 13 | 0 | 0 | 0 | 9/14 (64.3%) | 1/14 (7.1%) | 64.3% | 7.1% |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 3 | 3 | 0 | 6 | 0 | 0 | 0 | 3/6 (50.0%) | 0/6 (0.0%) | 50.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
opentaint-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 6 | 1 | 2 | 5 | 0 | 0 | 0 | 6/7 (85.7%) | 2/7 (28.6%) | 85.7% | 28.6% |
exceptional-flow | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 7 | 2 | 1 | 8 | 0 | 0 | 0 | 7/9 (77.8%) | 1/9 (11.1%) | 77.8% | 11.1% |
heap-field-sensitivity | 10 | 3 | 3 | 10 | 0 | 0 | 0 | 10/13 (76.9%) | 3/13 (23.1%) | 76.9% | 23.1% |
interprocedural-flow | 13 | 2 | 0 | 15 | 0 | 0 | 0 | 13/15 (86.7%) | 0/15 (0.0%) | 86.7% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 5 | 1 | 0 | 6 | 0 | 0 | 0 | 5/6 (83.3%) | 0/6 (0.0%) | 83.3% | 0.0% |
opentaint-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 2 | 0 | 0 | 2 | 0 | 8 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
opentaint-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
opentaint-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 6 | 1 | 3 | 4 | 0 | 0 | 0 | 6/7 (85.7%) | 3/7 (42.9%) | 85.7% | 42.9% |
exceptional-flow | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 7 | 2 | 1 | 8 | 0 | 0 | 0 | 7/9 (77.8%) | 1/9 (11.1%) | 77.8% | 11.1% |
heap-field-sensitivity | 10 | 3 | 4 | 9 | 0 | 0 | 0 | 10/13 (76.9%) | 4/13 (30.8%) | 76.9% | 30.8% |
interprocedural-flow | 16 | 3 | 2 | 17 | 0 | 0 | 0 | 16/19 (84.2%) | 2/19 (10.5%) | 84.2% | 10.5% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 5 | 0 | 2 | 3 | 0 | 0 | 0 | 5/5 (100.0%) | 2/5 (40.0%) | 100.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 5 | 1 | 0 | 6 | 0 | 0 | 0 | 5/6 (83.3%) | 0/6 (0.0%) | 83.3% | 0.0% |
pysa-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 7 | 0 | 7 | 0 | 0 | 0 | 0/7 (0.0%) | 0/7 (0.0%) | 0.0% | 0.0% |
exceptional-flow | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 6 | 3 | 1 | 8 | 0 | 0 | 0 | 6/9 (66.7%) | 1/9 (11.1%) | 66.7% | 11.1% |
heap-field-sensitivity | 5 | 8 | 0 | 13 | 0 | 0 | 0 | 5/13 (38.5%) | 0/13 (0.0%) | 38.5% | 0.0% |
interprocedural-flow | 10 | 9 | 0 | 19 | 0 | 0 | 0 | 10/19 (52.6%) | 0/19 (0.0%) | 52.6% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 2/5 (40.0%) | 0/5 (0.0%) | 40.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 4 | 2 | 0 | 6 | 0 | 0 | 0 | 4/6 (66.7%) | 0/6 (0.0%) | 66.7% | 0.0% |
pysa-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 4 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
pysa-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 2 | 0 | 2 | 0 | 0 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
local-flow | 0 | 6 | 0 | 6 | 0 | 0 | 0 | 0/6 (0.0%) | 0/6 (0.0%) | 0.0% | 0.0% |
sanitizer | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
semgrep-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 8 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 28 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
semgrep-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 34 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 34 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 30 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 24 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 34 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 38 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 38 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 38 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 2 | 0 | 0 | 0 | 0 | 2/2 (100.0%) | 2/2 (100.0%) | 100.0% | 100.0% |
heap-field-sensitivity | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
local-flow | 6 | 0 | 4 | 2 | 0 | 0 | 0 | 6/6 (100.0%) | 4/6 (66.7%) | 100.0% | 66.7% |
sanitizer | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
semgrep-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 38 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
semgrep-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 8 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 28 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
semgrep-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 12 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 24 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 34 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
joern-swift-core-taint-taint-benchmark-controlled — swift, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 8 | 0 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 0 | 0 | 0 | 0 | 18 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 26 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 34 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 16 | 0 | 0 | n/a | n/a | n/a | n/a |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
joern-swift-modeling-taint-taint-benchmark-controlled — swift, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 8 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
object-sensitivity | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
joern-swift-native-taint-taint-tool-native — swift, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-swift-language-extension-taint-taint-benchmark-controlled — swift, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
heap-field-sensitivity | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
codeql-swift-core-taint-taint-benchmark-controlled — swift, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 8 | 0 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 0 | 0 | 0 | 0 | 18 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 26 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 34 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 15 | 0 | 1 | n/a | n/a | n/a | n/a |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 0 | 0 | 0 | 0 | 5 | 0 | 1 | n/a | n/a | n/a | n/a |
recursion | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
codeql-swift-modeling-taint-taint-benchmark-controlled — swift, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 8 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
object-sensitivity | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
codeql-swift-native-taint-taint-tool-native — swift, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
codeql-swift-language-extension-taint-taint-benchmark-controlled — swift, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
heap-field-sensitivity | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |