Skip to content
DataFlowBench

Languages — v0.8.0

Rows are (language, scorecard, tier) partitions. They share a table for navigation, not a denominator. Definitive counts reached and not-reached; incomplete counts inconclusive, unsupported, and runner-error, which remain capability coverage and are never scored as negatives.

The v0.8.0 population expands to 1,000 cases with recursive-composition fixtures across the supported kernel languages. All 82 reports were freshly rerun. Languages with more rows have broader analyzer coverage; row count is not a quality score, and model profiles remain separate populations.

Language Scorecard Model profile Tier Cases Definitive Incomplete TPR (macro) FPR (macro)
c bifrost-c-kernel-taint-taint-benchmark-controlled benchmark-controlled core 56 42 14 100.0% 0.0%
c bifrost-c-kernel-taint-taint-benchmark-controlled benchmark-controlled language-extension 2 1 1 100.0% n/a
c bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
c codeql-c-kernel-taint-taint-benchmark-controlled benchmark-controlled core 56 0 56 n/a n/a
c codeql-c-kernel-taint-taint-benchmark-controlled benchmark-controlled language-extension 2 0 2 n/a n/a
c infer-c-kernel-taint-taint-benchmark-controlled benchmark-controlled core 56 56 0 64.4% 7.3%
c semgrep-c-kernel-taint-taint-benchmark-controlled benchmark-controlled core 56 14 42 100.0% 42.9%
cpp bifrost-cpp-kernel-taint-taint-benchmark-controlled benchmark-controlled core 68 30 38 100.0% 0.0%
cpp bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
cpp codeql-cpp-kernel-taint-taint-benchmark-controlled benchmark-controlled core 68 0 68 n/a n/a
cpp infer-cpp-kernel-taint-taint-benchmark-controlled benchmark-controlled core 68 68 0 44.6% 0.0%
cpp semgrep-cpp-kernel-taint-taint-benchmark-controlled benchmark-controlled core 68 14 54 100.0% 42.9%
csharp bifrost-csharp-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 36 34 100.0% 0.0%
csharp bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
csharp codeql-csharp-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 69 1 77.9% 28.5%
go bifrost-go-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 40 30 100.0% 0.0%
go bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
go codeql-go-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 67.3% 24.0%
go semgrep-go-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
java bifrost-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 46 24 100.0% 0.0%
java bifrost-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 7 17 100.0% 0.0%
java bifrost-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
java bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled calibration 2 1 1 not scored not scored
java bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 32 32 0 100.0% 0.0%
java codeql-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 79.4% 26.9%
java codeql-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 24 0 100.0% 0.0%
java codeql-java-native-taint-taint-tool-native tool-native modeling 12 12 0 100.0% 29.2%
java flowdroid-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 86.8% 11.4%
java flowdroid-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 14 10 100.0% 0.0%
java flowdroid-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
java infer-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 56.7% 0.0%
java infer-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 10 14 100.0% 0.0%
java infer-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
java joern-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 74.2% 19.4%
java joern-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 16 8 50.0% 0.0%
java joern-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
java opentaint-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 79.8% 14.9%
java opentaint-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 12 12 100.0% 0.0%
java opentaint-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
java semgrep-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
java semgrep-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 10 14 100.0% 0.0%
java semgrep-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
javascript bifrost-javascript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 40 30 100.0% 0.0%
javascript bifrost-javascript-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 4 20 100.0% 0.0%
javascript bifrost-javascript-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
javascript bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 32 32 0 100.0% 0.0%
javascript codeql-javascript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 79.1% 24.1%
javascript codeql-javascript-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 24 0 100.0% 0.0%
javascript codeql-javascript-native-taint-taint-tool-native tool-native modeling 12 12 0 70.8% 58.3%
javascript joern-javascript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 71.0% 15.3%
javascript joern-javascript-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 16 8 50.0% 0.0%
javascript joern-javascript-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
javascript semgrep-javascript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
javascript semgrep-javascript-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 10 14 100.0% 0.0%
javascript semgrep-javascript-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
kotlin bifrost-kotlin-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 32 38 100.0% 0.0%
kotlin bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
kotlin codeql-kotlin-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 69.2% 23.8%
kotlin flowdroid-kotlin-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 89.9% 17.9%
kotlin opentaint-kotlin-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 79.5% 20.1%
kotlin semgrep-kotlin-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
php bifrost-php-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 34 36 100.0% 0.0%
php bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
php joern-php-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 73.0% 17.5%
php semgrep-php-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
python bifrost-python-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 36 34 100.0% 0.0%
python bifrost-python-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 7 17 100.0% 0.0%
python bifrost-python-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
python bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 32 32 0 100.0% 0.0%
python codeql-python-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 69 1 79.1% 27.5%
python codeql-python-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 24 0 100.0% 0.0%
python codeql-python-native-taint-taint-tool-native tool-native modeling 12 12 0 100.0% 58.3%
python joern-python-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 65.6% 12.5%
python joern-python-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 16 8 50.0% 0.0%
python joern-python-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
python pysa-python-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 51.2% 5.7%
python pysa-python-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 20 4 100.0% 0.0%
python pysa-python-native-taint-taint-tool-native tool-native modeling 12 12 0 0.0% 0.0%
python semgrep-python-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
python semgrep-python-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 10 14 100.0% 0.0%
python semgrep-python-native-taint-taint-tool-native tool-native modeling 12 12 0 100.0% 91.7%
ruby bifrost-ruby-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 36 34 100.0% 0.0%
ruby bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
ruby codeql-ruby-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 69 1 73.1% 24.8%
ruby joern-ruby-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 64.5% 46.9%
ruby semgrep-ruby-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
rust bifrost-rust-kernel-taint-taint-benchmark-controlled benchmark-controlled core 62 42 20 100.0% 0.0%
rust bifrost-rust-kernel-taint-taint-benchmark-controlled benchmark-controlled language-extension 2 0 2 n/a n/a
rust bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
rust codeql-rust-kernel-taint-taint-benchmark-controlled benchmark-controlled core 62 62 0 67.0% 8.1%
rust codeql-rust-kernel-taint-taint-benchmark-controlled benchmark-controlled language-extension 2 2 0 0.0% 0.0%
rust joern-rust-kernel-taint-taint-benchmark-controlled benchmark-controlled core 62 62 0 66.2% 16.8%
rust semgrep-rust-kernel-taint-taint-benchmark-controlled benchmark-controlled core 62 14 48 100.0% 42.9%
scala bifrost-scala-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 42 28 100.0% 0.0%
scala bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
typescript bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
typescript bifrost-typescript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 38 32 100.0% 0.0%
typescript codeql-typescript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 79.1% 24.1%
typescript semgrep-typescript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%