Skip to content

Languages — v0.9.2

Rows are (language, scorecard, tier) partitions. They share a table for navigation, not a denominator. Definitive counts reached and not-reached; Inconclusive preserves incomplete proof, unsupported records a declared capability boundary, and runner-error records a failed execution. None is scored as a negative. Language participation and model profiles remain separate in the generated results.

Language Scorecard Model profile Tier Cases Definitive Incomplete TPR (macro) FPR (macro)
c bifrost-c-kernel-taint-taint-benchmark-controlled benchmark-controlled core 56 42 14 100.0% 0.0%
c bifrost-c-kernel-taint-taint-benchmark-controlled benchmark-controlled language-extension 2 1 1 100.0% n/a
c bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
c codeql-c-kernel-taint-taint-benchmark-controlled benchmark-controlled core 56 55 1 76.8% 19.5%
c codeql-c-kernel-taint-taint-benchmark-controlled benchmark-controlled language-extension 2 2 0 100.0% n/a
c infer-c-kernel-taint-taint-benchmark-controlled benchmark-controlled core 56 56 0 64.4% 7.3%
c semgrep-c-kernel-taint-taint-benchmark-controlled benchmark-controlled core 56 14 42 100.0% 42.9%
cpp bifrost-cpp-kernel-taint-taint-benchmark-controlled benchmark-controlled core 68 30 38 100.0% 0.0%
cpp bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
cpp codeql-cpp-kernel-taint-taint-benchmark-controlled benchmark-controlled core 68 67 1 57.3% 19.9%
cpp infer-cpp-kernel-taint-taint-benchmark-controlled benchmark-controlled core 68 68 0 44.6% 0.0%
cpp semgrep-cpp-kernel-taint-taint-benchmark-controlled benchmark-controlled core 68 14 54 100.0% 42.9%
csharp bifrost-csharp-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 44 26 100.0% 8.5%
csharp bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
csharp codeql-csharp-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 69 1 77.9% 28.5%
go bifrost-go-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 44 26 100.0% 0.0%
go bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
go codeql-go-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 69 1 67.3% 21.2%
go semgrep-go-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
java bifrost-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 46 24 100.0% 0.0%
java bifrost-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 7 17 100.0% 0.0%
java bifrost-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
java bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled calibration 2 1 1 not scored not scored
java bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 32 32 0 100.0% 0.0%
java codeql-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 79.4% 26.9%
java codeql-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 24 0 100.0% 0.0%
java codeql-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
java flowdroid-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 86.8% 11.4%
java flowdroid-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 14 10 100.0% 0.0%
java flowdroid-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
java infer-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 56.7% 0.0%
java infer-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 10 14 100.0% 0.0%
java infer-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
java joern-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 74.2% 19.4%
java joern-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 16 8 50.0% 0.0%
java joern-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
java opentaint-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 79.8% 14.9%
java opentaint-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 12 12 100.0% 0.0%
java opentaint-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
java semgrep-java-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
java semgrep-java-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 10 14 100.0% 0.0%
java semgrep-java-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
javascript bifrost-javascript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 48 22 100.0% 0.0%
javascript bifrost-javascript-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 4 20 100.0% 0.0%
javascript bifrost-javascript-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
javascript bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 32 32 0 100.0% 0.0%
javascript codeql-javascript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 79.1% 24.1%
javascript codeql-javascript-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 24 0 100.0% 0.0%
javascript codeql-javascript-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
javascript joern-javascript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 71.0% 15.3%
javascript joern-javascript-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 16 8 50.0% 0.0%
javascript joern-javascript-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
javascript semgrep-javascript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
javascript semgrep-javascript-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 10 14 100.0% 0.0%
javascript semgrep-javascript-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
kotlin bifrost-kotlin-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 32 38 100.0% 0.0%
kotlin bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
kotlin codeql-kotlin-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 69.2% 23.8%
kotlin flowdroid-kotlin-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 89.9% 17.9%
kotlin opentaint-kotlin-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 79.5% 20.1%
kotlin semgrep-kotlin-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
php bifrost-php-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 34 36 100.0% 0.0%
php bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
php joern-php-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 73.0% 17.5%
php semgrep-php-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
python bifrost-python-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 42 28 100.0% 0.0%
python bifrost-python-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 7 17 100.0% 0.0%
python bifrost-python-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
python bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 32 32 0 100.0% 0.0%
python codeql-python-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 69 1 79.1% 27.5%
python codeql-python-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 24 0 100.0% 0.0%
python codeql-python-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
python joern-python-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 65.6% 12.5%
python joern-python-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 16 8 50.0% 0.0%
python joern-python-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
python pysa-python-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 51.2% 5.7%
python pysa-python-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 20 4 100.0% 0.0%
python pysa-python-native-taint-taint-tool-native tool-native modeling 12 12 0 0.0% 0.0%
python semgrep-python-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
python semgrep-python-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 10 14 100.0% 0.0%
python semgrep-python-native-taint-taint-tool-native tool-native modeling 12 12 0 100.0% 91.7%
ruby bifrost-ruby-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 36 34 100.0% 0.0%
ruby bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
ruby codeql-ruby-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 69 1 73.1% 24.8%
ruby joern-ruby-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 64.5% 46.9%
ruby semgrep-ruby-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%
rust bifrost-rust-kernel-taint-taint-benchmark-controlled benchmark-controlled core 62 42 20 100.0% 0.0%
rust bifrost-rust-kernel-taint-taint-benchmark-controlled benchmark-controlled language-extension 2 1 1 n/a 0.0%
rust bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
rust codeql-rust-kernel-taint-taint-benchmark-controlled benchmark-controlled core 62 62 0 61.0% 6.9%
rust codeql-rust-kernel-taint-taint-benchmark-controlled benchmark-controlled language-extension 2 2 0 0.0% 0.0%
rust joern-rust-kernel-taint-taint-benchmark-controlled benchmark-controlled core 62 0 62 n/a n/a
rust semgrep-rust-kernel-taint-taint-benchmark-controlled benchmark-controlled core 62 14 48 100.0% 42.9%
scala bifrost-scala-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 42 28 100.0% 0.0%
scala bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
swift codeql-swift-calibration-taint-taint-benchmark-controlled benchmark-controlled calibration 4 0 4 not scored not scored
swift codeql-swift-core-taint-taint-benchmark-controlled benchmark-controlled core 66 0 66 n/a n/a
swift codeql-swift-language-extension-taint-taint-benchmark-controlled benchmark-controlled language-extension 2 0 2 n/a n/a
swift codeql-swift-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 0 24 n/a n/a
swift codeql-swift-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
swift joern-swift-calibration-taint-taint-benchmark-controlled benchmark-controlled calibration 4 0 4 not scored not scored
swift joern-swift-core-taint-taint-benchmark-controlled benchmark-controlled core 66 0 66 n/a n/a
swift joern-swift-language-extension-taint-taint-benchmark-controlled benchmark-controlled language-extension 2 0 2 n/a n/a
swift joern-swift-modeling-taint-taint-benchmark-controlled benchmark-controlled modeling 24 0 24 n/a n/a
swift joern-swift-native-taint-taint-tool-native tool-native modeling 12 0 12 n/a n/a
typescript bifrost-smoke-taint-taint-benchmark-controlled benchmark-controlled core 2 2 0 100.0% 0.0%
typescript bifrost-typescript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 46 24 100.0% 0.0%
typescript codeql-typescript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 70 0 79.1% 24.1%
typescript semgrep-typescript-kernel-taint-taint-benchmark-controlled benchmark-controlled core 70 14 56 100.0% 42.9%