Question: Provide a list of papers that have utilized the BERT + BiLSTM + CRF Decoding model and include the links to their code?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "BERT + BiLSTM + CRF Decoding" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Indicate the model that performed best in terms of Pearson Correlation metric on the MedSTS benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Pearson Correlation" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "MedSTS" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What are the titles and IDs of research papers that include a benchmark for the WSC dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "WSC" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: List the code links in papers that use the linear-chain CRFs model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "linear-chain CRFs" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: List the code links in papers that use the DrQA model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "DrQA" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Which model has achieved the highest Accuracy score on the SST-5 Fine-grained classification benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Accuracy" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "SST-5 Fine-grained classification" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What evaluation metrics are commonly used when benchmarking models on the ARC-PDN dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ARC-PDN" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Which QA benchmarks incorporating more than 10000 questions?

SELECT ?papers, ?papers_labels
WHERE {
  ?papers rdf:type orkgc:Paper;
          orkgp:P31 ?contrib;
          rdfs:label ?papers_labels.
  ?contrib orkgp:P41923 ?questions_number_str.
  BIND(REPLACE(?questions_number_str, "[+]", "") AS ?questions_number_preprocessed)
  BIND(xsd:integer(REPLACE(?questions_number_preprocessed, "","", "")) AS ?questions_number)
  FILTER(?questions_number > 10000)
}

What is the list of question answering benchmarks with more than 10000 questions?


Question: What evaluation metrics are commonly used when benchmarking models on the Atari 2600 Berzerk dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Berzerk" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Give me a list of research papers along with their titles and IDs, that have performed benchmarks on the Stanford Cars dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Stanford Cars" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: What are the titles and IDs of research papers that include a benchmark for the BUCC German-to-English dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "BUCC German-to-English" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: What are the metrics of evaluation over the Stanford Cars dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Stanford Cars" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What are the titles and IDs of research papers that include a benchmark for the ShARe/CLEF eHealth corpus dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ShARe/CLEF eHealth corpus" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: For what piezoresistive material the least response time was obtained?

PREFIX orkgp: <http://orkg.org/orkg/predicate/> SELECT ?piezoresistive_materials WHERE { orkgr:R138374 orkgp:compareContribution ?contrib . ?contrib orkgp:P41021 ?piezoresistive_materials . ?contrib orkgp:P41022 ?response_time . } ORDER BY ASC ( ?response_time ) LIMIT 1

Which piezoresistive material is characterized by the minimum response time in the experiments?


Question: List the code links in papers that use the GPT-2 (small) model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "GPT-2 (small)" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: List the metrics that are used to evaluate models on the Atari 2600 Fishing Derby benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Fishing Derby" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the best performing model benchmarking the ImageNet dataset in terms of Number of params metric?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Number of params" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ImageNet" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Can you list the models that have been evaluated on the Atari 2600 Battle Zone dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Battle Zone" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: List the code links in papers that use the BiT-M model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "BiT-M" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What is the highest benchmark result achieved on the Atari 2600 Star Gunner dataset, including the metric and its value?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Star Gunner" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Can you provide links to code used in papers that benchmark the NASCell model?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "NASCell" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Where can I find code references in papers that have used the TCN model for benchmarking purposes?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "TCN" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What is the top benchmark result (metric and value) over the dataset BUCC French-to-English?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "BUCC French-to-English" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What is the top benchmark result (metric and value) over the dataset SQuAD2.0?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "SQuAD2.0" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What is the top benchmark result (metric and value) over the dataset BC2GM?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "BC2GM" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: List the metrics that are used to evaluate models on the Story Cloze Test benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Story Cloze Test" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Who has contributed to the largest number of articles about coronavirus?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT ?author_name WHERE { { SELECT ( COUNT ( ?paper_ ) as ?max_n_papers ) WHERE { ?paper_ a orkgc:Paper ; rdfs:label ?title_ ; orkgp:P27 ?author_ . FILTER ( REGEX ( STR ( ?title_ ) , "2019-nCoV" ) ) } GROUP BY ?author_ ORDER BY DESC ( ?max_n_papers ) LIMIT 1 } ?paper a orkgc:Paper ; rdfs:label ?title ; orkgp:P27 ?author . OPTIONAL { ?author rdfs:label ?author_label } BIND ( IF ( BOUND ( ?author_label ) , ?author_label , ?author ) as ?author_name ) FILTER ( REGEX ( STR ( ?title ) , "2019-nCoV" ) ) } GROUP BY ?author ?type ?author_name ?max_n_papers HAVING ( COUNT ( ?paper ) = ?max_n_papers )

Which authors had the biggest contribution to the papers about the corona visus?


Question: What are the models that have been benchmarked on the DuIE dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "DuIE" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What coolant does ASTRID reactor use?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX xsd: <http://www.w3.org/2001/XMLSchema#> SELECT ?coolant ?coolant_label WHERE { ?ASTRID_reactor ?rdfs_label "ASTRID" ^^ xsd:string . ?contrib ?reactor_predicate ?ASTRID_reactor . ?contrib ?predicates ?coolant . ?predicates rdfs:label ?predicates_label . FILTER ( REGEX ( ?predicates_label , "coolant" ) ) ?coolant rdfs:label ?coolant_label . }

What is the collant used by the ASTRID reactor?


Question: Can you provide the highest benchmark result, including the metric and score, for the Atari 2600 Berzerk dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Berzerk" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Can you list the models that have been evaluated on the Atari 2600 Skiing dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Skiing" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What are the most commonly used benchmark datasets for the Text Summarization research field?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?dataset ?dataset_lbl WHERE { ?problem a orkgc:Problem ; rdfs:label ?problem_lbl . FILTER ( str ( ?problem_lbl ) = "Text Summarization" ) ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . }


Question: What are the metrics of evaluation over the Atari 2600 Tutankham dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Tutankham" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the name of the top performing model in terms of Score score when benchmarked on the Atari 2600 Tutankham dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Score" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Tutankham" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Can you list the models that have been evaluated on the PROTEINS dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "PROTEINS" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What is the name of the top performing model in terms of F1 score when benchmarked on the Natural Questions (long) dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "F1" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Natural Questions (long)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What are the metrics of evaluation over the CommitmentBank dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "CommitmentBank" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Can you provide links to code used in papers that benchmark the BiT-M (ResNet) model?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "BiT-M (ResNet)" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What is the best performing model benchmarking the ACE 2004 dataset in terms of RE+ Micro F1 metric?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "RE+ Micro F1" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ACE 2004" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What is the top benchmark score and its metric on the Nottingham dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Nottingham" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What evaluation metrics are commonly used when benchmarking models on the STEM-ECR v1.0 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "STEM-ECR v1.0" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Can you provide links to code used in papers that benchmark the Multi-Perspective Matching (single model) model?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Multi-Perspective Matching (single model)" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What models are being evaluated on the GAD dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "GAD" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What are the metrics of evaluation over the PubMed 20k RCT dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "PubMed 20k RCT" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: List the metrics that are used to evaluate models on the Gibson PointGoal Navigation benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Gibson PointGoal Navigation" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Give me a list of research papers along with their titles and IDs, that have performed benchmarks on the AAPD dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "AAPD" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Where can I find code references in papers that have used the AxCell model for benchmarking purposes?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "AxCell" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Can you provide links to code used in papers that benchmark the AWD-LSTM model?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "AWD-LSTM" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What are the titles and IDs of research papers that include a benchmark for the PubMedQA dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "PubMedQA" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Name the datasets that have been used for benchmarking in the Image Classification research problem?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?dataset ?dataset_lbl WHERE { ?problem a orkgc:Problem ; rdfs:label ?problem_lbl . FILTER ( str ( ?problem_lbl ) = "Image Classification" ) ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . }


Question: Can you provide the highest benchmark result, including the metric and score, for the Gibson PointGoal Navigation dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Gibson PointGoal Navigation" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Which model has achieved the highest Score score on the Cheetah, run (DMControl500k) benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Score" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Cheetah, run (DMControl500k)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What is the top benchmark score and its metric on the Stanford Dogs dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Stanford Dogs" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Indicate the model that performed best in terms of Senseval 2 metric on the Supervised: benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Senseval 2" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Supervised:" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Indicate the model that performed best in terms of Test perplexity metric on the WikiText-103 benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Test perplexity" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "WikiText-103" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What is the highest benchmark result achieved on the WMT2016 English-Russian dataset, including the metric and its value?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "WMT2016 English-Russian" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What is the most common lead compound?

PREFIX orkgp: <http://orkg.org/orkg/predicate/> SELECT ?compound WHERE { orkgr:R75638 orkgp:compareContribution ?contrib . ?contrib orkgp:P35194 ?compound . } ORDER BY DESC ( COUNT ( ?compound ) ) LIMIT 1


Question: What is the name of the top performing model in terms of Score score when benchmarked on the Atari 2600 Enduro dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Score" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Enduro" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Provide a list of papers that have utilized the C51 noop model and include the links to their code?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "C51 noop" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Can you provide links to code used in papers that benchmark the FABIR model?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "FABIR" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What is the emergency type of AMBER Alert?

PREFIX orkgp: <http://orkg.org/orkg/predicate/> SELECT DISTINCT ?emergency_type WHERE { orkgr:R153500 orkgp:P31 ?contrib . ?contrib orkgp:P43093 ?emergency_type . }

Which type of emergency is indicated with amber alerts?


Question: List the metrics that are used to evaluate models on the CoQA benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "CoQA" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Indicate the model that performed best in terms of F1 metric on the OntoNotes benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "F1" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "OntoNotes" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What are the titles and IDs of research papers that include a benchmark for the Atari 2600 Defender dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Defender" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Where can I find code references in papers that have used the Pointer + Coverage + EntailmentGen + QuestionGen model for benchmarking purposes?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Pointer + Coverage + EntailmentGen + QuestionGen" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Provide a list of papers that have utilized the Switch Transformer model and include the links to their code?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Switch Transformer" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Can you list the models that have been evaluated on the CommonsenseQA dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "CommonsenseQA" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What evaluation metrics are commonly used when benchmarking models on the Amazon-2 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Amazon-2" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: List the code links in papers that use the A3C-CTS model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "A3C-CTS" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What is the top benchmark score and its metric on the Hutter Prize dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Hutter Prize" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Which model has achieved the highest F1 score on the CoNLL 2003 (English) benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "F1" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "CoNLL 2003 (English)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What is the name of the top performing model in terms of Params score when benchmarked on the VTAB-1k dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Params" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "VTAB-1k" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Can you list benchmarked problems in the area of Artificial Intelligence?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?problem ?problem_lbl WHERE { ?rf a orkgc:ResearchField ; rdfs:label ?rf_label . FILTER ( str ( ?rf_label ) = "Artificial Intelligence" ) ?paper orkgp:P30 ?rf ; orkgp:P31 ?cont . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . ?problem rdfs:label ?problem_lbl . }


Question: What are the models that have been benchmarked on the FSNS - Test dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "FSNS - Test" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What is the best performing model benchmarking the WMT2014 German-English dataset in terms of BLEU metric?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "BLEU" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "WMT2014 German-English" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Can you provide links to code used in papers that benchmark the BiLSTM-Attention + ELMo model?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "BiLSTM-Attention + ELMo" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What is the highest benchmark result achieved on the STS Benchmark dataset, including the metric and its value?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "STS Benchmark" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Provide a list of papers that have utilized the Shake-Shake (SAM) model and include the links to their code?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Shake-Shake (SAM)" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What are the most commonly used benchmark datasets for the Joint Entity and Relation Extraction research field?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?dataset ?dataset_lbl WHERE { ?problem a orkgc:Problem ; rdfs:label ?problem_lbl . FILTER ( str ( ?problem_lbl ) = "Joint Entity and Relation Extraction" ) ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . }


Question: What evaluation metrics are commonly used when benchmarking models on the MultiRC dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "MultiRC" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Where can I find code references in papers that have used the SRU++ Base model for benchmarking purposes?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "SRU++ Base" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Indicate the model that performed best in terms of Score metric on the Atari 2600 Asteroids benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Score" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Asteroids" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: List the title and ID of research papers that contain a benchmark over the WMT2014 German-English dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "WMT2014 German-English" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: What are the models that have been benchmarked on the SearchQA dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "SearchQA" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What are the metrics of evaluation over the OntoNotes dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "OntoNotes" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What are the metrics of evaluation over the Atari 2600 Defender dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Defender" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the highest benchmark result achieved on the WMT2014 English-German dataset, including the metric and its value?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "WMT2014 English-German" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What are the titles and IDs of research papers that include a benchmark for the PWC Leaderboards (restricted) dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "PWC Leaderboards (restricted)" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: List the metrics that are used to evaluate models on the enwik8 benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "enwik8" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What evaluation metrics are commonly used when benchmarking models on the TempEval-3 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "TempEval-3" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the most common location in the studies?

PREFIX orkgp: <http://orkg.org/orkg/predicate/> SELECT ?locations WHERE { orkgr:R111045 orkgp:compareContribution ?cont . ?cont orkgp:P37537 ?locations . } ORDER BY DESC ( COUNT ( ?locations ) ) LIMIT 1

Where do the studies most often take place?


Question: Provide a list of papers that have utilized the BCN+ELMo model and include the links to their code?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "BCN+ELMo" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Indicate the model that performed best in terms of Pre-Training Dataset metric on the HMDB51 benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Pre-Training Dataset" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "HMDB51" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Can you list the models that have been evaluated on the Classical music, 5 seconds at 12 kHz dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Classical music, 5 seconds at 12 kHz" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Indicate the model that performed best in terms of BLEU score metric on the IWSLT2014 German-English benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "BLEU score" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "IWSLT2014 German-English" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Indicate the model that performed best in terms of F1 metric on the BC5CDR-disease benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "F1" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "BC5CDR-disease" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What evaluation metrics are commonly used when benchmarking models on the Atari 2600 Skiing dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Skiing" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: List the title and ID of research papers that contain a benchmark over the Atari 2600 Frostbite dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Frostbite" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Can you provide links to code used in papers that benchmark the COMET - Direct model?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "COMET - Direct" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Could you provide a list of models that have been tested on the BUCC Russian-to-English benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "BUCC Russian-to-English" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: What is the highest benchmark result achieved on the Atari 2600 Boxing dataset, including the metric and its value?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Boxing" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Which model has achieved the highest F1 score score on the Penn Treebank benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "F1 score" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Penn Treebank" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Can you provide the highest benchmark result, including the metric and score, for the IWSLT2015 German-English dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "IWSLT2015 German-English" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What are the metrics of evaluation over the Atari 2600 Frostbite dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Frostbite" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the top benchmark score and its metric on the MultiNLI dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "MultiNLI" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Can you list the models that have been evaluated on the ImageNet ReaL dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ImageNet ReaL" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Which model has achieved the highest Accuracy score on the Reuters En-De benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Accuracy" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Reuters En-De" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Can you provide the highest benchmark result, including the metric and score, for the Kinetics-600 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Kinetics-600" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: List the metrics that are used to evaluate models on the Yelp-5 benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Yelp-5" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Provide a list of papers that have utilized the BART model and include the links to their code?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "BART" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What is the top benchmark score and its metric on the Natural Questions (short) dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Natural Questions (short)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What evaluation metrics are commonly used when benchmarking models on the Sequential CIFAR-10 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Sequential CIFAR-10" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the top benchmark score and its metric on the Automatically labeled Medline abstracts corpus dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Automatically labeled Medline abstracts corpus" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Name the datasets that have been used for benchmarking in the citation classification research problem?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?dataset ?dataset_lbl WHERE { ?problem a orkgc:Problem ; rdfs:label ?problem_lbl . FILTER ( str ( ?problem_lbl ) = "citation classification" ) ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . }


Question: List the code links in papers that use the H-NLI model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "H-NLI" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What are the titles and IDs of research papers that include a benchmark for the PubMed 20k RCT dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "PubMed 20k RCT" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Indicate the model that performed best in terms of Macro Recall metric on the NLP-TDMS (Exp, arXiv only) benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Macro Recall" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "NLP-TDMS (Exp, arXiv only)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What is the name of the top performing model in terms of NLL score when benchmarked on the Nottingham dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "NLL" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Nottingham" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Where can I find code references in papers that have used the DCN model for benchmarking purposes?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "DCN" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What is the best performing model benchmarking the iNaturalist 2018 dataset in terms of Top-1 Accuracy metric?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Top-1 Accuracy" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "iNaturalist 2018" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What is the top benchmark score and its metric on the Atari 2600 Ice Hockey dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Ice Hockey" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: Provide a list of benchmarked datasets related to the Scientific Results Extraction research area?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?dataset ?dataset_lbl WHERE { ?problem a orkgc:Problem ; rdfs:label ?problem_lbl . FILTER ( str ( ?problem_lbl ) = "Scientific Results Extraction" ) ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . }


Question: What are the titles and IDs of research papers that include a benchmark for the Walker, walk (DMControl500k) dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Walker, walk (DMControl500k)" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Provide a list of benchmarked datasets related to the Semantic Role Labeling research area?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?dataset ?dataset_lbl WHERE { ?problem a orkgc:Problem ; rdfs:label ?problem_lbl . FILTER ( str ( ?problem_lbl ) = "Semantic Role Labeling" ) ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . }


Question: Provide a list of research paper titles and IDs that have benchmarked models on the WikiText-2 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "WikiText-2" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: What are the metrics of evaluation over the PWC Leaderboards (restricted) dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "PWC Leaderboards (restricted)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: List the code links in papers that use the Duel noop model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Duel noop" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: List the datasets benchmarked under the Fine-Grained Image Classification research problem?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?dataset ?dataset_lbl WHERE { ?problem a orkgc:Problem ; rdfs:label ?problem_lbl . FILTER ( str ( ?problem_lbl ) = "Fine-Grained Image Classification" ) ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . }


Question: What evaluation metrics are commonly used when benchmarking models on the DRI Corpus dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "DRI Corpus" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: List the metrics that are used to evaluate models on the Oxford-IIIT Pets benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Oxford-IIIT Pets" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the name of the top performing model in terms of Unpermuted Accuracy score when benchmarked on the Sequential CIFAR-10 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Unpermuted Accuracy" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Sequential CIFAR-10" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: Give me a list of research papers along with their titles and IDs, that have performed benchmarks on the STL-10 dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "STL-10" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Could you provide a list of models that have been tested on the SciCite benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "SciCite" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Provide a list of research paper titles and IDs that have benchmarked models on the Atari 2600 Skiing dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Skiing" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: List the metrics that are used to evaluate models on the VTAB-1k benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "VTAB-1k" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the name of the top performing model in terms of Score score when benchmarked on the Cart Pole (OpenAI Gym) dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Score" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Cart Pole (OpenAI Gym)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: List the code links in papers that use the Rfa-Gate-arccos model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Rfa-Gate-arccos" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Indicate the model that performed best in terms of F1 metric on the ShARe/CLEF eHealth corpus benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "F1" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ShARe/CLEF eHealth corpus" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What are the metrics of evaluation over the BioASQ dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "BioASQ" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: What is the best performing model benchmarking the Atari 2600 Centipede dataset in terms of Score metric?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Score" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Centipede" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What are the most commonly used benchmark datasets for the Natural Language Inference research field?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?dataset ?dataset_lbl WHERE { ?problem a orkgc:Problem ; rdfs:label ?problem_lbl . FILTER ( str ( ?problem_lbl ) = "Natural Language Inference" ) ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:P32 ?problem . }


Question: What models are being evaluated on the Classic dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Classic" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Where can I find code references in papers that have used the DeiT-Ti model for benchmarking purposes?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "DeiT-Ti" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: For which country of study overall prevalence of epilepsy is the highest?

SELECT ?country, ?country_label
WHERE {
  orkgr:R75729 orkgp:compareContribution ?contrib.
  ?contrib orkgp:P15512 ?country.
  ?contrib orkgp:P16013 ?overall_prevalence.
  ?country rdfs:label ?country_label.
  ?overall_prevalence rdfs:label ?overall_prevalence_value
}
ORDER BY DESC(?overall_prevalence_value)
LIMIT 1

In which country is the overall prevalence of epilepsy the highest?


Question: Can you list the models that have been evaluated on the ShARe/CLEF eHealth corpus dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ShARe/CLEF eHealth corpus" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Could you provide a list of models that have been tested on the HMDB51 benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "HMDB51" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?paper orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?paper orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } }


Question: Give me a list of research papers along with their titles and IDs, that have performed benchmarks on the Atari 2600 Venture dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Venture" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: List the metrics that are used to evaluate models on the Rotowire (Content Selection) benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Rotowire (Content Selection)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Where can I find code references in papers that have used the Tsetlin Machine model for benchmarking purposes?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Tsetlin Machine" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: What is the top benchmark score and its metric on the Atari 2600 Breakout dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Breakout" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What evaluation metrics are commonly used when benchmarking models on the Atari 2600 Bowling dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "Atari 2600 Bowling" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: List the code links in papers that use the FQF model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "FQF" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Indicate the model that performed best in terms of Sequence error metric on the FSNS - Test benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Sequence error" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "FSNS - Test" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }


Question: What is the top benchmark result (metric and value) over the dataset ARC (Challenge)?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl ( MAX ( ?value ) AS ?score ) WHERE { { SELECT ?metric ?metric_lbl ?value WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "ARC (Challenge)" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } ?cont orkgp:HAS_BENCHMARK ?benchmark . OPTIONAL { ?cont orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } } ORDER BY DESC ( ?value ) } } GROUP BY ?metric ?metric_lbl


Question: What are the titles and IDs of research papers that include a benchmark for the SciREX dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?paper ?paper_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "SciREX" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?paper orkgp:P31 ?cont ; rdfs:label ?paper_lbl . }


Question: Can you list the metrics used to evaluate models on the TSE-NER dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?metric ?metric_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "TSE-NER" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . OPTIONAL { ?eval orkgp:HAS_METRIC ?metric . ?metric rdfs:label ?metric_lbl . } }


Question: Where can I find code references in papers that have used the Concept Mention Extraction model for benchmarking purposes?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "Concept Mention Extraction" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: List the code links in papers that use the OTF spelling+lemma (single) model in any benchmark?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "OTF spelling+lemma (single)" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Provide a list of papers that have utilized the A3C LSTM hs model and include the links to their code?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?code WHERE { ?model a orkgc:Model ; rdfs:label ?model_lbl . FILTER ( str ( ?model_lbl ) = "A3C LSTM hs" ) ?benchmark orkgp:HAS_DATASET ?dataset . ?cont orkgp:HAS_BENCHMARK ?benchmark . ?cont orkgp:HAS_MODEL ?model ; orkgp:HAS_SOURCE_CODE ?code . }


Question: Which model has achieved the highest Percentage error score on the SVHN benchmark dataset?

PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX orkgp: <http://orkg.org/orkg/predicate/> PREFIX orkgc: <http://orkg.org/orkg/class/> SELECT DISTINCT ?model ?model_lbl WHERE { ?metric a orkgc:Metric ; rdfs:label ?metric_lbl . FILTER ( str ( ?metric_lbl ) = "Percentage error" ) { SELECT ?model ?model_lbl WHERE { ?dataset a orkgc:Dataset ; rdfs:label ?dataset_lbl . FILTER ( str ( ?dataset_lbl ) = "SVHN" ) ?benchmark orkgp:HAS_DATASET ?dataset ; orkgp:HAS_EVALUATION ?eval . ?eval orkgp:HAS_VALUE ?value ; orkgp:HAS_METRIC ?metric . ?cont orkgp:HAS_BENCHMARK ?benchmark ; orkgp:HAS_MODEL ?model . ?model rdfs:label ?model_lbl . } ORDER BY DESC ( ?value ) LIMIT 1 } }