Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Conceptual Combinations - Benchmark Task for BIG-Bench
2021 (English)Other (Refereed)
Abstract [en]

This is a task accepted in July 2021 as part of Google’s “Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models”. It is published at https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/conceptual_combinations. Links to the collection of queries are below, followed by the ReadMe file that explains the task, its justification, and its performance with existing AI language models.

Place, publisher, year, pages
2021.
National Category
Language Technology (Computational Linguistics) Philosophy
Identifiers
URN: urn:nbn:se:umu:diva-193533OAI: oai:DiVA.org:umu-193533DiVA, id: diva2:1650019
Available from: 2022-04-05 Created: 2022-04-05 Last updated: 2022-04-07Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

URL

Authority records

Coelho Mollo, Dimitri

Search in DiVA

By author/editor
Coelho Mollo, Dimitri
Language Technology (Computational Linguistics)Philosophy

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 490 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf