Types of Tasks and Paper Links
| Year |
Tasks |
Corpus Type |
Question Type |
Answer Source |
Answer Type |
Paper Links |
| 2013 |
MCTest |
Textual |
Natural |
Free-Form |
Multichoice |
|
| 2015 |
CNN/Daily Mail |
Textual |
Cloze |
Spans |
Natural |
|
| 2015 |
CuratedTREC |
Textual |
Natural |
Free-Form |
Natural |
|
| 2015 |
WikiQA |
Textual |
Natural |
Free-Form |
Natural |
|
| 2016 |
WikiMovies |
Textual |
Natural |
Free-Form |
Natural |
|
| 2016 |
SQuAD1.1 |
Textual |
Natural |
Spans |
Natural |
|
| 2016 |
Who-did-What |
Textual |
Cloze |
Free-Form |
Natural |
|
| 2016 |
MS MARCO |
Textual |
Natural |
Free-Form |
Natural |
|
| 2016 |
NewsQA |
Textual |
Natural |
Spans |
Natural |
|
| 2016 |
LAMBADA |
Textual |
Cloze |
Free-Form |
Natural |
|
| 2016 |
WikiReading |
Textual |
Synthesis |
Free-Form |
Natural |
|
| 2016 |
Facebook CBT |
Textual |
Cloze |
Free-Form |
Multichoice |
|
| 2016 |
BookTest |
Textual |
Cloze |
Free-Form |
Multichoice |
|
| 2016 |
Google MC-AFP |
Textual |
Synthesis |
Free-Form |
Multichoice |
|
| 2016 |
MovieQA |
Multi-modal |
Natural |
Free-Form |
Multichoice |
|
| 2017 |
TriviaQA(Web) |
Textual |
Natural |
Free-Form |
Natural |
|
| 2017 |
TriviaQA(Wiki) |
Textual |
Natural |
Free-Form |
Natural |
|
| 2017 |
RACE |
Textual |
Natural |
Free-Form |
Multichoice |
|
| 2017 |
Quasar-S |
Textual |
Cloze |
Spans |
Multichoice |
|
| 2017 |
Quasar-T |
Textual |
Natural |
Spans |
Natural |
|
| 2017 |
SearchQA |
Textual |
Natural |
Free-Form |
Natural |
|
| 2017 |
NarrativeQA |
Textual |
Natural |
Free-Form |
Natural |
|
| 2017 |
SciQ |
Textual |
Natural |
Spans |
Multichoice |
|
| 2017 |
Qangaroo-MEDHOP |
Textual |
Synthesis |
Spans |
Multichoice |
|
| 2017 |
Qangaroo-WIKIHOP |
Textual |
Synthesis |
Spans |
Multichoice |
|
| 2017 |
TQA |
Multi-modal |
Natural |
Free-Form |
Multichoice |
|
| 2017 |
COMICS(Cloze) |
Multi-modal |
Cloze |
Free-Form |
Multichoice |
|
| 2017 |
COMICS(Coherence) |
Multi-modal |
Natural |
Free-Form |
Multichoice |
|
| 2018 |
QuAC |
Textual |
Natural |
Free-Form |
Natural |
|
| 2018 |
CoQA |
Textual |
Natural |
Free-Form |
Natural |
|
| 2018 |
SQuAD2.0 |
Textual |
Natural |
Spans |
Natural |
|
| 2018 |
HotpotQA(Distractor) |
Textual |
Natural |
Spans |
Natural |
|
| 2018 |
HotpotQA(Fullwiki) |
Textual |
Natural |
Spans |
Natural |
|
| 2018 |
DuoRC-Self |
Textual |
Natural |
Free-Form |
Natural |
|
| 2018 |
DuoRC-Paraphrase |
Textual |
Natural |
Free-Form |
Natural |
|
| 2018 |
CLOTH |
Textual |
Cloze |
Free-Form |
Natural |
|
| 2018 |
ReCoRD |
Textual |
Cloze |
Free-Form |
Natural |
|
| 2018 |
CliCR |
Textual |
Cloze |
Free-Form |
Natural |
|
| 2018 |
ReviewQA |
Textual |
Natural |
Spans |
Multichoice |
|
| 2018 |
ARC-Challenge Set |
Textual |
Natural |
Free-Form |
Multichoice |
|
| 2018 |
ARC-Easy Set |
Textual |
Natural |
Free-Form |
Multichoice |
|
| 2018 |
OpenBookQA |
Textual |
Natural |
Free-Form |
Multichoice |
|
| 2018 |
SciTail |
Textual |
Natural |
Free-Form |
Multichoice |
|
| 2018 |
MultiRC |
Textual |
Natural |
Free-Form |
Multichoice |
|
| 2018 |
RecipeQA(Cloze) |
Multi-modal |
Cloze |
Free-Form |
Multichoice |
|
| 2018 |
RecipeQA(Coherence) |
Multi-modal |
Natural |
Free-Form |
Multichoice |
|
| 2018 |
PaperQA-T(Park etc 2018) |
Textual |
Cloze |
Free-Form |
Multichoice |
|
| 2018 |
PaperQA-L(Park etc 2018) |
Textual |
Cloze |
Free-Form |
Multichoice |
|
| 2018 |
PaperQA(Hong etc 2018) |
Textual |
Natural |
Spans |
Natural |
|
| 2018 |
MCScript |
Textual |
Natural |
Free-Form |
Multichoice |
|
| 2018 |
ProPara |
Textual |
Natural |
Spans |
Natural |
|
| 2019 |
Natrual Question(Short) |
Textual |
Natural |
Spans |
Natural |
|
| 2019 |
Natrual Question(Long) |
Textual |
Natural |
Spans |
Natural |
|
| 2019 |
DREAM |
Textual |
Natural |
Free-Form |
Multichoice |
|
| 2019 |
ShARC |
Textual |
Natural |
Free-Form |
Multichoice |
|
| 2019 |
CommonSenseQA |
Textual |
Natural |
Free-Form |
Multichoice |
|
| 2019 |
DROP |
Textual |
Natural |
Free-Form |
Natural |
|