数据集摘要

该存储库提供了使用docTTTTTquery（有时写作docT5query或doc2query-T5）为MS MARCO V1文档语料库生成的查询的查询。基本思想是训练一个模型，当给定输入文档时，生成文档可能回答的问题（或更广泛地说，文档可能相关的查询）。然后，这些预测的问题（或查询）被添加到原始文档中，然后像以前一样进行索引。docTTTTTquery模型的名称来自于使用T5作为扩展模型的方式。

数据集结构

所有三个折叠（训练、开发和测试）共享同一个语料库。一个示例数据条目如下：

{
    "id": "D1555982",
    "predicted_queries": ["when find radius of star r", "what is r radius", "how to find out radius of star", "what is radius r", "what is radius of r", "how do you find radius of star igel", "which law states that radiation is proportional to radiation?", "what is the radius of a spherical star", "what is the radius of the star", "what is radius of star", "which radiation is produced during a solar radiation experiment?", "how to find radius r", "what is radius r of a star", "the hot glowing surfaces of stars emit energy in the form of", "what is the radius of a star", "what is the radius of a star", "how to find radius r on a star", "how to find radius r in a solar cell", "what kind of energy does a hot glowing surface of a star emit?", "what kind of energy does the hot glowing surface of stars emit"]
}

加载数据集

加载数据集的示例：

dataset = load_dataset('castorini/msmarco_v1_doc_doc2query-t5_expansions')

引用信息

@article{docTTTTTquery,
  title={From doc2query to {docTTTTTquery}},
  author={Nogueira, Rodrigo and Lin, Jimmy},
  year={2019}
}

@article{emdt5,
   author = "Ronak Pradeep and Rodrigo Nogueira and Jimmy Lin",
   title = "The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models",
   journal = "arXiv:2101.05667",
   year = 2021,
}