模型:
unicamp-dl/mMiniLM-L6-v2-en-pt-msmarco-v2
mMiniLM-L6-v2-en-pt-msmarco-v2是基于mMARCO双语数据集进行微调的多语言miniLM模型。这个双语数据集版本由原始的MS MARCO数据集(英语版)和葡萄牙语翻译版组成。v2版本中,葡萄牙语数据集使用Google翻译进行了翻译。有关数据集或翻译方法的更多信息,请参阅我们的 mMARCO: A Multilingual Version of MS MARCO Passage Ranking Dataset 和 mMARCO 仓库。
from transformers import AutoTokenizer, AutoModel model_name = 'unicamp-dl/mMiniLM-L6-v2-en-pt-msmarco-v2' tokenizer = AutoTokenizer.from_pretrained(model_name) model = AutoModel.from_pretrained(model_name)
如果您使用mMiniLM-L6-v2-en-pt-msmarco-v2,请引用:
@misc{bonifacio2021mmarco, title={mMARCO: A Multilingual Version of MS MARCO Passage Ranking Dataset}, author={Luiz Henrique Bonifacio and Vitor Jeronymo and Hugo Queiroz Abonizio and Israel Campiotti and Marzieh Fadaee and Roberto Lotufo and Rodrigo Nogueira}, year={2021}, eprint={2108.13897}, archivePrefix={arXiv}, primaryClass={cs.CL}
}