MTEB Benchmark数据集卡

数据集简介

MTEB是一个由不同任务构建的异构基准测试集：

• BitextMining: BUCC , Tatoeba
• Classification: AmazonCounterfactualClassification , AmazonPolarityClassification , AmazonReviewsClassification , Banking77Classification , EmotionClassification , ImdbClassification , MassiveIntentClassification , MassiveScenarioClassification , MTOPDomainClassification , MTOPIntentClassification , ToxicConversationsClassification , TweetSentimentExtractionClassification
• Clustering: ArxivClusteringP2P , ArxivClusteringS2S , BiorxivClusteringP2P , BiorxivClusteringS2S , MedrxivClusteringP2P , MedrxivClusteringS2S , RedditClustering , RedditClusteringP2P , StackExchangeClustering , StackExchangeClusteringP2P , TwentyNewsgroupsClustering
• Pair Classification: SprintDuplicateQuestions , TwitterSemEval2015 , TwitterURLCorpus
• Reranking: AskUbuntuDupQuestions , MindSmallReranking , SciDocs , StackOverflowDupQuestions
• Retrieval: ArguAna , ClimateFEVER , CQADupstackRetrieval , DBPedia , FEVER , FiQA2018 , HotpotQA , MSMARCO , MSMARCOv2 , NFCorpus , NQ , QuoraRetrieval , SCIDOCS , SciFact , Touche2020 , TRECCOVID
• STS: BIOSSES , SICK-R , STS12 , STS13 , STS14 , STS15 , STS16 , STS17 , STS22 , STSBenchmark
• Summarization: SummEval

所有这些数据集都经过预处理，可用于您的实验。