数据集:

flax-sentence-embeddings/stackexchange_title_body_jsonl

英文

jsonl.gz 格式,来源于 https://huggingface.co/datasets/flax-sentence-embeddings/stackexchange_xml

每行包含一个字典的格式:{"text": ["标题", "正文"], "tags": ["标签1", "标签2"]}

以下参数用于过滤:min_title_len = 20 min_body_len = 20 max_body_len = 4096 min_score = 0

如果一个 Stack Exchange 包含少于 10k 个问题(过滤后),则写入到 small_stackexchanges.jsonl.gz 文件中。

这是从 https://archive.org/details/stackexchange 下载的文件转储,于 2021-07-01 通过 torrent 下载。

发布日期 2021-06-07 使用署名-相同方式共享 4.0 国际创作共用许可证(by sa)

请参阅许可信息: https://archive.org/details/stackexchange

文件的示例(行)数:

stackoverflow.com-Posts.jsonl.gz: 18,562,443 math.stackexchange.com.jsonl.gz: 1,338,443 small_stackexchanges.jsonl.gz: 448,146 superuser.com.jsonl.gz: 435,463 askubuntu.com.jsonl.gz: 347,925 serverfault.com.jsonl.gz: 270,904 tex.stackexchange.com.jsonl.gz: 202,954 unix.stackexchange.com.jsonl.gz: 185,997 stats.stackexchange.com.jsonl.gz: 173,466 physics.stackexchange.com.jsonl.gz: 173,307 electronics.stackexchange.com.jsonl.gz: 143,582 gis.stackexchange.com.jsonl.gz: 131,000 mathoverflow.net.jsonl.gz: 120,851 apple.stackexchange.com.jsonl.gz: 110,622 english.stackexchange.com.jsonl.gz: 109,522 salesforce.stackexchange.com.jsonl.gz: 105,260 wordpress.stackexchange.com.jsonl.gz: 100,474 magento.stackexchange.com.jsonl.gz: 99991 sharepoint.stackexchange.com.jsonl.gz: 94011 gaming.stackexchange.com.jsonl.gz: 88912 meta.stackexchange.com.jsonl.gz: 83510 ell.stackexchange.com.jsonl.gz: 83271 dba.stackexchange.com.jsonl.gz: 81871 blender.stackexchange.com.jsonl.gz: 80766 drupal.stackexchange.com.jsonl.gz: 79717 mathematica.stackexchange.com.jsonl.gz: 73131 scifi.stackexchange.com.jsonl.gz: 61528 diy.stackexchange.com.jsonl.gz: 60083 security.stackexchange.com.jsonl.gz: 58000 softwareengineering.stackexchange.com.jsonl.gz: 53942 android.stackexchange.com.jsonl.gz: 51608 gamedev.stackexchange.com.jsonl.gz: 46485 codereview.stackexchange.com.jsonl.gz: 45765 rpg.stackexchange.com.jsonl.gz: 42303 travel.stackexchange.com.jsonl.gz: 41227 cs.stackexchange.com.jsonl.gz: 38314 meta.stackoverflow.com.jsonl.gz: 36456 webmasters.stackexchange.com.jsonl.gz: 34559 chemistry.stackexchange.com.jsonl.gz: 34506 academia.stackexchange.com.jsonl.gz: 34331 ethereum.stackexchange.com.jsonl.gz: 32760 judaism.stackexchange.com.jsonl.gz: 32028 money.stackexchange.com.jsonl.gz: 32021 raspberrypi.stackexchange.com.jsonl.gz: 30625 graphicdesign.stackexchange.com.jsonl.gz: 30233 webapps.stackexchange.com.jsonl.gz: 29697 ux.stackexchange.com.jsonl.gz: 29403 datascience.stackexchange.com.jsonl.gz: 27397 worldbuilding.stackexchange.com.jsonl.gz: 26763 bitcoin.stackexchange.com.jsonl.gz: 25374 biology.stackexchange.com.jsonl.gz: 24447 workplace.stackexchange.com.jsonl.gz: 24189 photo.stackexchange.com.jsonl.gz: 23753 cooking.stackexchange.com.jsonl.gz: 23705 crypto.stackexchange.com.jsonl.gz: 23231 mechanics.stackexchange.com.jsonl.gz: 22868 japanese.stackexchange.com.jsonl.gz: 22056 dsp.stackexchange.com.jsonl.gz: 21252 emacs.stackexchange.com.jsonl.gz: 21055 music.stackexchange.com.jsonl.gz: 20636 movies.stackexchange.com.jsonl.gz: 20181 softwarerecs.stackexchange.com.jsonl.gz: 20142 aviation.stackexchange.com.jsonl.gz: 20139 arduino.stackexchange.com.jsonl.gz: 19553 law.stackexchange.com.jsonl.gz: 17941 puzzling.stackexchange.com.jsonl.gz: 17851 quant.stackexchange.com.jsonl.gz: 17261 rus.stackexchange.com.jsonl.gz: 16871 bicycles.stackexchange.com.jsonl.gz: 16353 space.stackexchange.com.jsonl.gz: 15142 gardening.stackexchange.com.jsonl.gz: 15136 philosophy.stackexchange.com.jsonl.gz: 14829 german.stackexchange.com.jsonl.gz: 13950 networkengineering.stackexchange.com.jsonl.gz: 13454 hinduism.stackexchange.com.jsonl.gz: 13450 craftcms.stackexchange.com.jsonl.gz: 12574 civicrm.stackexchange.com.jsonl.gz: 12543 boardgames.stackexchange.com.jsonl.gz: 12149 christianity.stackexchange.com.jsonl.gz: 12108 history.stackexchange.com.jsonl.gz: 12021 politics.stackexchange.com.jsonl.gz: 11894 expressionengine.stackexchange.com.jsonl.gz: 11866 islam.stackexchange.com.jsonl.gz: 11853 anime.stackexchange.com.jsonl.gz: 11444 economics.stackexchange.com.jsonl.gz: 11115 french.stackexchange.com.jsonl.gz: 10794 engineering.stackexchange.com.jsonl.gz: 10753 cstheory.stackexchange.com.jsonl.gz: 10642 vi.stackexchange.com.jsonl.gz: 10551 astronomy.stackexchange.com.jsonl.gz: 10462 writers.stackexchange.com.jsonl.gz: 10157 skeptics.stackexchange.com.jsonl.gz: 10009 总计:25,333,327