This is a repreprocessed version of P3 with any updates that have been made to the P3 datasets since the release of the original P3. It is used for the finetuning of bloomz-p3 & mt0-xxl-p3 . The script is available here .