mola-68m / DATA.md
codavidgarcia's picture
Mola release: mola-68m
186ea43 verified
|
Raw History Blame Contribute Delete
24.8 kB

Training data

Mola 68M and Mola 150M are fine-tunes of cross-encoder/ettin-reranker-68m-v1 and cross-encoder/ettin-reranker-150m-v1 (Apache-2.0), which were trained from jhu-clsp/ettin-encoder-68m and jhu-clsp/ettin-encoder-150m (MIT).

The fine-tuning data are public datasets converted to typed decisions, including the collections below, the train splits of several benchmarks of the Decision Index suite, other public datasets of the same task forms, and items generated with the public CLadder generator. Some sources are under non-commercial or research-only terms; the weights are released for non-commercial use only. No suite file was trained on, but at least 86 training rows (exact or normalised-text matches) restate public test items of the suite through items their upstream sources share with it (for example SuperGLUE AX-g sentences reused by BIG-Bench Hard, and train/test duplicates in SWAG/HellaSwag, ARC, BANKING77 and CLINC150).

Collections: tasksource (Sileo, 2024), tasksource/tasksource-jev-typed-decisions @ 3ae18564; Bekko by hotchpotch (its card states that each subset follows the licence of its original dataset), hotchpotch/bekko-system-one-dataset-v0 @ 9c673a09; Open-Jev (CC0-1.0 for its generated records; part of its customer-control subset quotes short descriptions without a verified licence; third-party notices), ZefanCai/Open-Jev @ c67699e1; Decision Index kit instruction and criteria templates, MIT, © 2026 Apolinário Passos.

Attribution

The table lists the sources under attribution licences (CC BY family, ODC-By) or with share-alike, copyleft, non-commercial or custom terms; permissive sources (MIT, Apache-2.0, BSD) are not listed. Creators, title and copyright notice are those given on the linked pages; where a linked page's licence differs from the upstream one, the Licence column gives the upstream one.

Changes made to all of this material: rows were sampled, converted into decision rows (state, question, options, target distribution), truncated to fit the model's context and filtered; labels were mapped to target distributions; some questions were paraphrased. The models are trained on the converted rows; no training row is redistributed. No creator listed here endorses these models. The material is provided by its creators as-is, without warranties.

Source Creators Licence
alisawuffles/WANLI Liu et al. (2022) CC BY 4.0
allenai/ai2_arc Clark et al. (2018), Allen Institute for AI CC BY-SA 4.0
allenai/cosmos_qa see card CC BY 4.0
allenai/qasc see card CC BY 4.0
allenai/qasper see card CC BY 4.0
allenai/quartz see card CC BY 4.0
allenai/ropes see card CC BY 4.0
allenai/social_i_qa see card CC BY 4.0
allenai/wildguardmix see card ODC-By licence; access gate requires agreeing to research-only use (AI2 Responsible Use Guidelines)
allenai/winogrande Sakaguchi et al. (2019), Allen Institute for AI CC BY (2.0 per the release README); code Apache-2.0
AmazonScience/massive see card CC BY 4.0
amydeng2000/CREAK see card CC BY-SA 4.0 per tasksource metadata; the repository shows MIT (treated as CC BY-SA 4.0)
aps/dynahate see card GPL
aps/super_glue Wang et al. (2019) and the authors of each SuperGLUE task (BoolQ: Clark et al. 2019) per task: BoolQ CC BY-SA 3.0, WiC CC BY-NC 4.0
bitext/Bitext-customer-support-llm-chatbot-training-dataset see card CDLA-Sharing-1.0
Brand24/mms see card CC BY-NC 4.0
cambridgeltl/xcopa see card CC BY 4.0
cardiffnlp/tweet_eval Barbieri et al. (2020); sentiment subset: Rosenthal, Farra and Nakov (2017) Twitter ToS (+ per-subset terms)
cardiffnlp/tweet_sentiment_multilingual Barbieri, Espinosa-Anke and Camacho-Collados (2022) CC BY 3.0
castorini/mr-tydi see card Apache-2.0; Wikipedia text: CC BY-SA / GFDL
clinc/clinc_oos Larson et al. (2019), Clinc Inc. CC BY 3.0
github.com/clinc/oos-eval Larson et al. (2019), Clinc Inc. CC BY 3.0
CLUTRR/v1 see card CC BY-NC 4.0
coastalcph/lex_glue see card CC BY 4.0 (SCOTUS task: plus custom terms)
community-datasets/offenseval_dravidian see card CC BY 4.0
community-datasets/proto_qa see card CC BY 4.0
copenlu/scientific-exaggeration-detection see card GPL-3.0
declare-lab/cicero see card MIT (card); dialogues from DailyDialog (CC BY-NC-SA 4.0) and DREAM (non-commercial research)
demo-org/auditor_review see card proprietary card / CC BY-NC-SA 3.0 origin
DFKI-SLT/few-nerd see card CC BY-SA 4.0
dravidianlangtech/hope_edi see card CC BY 4.0
dvilares/head_qa see card MIT + ministry reuse conditions
dynabench/dynasent see card CC BY 4.0
Dzeniks/hover HoVer: Jiang et al. (2020) CC BY-SA 4.0 (mirror card says MIT)
eusip/silicone see card CC BY-NC-SA 4.0 (card body) vs CC BY-SA 4.0 (YAML)
facebook/xnli see card CC BY-NC 4.0
fancyzhx/ag_news see card AG's corpus terms: research and non-commercial use
fancyzhx/dbpedia_14 Zhang, Zhao and LeCun (2015); DBpedia CC BY-SA 3.0
FastFit/hwu_64 see card CC BY 4.0
GBaker/MedQA-USMLE-4-options-hf see card CC BY-SA 4.0
google-research-datasets/circa see card CC BY 4.0
github.com/google-research-datasets/dstc8-schema-guided-dialogue Rastogi et al. (2020) CC BY-SA 4.0
google-research-datasets/google_wellformed_query see card CC BY-SA 4.0
google-research-datasets/natural_questions Kwiatkowski et al. (2019) CC BY-SA 3.0
google-research-datasets/paws see card Google custom license; Wikipedia text: CC BY-SA / GFDL
google-research-datasets/poem_sentiment see card CC BY 4.0
github.com/google-research-datasets/Taskmaster see card CC BY 4.0
google/boolq Clark et al. (2019) CC BY-SA 3.0
google/code_x_glue_cc_defect_detection see card C-UDA
HannahRoseKirk/HatemojiBuild see card CC BY 4.0
hotchpotch/fineweb-ir-simulated-search-queries see card ODC-By 1.0 (database); source-page rights vary
hotchpotch/wikipedia-english-ir-simulated-search-queries see card CC BY-SA 4.0 / GFDL
hotpotqa/hotpot_qa Yang et al. (2018) CC BY-SA 4.0
github.com/hover-nlp/hover Jiang et al. (2020) CC BY-SA 4.0 (HoVer; evidence: English Wikipedia)
HuggingFaceFW/fineweb-edu see card ODC-By 1.0 (database); source-page rights vary
ibm-research/argument_quality_ranking_30k Gretz et al. (2020), IBM Research CC BY-SA 3.0 (IBM card); Bekko lists CC BY 3.0
indonlp/NusaX-senti see card CC BY-SA 4.0
jaredfern/codah see card ODC-By
joey234/nan-nli see card CC BY-SA 4.0
juletxara/xstory_cloze see card CC BY-SA 4.0
klue/klue see card CC BY-SA 4.0
launch/open_question_type see card CC BY 4.0 + custom
leondz/wnut_17 see card CC BY 4.0
malmaud/onestop_qa see card CC BY-SA 4.0
masakhane/masakhanews see card CC 4.0 Non-Commercial (card body) vs AFL-3.0 (YAML)
mhardalov/exams see card CC BY-SA 4.0
miracl/miracl see card Apache-2.0; Wikipedia text: CC BY-SA / GFDL
MoritzLaurer/dataset_train_nli see card mixture of classification datasets recast as NLI; its components include CC BY-NC 4.0, CC BY-NC-SA 3.0 and custom non-commercial sets
MoritzLaurer/multilingual-NLI-26lang-2mil7 see card machine-translated mixture of MNLI, FEVER-NLI, ANLI (CC BY-NC 4.0), LingNLI and WANLI
mteb/amazon_counterfactual see card CC BY-NC 4.0 (source repository LICENSE); mteb mirror card says CC BY 4.0
multilingual-discourse-hub/disrpt see card per corpus: PCC CC BY-NC-SA 4.0, PRSTC CC BY-NC, ANNODIS CC BY-NC-SA 3.0, RRT CC BY-NC-SA 4.0 (hub card: Apache-2.0)
mwong/fever-evidence-related FEVER: Thorne et al. (2018) CC BY-SA 3.0 + GPL-3.0 + CC BY-SA 4.0
nala-cub/americas_nli see card CC BY-SA 4.0
nikhilweee/sharc_modified ShARC: Saeidi et al. (2018) CC BY-SA 3.0 (ShARC; not independently verified)
nvidia/Aegis-AI-Content-Safety-Dataset-2.0 see card CC BY 4.0
nvidia/CantTalkAboutThis-Topic-Control-Dataset see card CC BY 4.0
nvidia/HelpSteer see card CC BY 4.0
nvidia/HelpSteer2 see card CC BY 4.0
nvidia/HelpSteer3 see card CC BY 4.0
nyu-mll/blimp see card CC BY 4.0
nyu-mll/glue Wang et al. (2019) and the authors of each GLUE task per task: MNLI OANC + fiction CC BY-SA 3.0 / CC BY 3.0; QNLI (SQuAD passages) CC BY-SA 4.0
nyu-mll/multi_nli Williams, Nangia and Bowman (2018) OANC genres; fiction genre CC BY-SA 3.0 / CC BY 3.0 / public domain
odegiber/hate_speech18 de Gibert et al. (2018) CC BY-SA 3.0
pacovaldez/stackoverflow-questions Stack Overflow contributors (each post's author) CC BY-SA 3.0/4.0 (Stack Overflow posts); card says Apache-2.0
PierreColombo/miam see card CC BY-NC-SA 4.0 (card body) vs CC BY-SA 4.0 (YAML)
pietrolesci/breaking_nli see card CC BY-SA 4.0
pietrolesci/gen_debiased_nli see card CC BY-SA 4.0 + OANC
pietrolesci/nli_fever FEVER: Thorne et al. (2018); NLI version: Nie et al. (2019) FEVER claims CC BY-SA 3.0; nli_fever.zip distributed by the ANLI repository (CC BY-NC 4.0) with no licence of its own
pietrolesci/robust_nli see card CC BY-SA 4.0 + MIT + OANC
pkavumba/balanced-copa see card CC BY 4.0 + BSD-2-Clause
github.com/PolyAI-LDN/task-specific-datasets see card CC BY 4.0
PolyAI/banking77 Casanueva et al. (2020), PolyAI CC BY 4.0
PolyAI/minds14 see card CC BY 4.0
rajpurkar/squad Rajpurkar et al. (2016) CC BY-SA 4.0
rajpurkar/squad_v2 Rajpurkar, Jia and Liang (2018) CC BY-SA 4.0
Rowan/hellaswag see card MIT (card body); wikiHow contexts CC BY-NC-SA 3.0
rungalileo/ragbench Galileo (RAGBench); HotpotQA: Yang et al. (2018) CC BY 4.0 (components cuad CC BY 4.0, tatqa CC BY 4.0, hotpotqa CC BY-SA 4.0)
sadat2307/MSciNLI see card CC BY-SA 4.0
SemEvalWorkshop/emo see card MPL-2.0
sentence-transformers/agnews see card AG's corpus terms: research and non-commercial use (Bekko: Unknown)
sentence-transformers/all-nli see card SNLI: CC BY-SA 4.0; MultiNLI: CC BY 3.0 / CC BY-SA 3.0 / OANC / public domain
sentence-transformers/coco-captions see card CC BY 4.0 (captions)
sentence-transformers/natural-questions see card CC BY-SA 3.0
SetFit/ethos_binary see card GPL-3.0 (original ETHOS: AGPL-3.0 / GPL-3.0)
Shitao/bge-m3-data see card no collection licence; constituents: HotpotQA and SQuAD CC BY-SA 4.0, Natural Questions CC BY-SA 3.0, MIRACL and Mr. TyDi Apache-2.0 with Wikipedia text (CC BY-SA / GFDL)
shmuhammad/AfriSenti-twitter-sentiment see card CC BY 4.0
sihaochen/propsegment see card CC BY 4.0
sileod/pragmeval see card per task: EmoBank CC BY-SA 4.0, STAC CC BY-NC-SA 4.0, Switchboard GPL-2.0 (repository label)
sileod/probability_words_nli see card Apache-2.0 + CC BY-SA 4.0
github.com/stanfordnlp/contract-nli Koreeda and Manning (2021) CC BY 4.0 (a mirror's metadata says CC BY-NC-SA 4.0; the publisher's statement is CC BY 4.0)
stanfordnlp/SHP see card Reddit API ToS
stanfordnlp/snli Bowman et al. (2015) CC BY-SA 4.0
strombergnlp/rumoureval_2019 see card CC BY 4.0 + custom
strombergnlp/x-stance see card CC BY-NC 4.0 (data); MIT (code)
tals/vitaminc Schuster, Fisch and Barzilay (2021) CC BY-SA 3.0
tasksource/avicenna see card CC (version unstated)
tasksource/Boardgame-QA see card CC BY 4.0
tasksource/chaos-mnli-ambiguity see card CC BY-NC 4.0 (ChaosNLI release)
tasksource/commonsense_qa_2.0 see card CC BY 4.0
tasksource/dadc-limit-nli see card CC (version unstated)
tasksource/defeasible-nli see card Apache-2.0 / CC BY-SA 4.0
tasksource/doc-nli see card BSD (card); built partly from ANLI (CC BY-NC 4.0)
tasksource/folio see card CC (version unstated) + CC BY-SA 4.0
tasksource/goal-step-wikihow see card wikiHow article text: CC BY-NC-SA 3.0; tasksource card says MIT
tasksource/help-nli see card CC (version unstated) + CC BY-SA 4.0
tasksource/implicatures see card GPL
tasksource/it-support-tickets see card CC BY 4.0
tasksource/jigsaw_toxicity Jigsaw / Conversation AI; comment text: Wikipedia contributors CC0 (labels); CC BY-SA 3.0 (Wikipedia talk-page comment text); card says Apache-2.0
tasksource/mtop see card CC BY-SA 4.0
tasksource/nli-veridicality-transitivity see card CC (version unstated); built partly on SICK sentences (CC BY-NC-SA 3.0)
tasksource/patent-phrase-similarity see card CC BY 4.0
tasksource/PLANE-ood Bertolini et al. (2022) CC BY 2.0
tasksource/recast see card CC BY-SA 4.0
tasksource/resnli see card CC BY 4.0
tasksource/ScienceQA_text_only see card CC BY-NC-SA 4.0
tasksource/scinli see card Apache-2.0 + CC BY-SA 4.0
tasksource/SDOH-NLI see card CC BY 4.0
tasksource/seahorse_summarization_evaluation see card CC (version unstated)
tasksource/sherliic see card CC BY 4.0
tasksource/tomi-nli see card GPL-3.0
tasksource/TroFi see card GPL + custom
tasksource/universal-joy see card GPL
tasksource/wice see card CC BY-SA 4.0
tasksource/winodict see card CC BY 4.0
tweets-hate-speech-detection/tweets_hate_speech_detection see card GPL-3.0
ucberkeley-dlab/measuring-hate-speech see card CC BY 4.0
ucirvine/sms_spam see card CC BY 4.0
universal-dependencies/universal_dependencies see card CC BY-SA 4.0
webis/args_me see card CC BY 4.0
webis/Touche23-ValueEval see card CC BY 4.0
zapsdcn/hyperpartisan_news see card CC BY 4.0
zefang-liu/phishing-email-dataset see card LGPL-3.0

Licence texts: CC BY 2.0, CC BY 3.0, CC BY 4.0, CC BY-SA 3.0, CC BY-SA 4.0, CC BY-NC 4.0, CC BY-NC-SA 3.0, CC BY-NC-SA 4.0, ODC-By 1.0, GPL-2.0, GPL-3.0, AGPL-3.0, LGPL-3.0, MPL-2.0, GFDL, CDLA-Sharing-1.0, AFL-3.0, BSD-2-Clause, C-UDA.