Models

224

Full-text search

Active filters: kto, trl

DatPySci/zephyr-7b-kto-iter0

Text Generation • 7B • Updated Apr 9, 2024 • 5

eperim/mistral-QLORA-KTO

Updated Mar 23, 2024 • 13

lewtun/kto-aligned-model-lora

Updated Mar 27, 2024

Weni/WeniGPT-QA-Zephyr-7B-4.0.1-KTO

Updated Mar 29, 2024 • 1

Weni/WeniGPT-Agents-Zephyr-1.0.22-KTO

Updated Apr 9, 2024 • 1

Weni/WeniGPT-Agents-Zephyr-1.0.23-KTO

Updated Apr 9, 2024 • 8

DatPySci/zephyr-7b-kto-iter0-des133

Text Generation • 7B • Updated Apr 11, 2024 • 2

superemohot/llama3-8b_cp-p1_tv-llama3-emb_ft-b8.3patch1e1_spin-kto-b8.3p3b1-nft

Text Generation • 8B • Updated May 2, 2024 • 2

superemohot/llama3-8b_cp-p1_tv-llama3-emb_spin-kto-b8.3p3b1

Text Generation • 8B • Updated May 2, 2024

NBA55/Experiment_with_trained_model_Final_KTO_for_all_3_issues-epoch-2

Updated May 12, 2024

stojchet/kto-python-6k-bad-ds

Updated Jun 16, 2024 • 1

sfulay/kto-aligned-model-lora

Updated Jun 17, 2024 • 2

stojchet/test_kto

Updated Jul 5, 2024 • 1

stojchet/big_kto1

Updated Jul 9, 2024 • 1

stojchet/lr_kto1

Updated Jul 9, 2024

stojchet/lr_kto2

Updated Jul 9, 2024

stojchet/kto1

Text Generation • 1B • Updated Mar 24, 2025 • 3

stojchet/w_kto1

Updated Jul 9, 2024

asmith26/kto_model

Text Generation • 4B • Updated Jul 6, 2024 • 2

stojchet/kto2

Text Generation • 1B • Updated Mar 17, 2025 • 3

stojchet/kto_test

Text Generation • 1B • Updated Mar 17, 2025 • 2

stojchet/py_base1_kto1

Updated Jul 12, 2024 • 1

stojchet/py_base1_kto1_no_ref

Updated Jul 12, 2024 • 1

stojchet/kto5k1

Text Generation • 1B • Updated Jul 14, 2024 • 8

stojchet/kto5k2

Text Generation • 1B • Updated Jul 14, 2024

stojchet/kto5k3

Text Generation • 1B • Updated Jul 14, 2024

stojchet/kto5k4

Text Generation • 1B • Updated Jul 14, 2024

stojchet/kto10k1

Text Generation • 1B • Updated Jul 14, 2024 • 4

stojchet/kto10k2

Text Generation • 1B • Updated Jul 14, 2024 • 1

stojchet/nkto1

Text Generation • 1B • Updated Jul 16, 2024 • 1