MHSafeEval: Role-Aware Interaction-Level Evaluation of Mental Health Safety in Large Language Models
Paper • 2604.17730 • Published • 3
AI & ML interests
None defined yet.
Papers
SEA-Guard: Culturally Grounded Multilingual Safeguard for Southeast Asia
SEA-SafeguardBench: Evaluating AI Safety in SEA Languages and Cultures
Suhyunlee
authored a
paper 5 months ago
mrpeerat
authored a
paper 7 months ago
mrpeerat
authored a
paper 8 months ago
mrpeerat
submitted a
paper to Daily Papers 8 months ago
eugenesiow
authored a
paper about 1 year ago
mrpeerat
authored 6
papers about 1 year ago
SEA-HELM: Southeast Asian Holistic Evaluation of Language Models
Paper • 2502.14301 • Published • 3
Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asia
Paper • 2503.07920 • Published • 103
SEA-LION: Southeast Asian Languages in One Network
Paper • 2504.05747 • Published • 1
Language Surgery in Multilingual Large Language Models
Paper • 2506.12450 • Published • 16
Mangosteen: An Open Thai Corpus for Language Model Pretraining
Paper • 2507.14664 • Published • 7
WangchanThaiInstruct: An instruction-following Dataset for Culture-Aware, Multitask, and Multi-domain Evaluation in Thai
Paper • 2508.15239 • Published
PumeTu
authored 2
papers about 1 year ago
eugenesiow
posted an update over 1 year ago
Post
2168
GPT-4.1 dropped this week - and it puts OpenAI back in the race for coding & agentic leadership.
⚙️ API only - no ChatGPT toggle for this.
💻 Coding performance is back on par with Claude 3.7 Sonnet & Gemini 2.5 Pro (though Gemini still leads).
💸 Pricing:
• Full: $3.50 / 1M tokens
• Mini: $0.70 / 1M
• Nano: $0.17 / 1M
👉 Gemini 2.5 Pro = best price/perf ($3.44 / 1M)
😵 Claude 3.5 Sonnet = $6 / 1M (!)
🧠 Not a "thinking" model.
📊 Mini shines on general reasoning tasks (e.g. GPQA), but only the full model holds up in SWE-bench-verified (GitHub issue solving).
⚙️ API only - no ChatGPT toggle for this.
💻 Coding performance is back on par with Claude 3.7 Sonnet & Gemini 2.5 Pro (though Gemini still leads).
💸 Pricing:
• Full: $3.50 / 1M tokens
• Mini: $0.70 / 1M
• Nano: $0.17 / 1M
👉 Gemini 2.5 Pro = best price/perf ($3.44 / 1M)
😵 Claude 3.5 Sonnet = $6 / 1M (!)
🧠 Not a "thinking" model.
📊 Mini shines on general reasoning tasks (e.g. GPQA), but only the full model holds up in SWE-bench-verified (GitHub issue solving).
RaymondAISG
authored a
paper almost 2 years ago
Jian-Gang
authored 3
papers almost 2 years ago
BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language Models
Paper • 2309.06085 • Published • 1
Kalahi: A handcrafted, grassroots cultural LLM evaluation suite for Filipino
Paper • 2409.15380 • Published
Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation
Paper • 2412.03304 • Published • 21
raileymontalan
authored a
paper almost 2 years ago
raileymontalan
updated a
dataset almost 2 years ago