Chatbot Arena Leaderboard Week 8: Introducing MT-Bench and Vicuna-33B | LMSYS Org

­ Welcome to try the Chatbot Arena voting demo. Keep in mind that each benchmark has its limitations. Please consider the results as guiding references. See our discussion below for more technical details. Evaluating Chatbots with MT-bench and Arena Motivation While several benchmarks exist for evaluating Large Language Model's (LLM) performance, such as MMLU, HellaSwag, and HumanEval, we noticed

[stealthinu]

Vicuna-33BがだいぶGPT-3.5に迫りつつある。軽量化手法が進んだ今なら33Bだと3090x2くらいあれば動かせるのかな？3.5レベルの性能あるとやれることだいぶ違う。