Skip to content

CSVs of the Huggingface and LMSYS LLM leaderboards, along with the code to generate them in R.

License

Notifications You must be signed in to change notification settings

fboulnois/llm-leaderboard-csv

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

75 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LLM Leaderboard CSVs

Generate CSVs of the Huggingface Open LLM Leaderboard (v1 and v2), the LMSYS Chatbot Arena Leaderboard, and the merged leaderboard in R.

The latest CSVs can be downloaded from the Releases page.

Run

Tip

Delete the csv directory before running the code if you want to recreate the CSVs using the latest data.

Run using R or RStudio

The code is in huggingface.R:

# install the required dependencies
install.packages(c("data.table", "rvest", "stringr", "jsonlite"))

# run the code to generate the leaderboard data.tables
source("huggingface.R")

Run using Docker

A Dockerfile is also provided to build and run the code using the official r-base Docker image:

docker build . --tag llm-leaderboard-csv
docker run -v ./csv:/home/docker/csv --rm llm-leaderboard-csv