doctorpangloss 4 minutes ago Pokémon Showdown isn't a game so much as it is competitive Wiki reading.
pgn 15 minutes ago what was the selection for the teams? random per round? how does it play against people in ladder?
deadbabe 33 minutes ago Jev will give better results on this kind of thing. nico 11 minutes ago For sure are many better models for this use case[0]At the same time, it’s interesting seeing how generally capable language models/LLMs/agents/harnesses are gettingWe’ll probably see a lot more experiments and benchmarks like these in the near future0: simple classifiers can play quite a few game, including Doom https://playground.jeffyclassify.com/#doom
nico 11 minutes ago For sure are many better models for this use case[0]At the same time, it’s interesting seeing how generally capable language models/LLMs/agents/harnesses are gettingWe’ll probably see a lot more experiments and benchmarks like these in the near future0: simple classifiers can play quite a few game, including Doom https://playground.jeffyclassify.com/#doom
Pokémon Showdown isn't a game so much as it is competitive Wiki reading.
what was the selection for the teams? random per round? how does it play against people in ladder?
Jev will give better results on this kind of thing.
For sure are many better models for this use case[0]
At the same time, it’s interesting seeing how generally capable language models/LLMs/agents/harnesses are getting
We’ll probably see a lot more experiments and benchmarks like these in the near future
0: simple classifiers can play quite a few game, including Doom https://playground.jeffyclassify.com/#doom