Workshop on the linguistic and cultural evaluation of LLMs

The European Commission, in collaboration with the ALT-EDIC and the European Language Data Space, is hosting a virtual workshop on December 11, 2024, focused on the Linguistic and Cultural Evaluation of Large Language Models (LLMs). The event will start at 9:00 AM and offer a unique opportunity for professionals, researchers, and AI practitioners to engage with experts in language technology and cultural evaluation.

During the workshop, host and participants will share experiences and insights on:

  • exploring cross-language and cross-cultural evaluations and benchmarks across Europe
  • identifying, creating and collecting language- and culture-specific LLM benchmarks within each Member State
  • categorising LLM evaluation data
  • developing a transparent LLM evaluation process
  • establishing common guidelines for LLM evaluation

Interested participants can register online and access further details about the event through the European Commission’s Language Data Space website.