Call for Papers
We invite researchers working on either evaluating model behavior, internals, or both, to submit their work addressing (but not limited to) the following key questions:
- How can we jointly evaluate model behavior and internals?
- How do model interventions influence behavior, internals, and their interplay?
- How can we disentangle the influence of internal dynamics from external behavior?
- How do behavioral and internal evaluations align? Where and why do they differ?
- How do model size, architecture, and pre-training data influence the link between internals and behavior?
We are looking for reviewers, please register here.
Submission Format
Our workshop accepts archival (OpenReview) and non-archival (published or unpublished) submissions for three distinct tracks:
1) Main Track
- Empirical, methodological, or theoretical contributions
- Short papers: up to 4 pages (excl. references and appendices)
- Long papers: up to 9 pages (excl. references and appendices)
2) Flash Track
- Early ideas or preliminary results
- Up to 4 pages (excl. references and appendices)
3) Lessons Learned Track
- Insights from negative or inconclusive experiments
- Up to 4 pages (excl. references and appendices)
We also invite researchers to present related and previously published work at this workshop. If you are interested, email us.
Presentation Format
Submissions of all tracks will be presented as posters at the workshop. We will also invite selected submissions for a short talk (5-15 minutes). Please note: At least one author must attend the workshop in person for talks.
Reviewing Process & Timeline
Submissions will be managed via OpenReview (link to appear). All deadlines are anywhere on Earth (AoE).
June 23 - Submission due
July 24 - Acceptance notification
Style Files and Templates
Please prepare your paper using the official COLM ‘25 template.
Guides and Policies
All submissions must follow the COLM ‘25 guidelines and policies.