Publications

Context-Aware Toxicity Detection in Game Chat: Domain-Adaptive Pretraining with Match Metadata under Limited Labels

A. Schurger-Foy; R. Kocielnik; Ç. Gülçehre; R. M. Alvarez 

Games: Research and Practice

2026

DOI : 10.1145/3831696

Sequence Modeling Architectures: Foundations [Special Issue on the Mathematics of Deep Learning]

F. Sarnthein; A. Afzal; R. Pascanu; A. Orvieto; C. Gulcehre et al. 

IEEE Signal Processing Magazine

2026

Vol. 43 , num. 3, p. 115 – 129.

DOI : 10.1109/msp.2026.3682808

One-Step is Enough: Sparse Autoencoders for Text-to-Image Diffusion Models

V. Surkov; C. Wendler; A. Mari; M. Terekhov; J. Deschenaux et al. 

Advances in Neural Information Processing Systems 38

2025

39th Conference on Neural Information Processing Systems, San Diego, USA, 2025-12-02 – 2025-12-07.

p. 110795 – 110866

DOI : 10.52202/085713-3342

Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions

S. Matrenok; S. Moalla; C. Gulcehre 

Advances in Neural Information Processing Systems 38

2025

39th Conference on Neural Information Processing Systems, San Diego, USA, 2025-12-02 – 2025-12-07.

p. 113795 – 113852

DOI : 10.52202/085713-3434

RAT: Bridging RNN Efficiency and Attention Accuracy via Chunk-based Sequence Modeling

X. Wei; A. Yadav; R. Pascanu; C. Gulcehre 

Advances in Neural Information Processing Systems 38

2025

39th Conference on Neural Information Processing Systems, San Diego, USA, 2025-12-02 – 2025-12-07.

p. 39016 – 39043

DOI : 10.52202/085713-1165

Regret-Optimized Portfolio Enhancement through Deep Reinforcement Learning and Future Looking Rewards

D. Karzanov; R. Garzón; M. Terekhov; C. Gulcehre; T. Raffinot et al. 

ICAIF ’25: Proceedings of the 6th ACM International Conference on AI in Finance

2025

6th ACM International Conference on AI in Finance (ICAIF 2025), Singapore Singapore, 2025-11-15 – 2025-11-18.

p. 890 – 897

DOI : 10.1145/3768292.3770340

Algorithm Discovery With LLMs: Evolutionary Search Meets Reinforcement Learning

A. Surina; C. Gulcehre; E. Abbé; M. Viazovska; A. Seddas et al. 

2025

Second Conference on Language Modeling COLM 2025, Montreal, Canada, 2025-10-07.

Beyond Autoregression: Fast LLMs via Self-Distillation Through Time

J. S. Deschenaux; C. Gulcehre 

Proceedings of the Thirteenth International Conference on Learning Representations (ICLR) 2025 [Forthcoming publication]

2025

13th International Conference on Learning Representations (ICLR 2025), Singapore, 2025-04-24 – 2025-04-28.

Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers

X. Wei; S. Moalla; R. Pascanu; C. Gulcehre 

Advances in Neural Information Processing Systems 37 (NeurIPS 2024)

2024

38th Annual Conference on Neural Information Processing Systems, Vancouver Convention Center, 2024-12-10 – 2024-12-15.

No Representation, No Trust: Connecting Representation, Collapse, and Trust Issues in PPO

S. Moalla; R. Pascanu; A. S. A. Miele; D. Pyatko; C. Gulcehre 

Advances in Neural Information Processing Systems 37 (NeurIPS 2024)

2024

38th Annual Conference on Neural Information Processing Systems, Vancouver Convention Center, 2024-12-10 – 2024-12-15.

Self-Recognition in Language Models

T. R. Davidson; V. Surkov; V. Veselovskyy; G. Russo; R. West et al. 

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing

2024

Conference on Empirical Methods in Natural Language Processing (EMNLP 2024), Miami, Florida, USA, 2024-11-12 – 2024-11-16.

p. 12032 – 12059

Simple Hierarchical Planning with Diffusion

C. Chen; D. Fei; K. Kenji; C. Gulcehre; A. Sungjin 

2024

12th International Conference on Learning Representations (ICLR 2024), Vienna, Austria, 2024-05-07 – 2024-05-11.

Imagine the Unseen World: A Benchmark for Systematic Generalization in Visual World Models

Y. Kim; G. Singh; J. Park; C. Gulcehre; S. Ahn 

37th Conference on Neural Information Processing Systems (NeurIPS 2023) Track on Datasets and Benchmarks

2023

37th Conference on Neural Information Processing Systems (NeurIPS 2023), New Orleans, Louisiana, USA, 2023-12-10 – 2023-12-16.

DOI : 10.48550/arXiv.2311.09064