Rayan Harfouche (2022)

Internship project topic: Scalable and Universal Second Order Methods for Convex Optimization

Research Interests

  • Statistical Physics  
  • Optimization
  • Information theory

Biography

I have done a Bachelor in Physics and currently I am a Master student in Applied Physics at EPFL. Physics deals with all kinds of phenomena, but I am particularly interested in how it appears in complex systems, such as a large number of interacting particles or a large data set. These systems, although sometimes governed by simple laws, can result in complicated behaviours that are universal and can be generalized to other systems. This is what statistical physics allows us to study.

On the Convergence of Encoder-only Shallow Transformers

Y. Wu; F. Liu; G. Chrysos; V. Cevher 

2023. 37th Annual Conference on Neural Information Processing Systems, New Orleans, USA, December 10-16. 2023.

Detailed record

Full text

Extrapolation and Spectral Bias of Neural Nets with Hadamard Product: a Polynomial Net Study

Y. Wu; Z. Zhu; F. Liu; G. Chrysos; V. Cevher 

2022. 36th Conference on Neural Information Processing Systems (NeurIPS), New Orleans, USA, November 28 – December 3, 2022.

Detailed record

Full text

Contact