Skip to content
Logo EPFL, École polytechnique fédérale de Lausanne
  • About
  • Education
  • Research
  • Innovation
  • Schools
  • Campus
Show / hide the search form
Hide the search form
  • EN
  2. STI IEM Data and network sciences Imaging and vision Learning and decision systems Artificial Intelligence (AI) Machine Learning (ML) Algorithms & theoretical computer science Optimization Signal & image processing Data science
  4. Laboratories list
    • About
    • Education
    • Research
    • Innovation
    • Schools
    • Campus
    • Laboratories list
  5. Lions
  6. Courses
    • People
    • Publications
    • Research
    • Courses
    • Student projects
    • Tutorials
    • Open positions
  7. Current Courses
    • Current Courses
    • Past courses
  8. EE-628 Training Large Language Models
    • EE-556 Mathematics of Data: From Theory to Computation
    • EE-568 Reinforcement Learning
    • EE-628 Training Large Language Models
    • EE-735 Online learning in games
  9. EE-628- Slides 2025
  • About
  • Education
  • Research
  • Innovation
  • Schools
  • Campus

In the same section

  • EE-628- Slides 2025

EE-628- Slides 2025

Outline

The 2025 course consists of the following topics:
 

Lecture 1 – Architectures

Lecture 2 – Optimization and Hyperparameter Transfer

Lecture 3 – Data Mixtures

Lecture 4 – Fine Tuning

Lecture 5 – Alignment

 

  • Who we are
  • Associated Campuses
  • Data
  • Presidency
  • Vice Presidencies
  • Working at EPFL
  • Recruiting EPFL Talents
  • News & Media
  • Sustainability
  • Equality & Diversity
  • Respect
  • Philanthropy
  • EPFL Alumni
  • Admission
  • Academic Calendar
  • Preparatory Year (CMS)
  • Bachelor
  • Master
  • Doctorate
  • Continuing Education - Extension School
  • Study Management
  • International
  • Teaching
  • Educational Initiatives
  • Education & Science Outreach
  • Infrastructures Under Development
  • Engaging with Society
  • Mission and Policy
  • Research Domains
  • EPFL Research Facilities
  • Faculty Members
  • Solutions 5 Sustainability - S4S
  • Awards and Prizes
  • Funding Opportunities
  • Research Management Support
  • From Lab to Market
  • Research Ethics
  • Research with Animals
  • Open Science
  • Industry Collaboration
  • Innovation Initiatives
  • Startup Launchpad
  • Services & Resources
  • Library
  • Restaurants, Shops & Hotels
  • Security, Prevention & Health
  • Sports
  • Community & Support
  • Chaplaincy
  • Events
  • Arts & Culture
  • Associations
  • Visit EPFL
  • Mobility & Travel
  • School of Architecture, Civil & Environmental Engineering ENAC
  • School of Basic Sciences SB
  • School of Engineering STI
  • School of Computer & Communication Sciences IC
  • School of Life Sciences SV
  • College of Management of Technology CDM
  • College of Humanities CDH

Practical

Services & Resources Emergencies: +41 21 693 3000 Contact Map

Follow EPFL on social media

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on Mastodon
  • Follow us on X
  • Follow us on Youtube
Accessibility Disclaimer Privacy policy

© 2025 EPFL, all rights reserved