PPaperPicks

Atli Kosson

4 papers at tracked venues · 4 at CORE A* · active 20242024

Venues

Frequent coauthors

Papers

  1. Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training
    NeurIPS 2024 · Atli Kosson
  2. Ghost Noise for Regularizing Deep Neural Networks
    AAAI 2024 · Atli Kosson
  3. Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks
    ICML 2024 · Atli Kosson
  4. Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations