Publications

Stabilizer-Code Channel Transforms Beyond Repetition Codes for Improved Hashing Bounds

T. Kann; M. R. Bloch; S. Kudekar; R. Urbanke 

Semi-empirical universal model of heat capacity based on the Laplace distribution Напівемпірична універсальна модель теплоємності на основі розподілу Лапласа

N. N. Yilmaz; P. A. Kozub; M. G. Revyakina; S. N. Kozub; G. V. Revyakin et al. 

Minimax Limits of k-Fold Cross-Validation via Majority

I. Nachum; R. Urbanke; T. Weinberger 

Which Algorithms Have Tight Generalization Bounds?

M. Gastpar; I. Nachum; J. Shafer; T. Weinberger 

Interpolation of Quantum Polar Codes and Quantum Reed-Muller Codes

K. Hidaka; D. Abdelhadi; R. Urbanke 

Efficient Machine Unlearning by Model Splitting and Core Sample Selection

M. Egger; R. Bitar; R. Urbanke 

A Vector-Based Algorithm for Generating Complete Balanced Reaction Sets with Arbitrary Numbers of Reagents

N. Yilmaz; P. Kozub; S. Kozub 

Vector-Based Approach to the Stoichiometric Analysis of Multicomponent Chemical Reactions: The Case of Black Powder

P. Kozub; N. Yilmaz; S. Kozub 

Reed-Muller Codes for Quantum Pauli and Multiple Access Channels

D. Abdelhadi; C. Sandon; E. Abbe; R. Urbanke 

Noisy Quantum Communication and Computation

Federated One-Shot Learning with Data Privacy and Objective-Hiding

M. Egger; R. Urbanke; R. Bitar 

Entanglement Sharing Across a Damping-Dephasing Channel

V. Siddhu; D. Abdelhadi; T. Jochym-O’Connor; J. A. Smolin 

Random matrix methods for high-dimensional machine learning models

Beyond worst-case analysis, with or without predictions

Symmetry in design and decoding of polar-like codes

On the Efficiency of Polar-Like Decoding for Symmetric Codes

K. Ivanov; R. L. Urbanke 

Polar Codes Do Not Have Many Affine Automorphisms

K. Ivanov; R. Urbanke 

Mutual information for low-rank even-order symmetric tensor estimation

C. Luneau; J. Barbier; N. Macris 

The Stability of Low-Density Parity-Check Codes and Some of its Consequences

W. Liu; R. Urbanke 

A Statistical Physics approach to a multi-channel Wigner spiked model

D. Alberici; F. Camilli; P. Contucci; E. Mingione 

High Signal-to-Noise Ratio Asymptotics of Entropy-Constrained Gaussian Channel Capacity

A. Girish; E. Telatar; S. Shamai Shitz 

On Perfect Functional Representations

S. E. Coban; Y. Y. Shkel; E. Telatar 

On the Suboptimality of Linear Codes for Binary Distributed Hypothesis Testing

A. Girish; R. D. H. Cung; E. Telatar 

Coded Acknowledgement with Random Subspaces

N. Kwan; R. Song; W. Yu 

Space Upper Bounds for α-Perfect Hashing

R. Song; E. Telatar 

𝐵-jet fragmentation with 𝐵± →𝐽/𝜓⁢𝐾± decays in √𝑠 =13  TeV 𝑝⁢𝑝 collisions at LHCb

R. Aaij; A. Abdelmotteleb; C. Abellan Beteta; F. Abudinén; T. Ackernley et al. 

Deuteron identification via time of flight with LHCb

R. Aaij; A. S. W. Abdelmotteleb; C. A. Beteta; F. Abudinén; T. Ackernley et al. 

On Entropy-Constrained Gaussian Channel Capacity via the Moment Problem

A. Girish; E. Telatar; S. S. Shitz 

Urolithin A provides cardioprotection and mitochondrial quality enhancement preclinically and improves human cardiovascular health biomarkers

S. Liu; J. Faitg; C. Tissot; D. Konstantopoulos; R. Laws et al. 

On entropy-constrained Gaussian channel capacity via the moment problem

A. Girish; S. Shamai; E. Telatar 

Attention with Markov: A Curious Case of Single-layer Transformers

A. V. Makkuva; M. Bondaschi; A. Girish; A. Nagle; M. Jaggi et al. 

Downlink Massive Random Access with Lossy Source Coding

R. Song; W. Yu 

How to Make Measure Theory Completely Pointless

Coded Downlink Massive Random Access and a Finite de Finetti Theorem

R. Song; K. M. Attiah; W. Yu 

Jacobian Descent for Multi-Objective Optimization

P. Quinton; V. Rey 

Local to global: Learning dynamics and effect of initialization for transformers

A. V. Makkuva; M. Bondaschi; C. Ekbote; A. Girish; A. Nagle et al. 

Fundamental Limits of Prompt Compression: A Rate- Distortion Framework for Black-Box Language Models

A. Girish; A. Nagle; M. Bondaschi; M. Gastpar; A. V. Makkuva et al. 

Causal Impact Analysis for Asynchronous Decision Making

M. Kayaalp; Y. Inan; V. Koivunen; A. Sayed 

How Deep Neural Networks Learn Compositional Data: The Random Hierarchy Model

F. Cagnetta; L. Petrini; U. M. Tomasini; A. Favero; M. Wyart 

On the Arithmetic and Geometric Fusion of Beliefs for Distributed Inference

M. Kayaalp; Y. Inan; E. Telatar; A. H. Sayed 

Four faces of information in natural systems

F. E. Rosas; P. A. M. Mediano; A. I. Luppi; A. B. Boyd; M. Berta et al. 

A Finite-Sample Strong Converse for Binary Hypothesis Testing via (Reverse) Rényi Divergence

R. Bruno; A. Vandenbroucque; A. R. Esposito 

Contraction of Rényi Divergences for Discrete Channels: Properties and Applications

A. Vandenbroucque; A. R. Esposito; M. Gastpar 

Model Non-Collapse: Minimax Bounds for Recursive Discrete Distribution Estimation

M. Kanabar; M. Gastpar 

Correlated phases in rhombohedral multilayer graphene

A. Herasymchuk; S. G. Sharapov; O. V. Yazyev; Y. Zhumagulov 

Universal Prediction in the Age of Large Language Models

zip2zip: Inference-Time Adaptive Tokenization via Online Compression

S. Geng; N. Ranchin; Y. Yao; M. Peyrard; C. Wendler et al. 

Which Algorithms Have Tight Generalization Bounds?

M. Gastpar; I. Nachum; J. Shafer; T. Weinberger 

What One Cannot, Two Can: Two-Layer Transformers Provably Represent Induction Heads on Any-Order Markov Chains

C. Ekbote; A. V. Makkuva; M. Bondaschi; N. Rajaraman; M. Gastpar et al. 

The Conditional Regret-Capacity Theorem for Batch Universal Prediction

M. Bondaschi; M. Gastpar 

Characterising high-order interdependence via entropic conjugation

F. E. Rosas; A. J. Gutknecht; P. A. Mediano; M. Gastpar 

Leveraging Sparsity for Sample-Efficient Preference Learning: A Theoretical Perspective

Y. Yao; L. He; M. Gastpar 

Model Non-Collapse: Minimax Bounds for Recursive Discrete Distribution Estimation

M. Kanabar; M. Gastpar 

Alpha-NML Universal Predictors

M. Bondaschi; M. Gastpar 

Attention with Markov: A Curious Case of Single-layer Transformers

A. V. Makkuva; M. Bondaschi; A. Girish; A. Nagle; M. Jaggi et al. 

Sibson α-Mutual Information and Its Variational Representations

A. R. Esposito; M. Gastpar; I. Issa 

Data Heterogeneity in Linear Distributed Estimation and Learning

Propagation of Orientation Across Lengthscales in Sheared Self-Assembling Hierarchical Suspensions via Rheo-PLI-SAXS

R. Ghanbari; A. Terry; S. Wojno; M. Bek; K. Sekar et al. 

Lower Bounds on the Bayesian Risk via Information Measures

A. R. Esposito; A. Vandenbroucque; M. C. Gastpar 

Local to global: Learning dynamics and effect of initialization for transformers

A. V. Makkuva; M. Bondaschi; C. Ekbote; A. Girish; A. Nagle et al. 

Comparing Langevin Dynamics and Stochastic Gradient Flow in the Weak Features Model

A. Remizova; N. Macris 

Denoising Score Matching with Random Features: Insights on Diffusion Models From Precise Learning Curves

A. J. George; R. Veiga; N. Macris 

The Cosmoverse White Paper: Addressing Observational Tensions in Cosmology with Systematics and Fundamental Physics

E. Di Valentino; J. Levi Said; A. Riess; A. Pollo; V. Poulin et al. 

Tighter lower bounds on teh conditional entropy for USD-Based QRNG

T. Brunet 

Entanglement Phase Transitions in 1D Topological Insulators

Z. Sahinel 

Rectangular rotational invariant estimator for high-rank matrix estimation

F. Pourkamali; N. Macris 

Analysis of Diffusion Models for Manifold Data

A. J. George; R. Veiga; N. Macris 

Noisy Quantum Communication and Computation

Tackling Hardness using Spin Glass Physics: from Inference to Sampling through Diffusions

Data Heterogeneity in Linear Distributed Estimation and Learning

Sampling in High-dimensions Using Stochastic Interpolants and Forward -backward Stochastic Differential Equations

A. J. George; N. Macris 

Search for high-mass exclusive diphoton production with tagged protons in proton-proton collisions at √s=13 TeV

A. Tumasyan; W. Adam; J. W. Andrejkovic; T. Bergauer; S. Chatterjee et al. 

Nonresonant central exclusive production of charged-hadron pairs in proton-proton collisions at √s=13 TeV

A. Hayrapetyan; A. Tumasyan; W. Adam; J. W. Andrejkovic; T. Bergauer et al. 

On the Convergence to the Non-equilibrium Steady State of a Langevin Dynamics with Widely Separated Time Scales and Different Temperatures

D. Alberici; N. Macris; E. Mingione 

Spectral Estimators for High-Dimensional Matrix Inference

Advances in Algorithms for Sampling, Optimization and Inference in Disordered Systems

Random matrix methods for high-dimensional machine learning models

Continual Mean Estimation Under User-Level Privacy

A. J. George; L. Ramesh; A. V. Singh; H. Tyagi 

Matrix Inference in Growing Rank Regimes

F. Pourkamali; J. Barbier; N. Macris 

On Speed and Advantage : Results in Information Velocity and Monitoring Problems

Log-Likelihood Loss for Semantic Compression

A. K. Yadav; D. Song; Y. Y. Shkel; A. Özgür 

Adaptive Composition Theorems: Degeneracy Conditions and Leakage Growth

I. Issa; Y. Y. Shkel; R. D. Cung 

On Perfect Functional Representations

S. E. Coban; Y. Y. Shkel; E. Telatar 

On the Suboptimality of Linear Codes for Binary Distributed Hypothesis Testing

A. Girish; R. D. H. Cung; E. Telatar 

Composition Theorems for Multiple Differential Privacy Constraints

C. Cadir; S. Najib; Y. Shkel 

On the Extremal Mechanisms for Local Differential Privacy & Binary Maximal Leakage

C. Cadir; Y. Y. Shkel 

DSP-Assisted In-Vivo Health Monitoring for ≥ 50G PON

C. Füllner; A. K. Yadav; R. Bonk 

Wiretapped Commitment Over Binary Channels

A. K. Yadav; M. Mamindlapally; A. J. Budkuley 

Binary Maximal Leakage

R. D. Cung; Y. Y. Shkel; I. Issa 

Communication-Constrained Secret Key Generation: Second-Order Bounds

H. Hentila; Y. Y. Shkel; V. Koivunen 

On Measuring Linkability of Multiple Protected Biometric Templates Using Maximal Leakage

H. O. Shahreza; Y. Y. Shkel; S. Marcel 

Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations

A. K. Yadav; Y. Shkel 

On the (Im)possibility of Commitment over Gaussian Unfair Noisy Channels

A. Budkuley; P. Joshi; M. Mamindlapally; A. K. Yadav 

Mismatched Rate-Distortion Theory: Ensembles, Bounds, and General Alphabets

M. Kanabar; J. Scarlett 

On Speed and Advantage : Results in Information Velocity and Monitoring Problems

Unlabeled Principal Component Analysis and Matrix Completion

Y. Yao; L. Peng; M. C. Tsakiris 

Random matrix methods for high-dimensional machine learning models

On the (Im)possibility of Commitment over Gaussian Unfair Noisy Channels

A. Budkuley; P. Joshi; M. Mamindlapally; A. K. Yadav 

Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations

A. K. Yadav; Y. Shkel 

Time vs. Truth: Age-Distortion Tradeoffs and Strategies for Distributed Inference

Distributed Lossy Computation with Structured Codes: From Discrete to Continuous Sources

A. Pastore; S. H. Lim; C. Feng; B. Nazer; M. C. Gastpar 

Personalized Privacy-Preserving Distributed Learning on Heterogeneous Data

A. Pradeep; M. C. Gastpar 

Beyond worst-case analysis, with or without predictions

Social Learning under Randomized Collaborations

Y. Inan; M. Kayaalp; E. Telatar; A. H. Sayed 

Optima Age Over Erasure Channels

E. Najm; E. Telatar; R. Nasser 

Age-Optimal Causal Labeling of Memoryless Processes

Y. Inan; E. Telatar 

Second-Order Converse for Rate-Limited Common Randomness Generation

H. Hentila; Y. Shkel; V. Koivunen 

Safety in Numbers: Asymptotic Analysis of a Monitoring Problem

R. Inovan; E. Telatar 

A Revisitation of Low-Rate Bounds on the Reliability Function of Discrete Memoryless Channels for List Decoding

M. Bondaschi; M. Dalai 

Mismatched Decoding Reliability Function at Zero Rate

M. Bondaschi; A. G. Fabregas; M. Dalai 

The Gray-Wyner Network and Wyner’s Common Information for Gaussian Sources

E. Sula; M. Gastpar 

Age-Optimal Causal Labeling of Memoryless Processes

Y. Inan; E. Telatar 

Safety in Numbers: Asymptotic Analysis of a Monitoring Problem

R. Inovan; E. Telatar 

A Johnson-Lindenstrauss Framework for Randomly Initialized CNNs

I. Nachum; J. Hazla; M. C. Gastpar; A. Khina 

A Unified Discretization Approach to Compute–Forward: From Discrete to Continuous Inputs

A. Pastore; S. H. Lim; C. Feng; B. Nazer; M. C. Gastpar 

From Generalisation Error to Transportation-cost Inequalities and Back

A. R. Esposito; M. C. Gastpar 

Shannon Bounds on Lossy Gray-Wyner Networks

E. Sula; M. C. Gastpar 

Alpha-NML Universal Predictors

M. Bondaschi; M. C. Gastpar 

On Sibson’s α-Mutual Information

A. R. Esposito; A. Vandenbroucque; M. C. Gastpar 

Finite Littlestone Dimension Implies Finite Information Complexity

A. Pradeep; I. Nachum; M. C. Gastpar 

Lower-bounds on the Bayesian Risk in Estimation Procedures via f–Divergences

A. Vandenbroucque; A. R. Esposito; M. C. Gastpar 

The Price of Distributed: Rate Loss in the CEO Problem

A. Atalik; A. Kose; M. C. Gastpar 

Differential Entropy of the Conditional Expectation Under Additive Gaussian Noise

A. Atalik; A. Kose; M. Gastpar 

A Functional Perspective on Information Measures

On the Efficiency of Polar-Like Decoding for Symmetric Codes

K. Ivanov; R. L. Urbanke 

Secret Key Generation Using Short Blocklength Polar Coding Over Wireless Channels

H. Hentila; Y. Y. Shkel; V. Koivunen 

Symmetry in design and decoding of polar-like codes

Mutual information for low-rank even-order symmetric tensor estimation

C. Luneau; J. Barbier; N. Macris 

The Stability of Low-Density Parity-Check Codes and Some of its Consequences

W. Liu; R. Urbanke 

Almost-Reed-Muller Codes Achieve Constant Rates for Random Errors

E. Abbe; J. Hazla; I. Nachum 

A Fundamental Limit of Distributed Hypothesis Testing Under Memoryless Quantization

Y. Inan; M. Kayaalp; A. H. Sayed; E. Telatar 

Bell Diagonal and Werner State Generation: Entanglement, Non-Locality, Steering and Discord on the IBM Quantum Computer

E. Riedel Gårding; N. Schwaller; C. L. Chan; S. Y. Chang; S. Bosch et al. 

Adaptive Path Interpolation Method for Sparse Systems: Application to a Censored Block Model

J. Barbier; C. L. Chan; N. Macris 

Secrecy by Design With Applications to Privacy and Compression

Y. Y. Shkel; R. S. Blum; H. V. Poor 

Common Information Components Analysis

E. Sula; M. C. Gastpar 

Differential Entropy of the Conditional Expectation under Gaussian Noise

A. Atalik; A. Kose; M. Gastpar 

Optimal Policies for Age and Distortion in a Discrete-Time Model

Y. Inan; R. Inovan; E. Telatar 

A Statistical Physics approach to a multi-channel Wigner spiked model

D. Alberici; F. Camilli; P. Contucci; E. Mingione 

Positioning Left-hand Movement in Violin Performance: A System and User Study of Fingering Pattern Generation

Y-H. Jen; T-P. Chen; S-W. Sun; L. Su 

Learning, compression, and leakage: Minimising classification error via meta-universal compression principles

F. E. Rosas; P. A. M. Mediano; M. Gastpar 

Secret Key Generation Over Wireless Channels Using Short Blocklength Multilevel Source Polar Coding

H. Hentila; Y. Y. Shkel; V. Koivunen 

A Discretization Approach to Compute-Forward

A. Pastore; S. H. Lim; C. Feng; B. Nazer; M. Gastpar 

Zero-rate Reliability Function for Mismatched Decoding

M. Bondaschi; A. Guillen i Fabregas; M. Dalai