Publications

Interpolation of Quantum Polar Codes and Quantum Reed-Muller Codes

K. Hidaka; D. Abdelhadi; R. Urbanke 

A Vector-Based Algorithm for Generating Complete Balanced Reaction Sets with Arbitrary Numbers of Reagents

N. Yilmaz; P. Kozub; S. Kozub 

Vector-Based Approach to the Stoichiometric Analysis of Multicomponent Chemical Reactions: The Case of Black Powder

P. Kozub; N. Yilmaz; S. Kozub 

Reed-Muller Codes for Quantum Pauli and Multiple Access Channels

D. Abdelhadi; C. Sandon; E. Abbe; R. Urbanke 

Federated One-Shot Learning with Data Privacy and Objective-Hiding

M. Egger; R. Urbanke; R. Bitar 

Noisy Quantum Communication and Computation

Entanglement Sharing Across a Damping-Dephasing Channel

V. Siddhu; D. Abdelhadi; T. Jochym-O’Connor; J. A. Smolin 

Random matrix methods for high-dimensional machine learning models

Beyond worst-case analysis, with or without predictions

On the Efficiency of Polar-Like Decoding for Symmetric Codes

K. Ivanov; R. L. Urbanke 

Symmetry in design and decoding of polar-like codes

Polar Codes Do Not Have Many Affine Automorphisms

K. Ivanov; R. Urbanke 

Mutual information for low-rank even-order symmetric tensor estimation

C. Luneau; J. Barbier; N. Macris 

The Stability of Low-Density Parity-Check Codes and Some of its Consequences

W. Liu; R. Urbanke 

A Statistical Physics approach to a multi-channel Wigner spiked model

D. Alberici; F. Camilli; P. Contucci; E. Mingione 

Learning from survey propagation: a neural network for MAX-E-3-SAT

R. Marino 

The Solution of the Deep Boltzmann Machine on the Nishimori Line

D. Alberici; F. Camilli; P. Contucci; E. Mingione 

Bell Diagonal and Werner State Generation: Entanglement, Non-Locality, Steering and Discord on the IBM Quantum Computer

E. Riedel Gårding; N. Schwaller; C. L. Chan; S. Y. Chang; S. Bosch et al. 

Criticality and conformality in the random dimer model

S. Caracciolo; R. Fabbricatore; M. Gherardi; R. Marino; G. Parisi et al. 

Adaptive Path Interpolation Method for Sparse Systems: Application to a Censored Block Model

J. Barbier; C. L. Chan; N. Macris 

Deuteron identification via time of flight with LHCb

R. Aaij; A. S. W. Abdelmotteleb; C. A. Beteta; F. Abudinén; T. Ackernley et al. 

On Entropy-Constrained Gaussian Channel Capacity via the Moment Problem

A. Girish; E. Telatar; S. S. Shitz 

Urolithin A provides cardioprotection and mitochondrial quality enhancement preclinically and improves human cardiovascular health biomarkers

S. Liu; J. Faitg; C. Tissot; D. Konstantopoulos; R. Laws et al. 

On entropy-constrained Gaussian channel capacity via the moment problem

A. Girish; S. Shamai; E. Telatar 

Attention with Markov: A Curious Case of Single-layer Transformers

A. V. Makkuva; M. Bondaschi; A. Girish; A. Nagle; M. Jaggi et al. 

How to Make Measure Theory Completely Pointless

Downlink Massive Random Access with Lossy Source Coding

R. Song; W. Yu 

Jacobian Descent for Multi-Objective Optimization

P. Quinton; V. Rey 

Local to global: Learning dynamics and effect of initialization for transformers

A. V. Makkuva; M. Bondaschi; C. Ekbote; A. Girish; A. Nagle et al. 

Fundamental Limits of Prompt Compression: A Rate- Distortion Framework for Black-Box Language Models

A. Girish; A. Nagle; M. Bondaschi; M. Gastpar; A. V. Makkuva et al. 

Causal Impact Analysis for Asynchronous Decision Making

M. Kayaalp; Y. Inan; V. Koivunen; A. Sayed 

How Deep Neural Networks Learn Compositional Data: The Random Hierarchy Model

F. Cagnetta; L. Petrini; U. M. Tomasini; A. Favero; M. Wyart 

On the Arithmetic and Geometric Fusion of Beliefs for Distributed Inference

M. Kayaalp; Y. Inan; E. Telatar; A. H. Sayed 

Causal Influence in Federated Edge Inference

M. Kayaalp; Y. Inan; V. Koivunen; A. H. Sayed 

On Speed and Advantage : Results in Information Velocity and Monitoring Problems

Social Learning under Randomized Collaborations

Y. Inan; M. Kayaalp; E. Telatar; A. H. Sayed 

On the Fusion Strategies for Federated Decision Making

M. Kayaalp; Y. Inan; V. Koivunen; E. Telatar; A. H. Sayed 

Time vs. Truth: Age-Distortion Tradeoffs and Strategies for Distributed Inference

Optima Age Over Erasure Channels

E. Najm; E. Telatar; R. Nasser 

Age-Optimal Causal Labeling of Memoryless Processes

Y. Inan; E. Telatar 

The Conditional Regret-Capacity Theorem for Batch Universal Prediction

M. Bondaschi; M. Gastpar 

Characterising high-order interdependence via entropic conjugation

F. E. Rosas; A. J. Gutknecht; P. A. Mediano; M. Gastpar 

Model Non-Collapse: Minimax Bounds for Recursive Discrete Distribution Estimation

M. Kanabar; M. Gastpar 

Attention with Markov: A Curious Case of Single-layer Transformers

A. V. Makkuva; M. Bondaschi; A. Girish; A. Nagle; M. Jaggi et al. 

Data Heterogeneity in Linear Distributed Estimation and Learning

Sibson α-Mutual Information and Its Variational Representations

A. R. Esposito; M. Gastpar; I. Issa 

Propagation of Orientation Across Lengthscales in Sheared Self-Assembling Hierarchical Suspensions via Rheo-PLI-SAXS

R. Ghanbari; A. Terry; S. Wojno; M. Bek; K. Sekar et al. 

Lower Bounds on the Bayesian Risk via Information Measures

A. R. Esposito; A. Vandenbroucque; M. C. Gastpar 

Local to global: Learning dynamics and effect of initialization for transformers

A. V. Makkuva; M. Bondaschi; C. Ekbote; A. Girish; A. Nagle et al. 

Fundamental Limits of Prompt Compression: A Rate- Distortion Framework for Black-Box Language Models

A. Girish; A. Nagle; M. Bondaschi; M. Gastpar; A. V. Makkuva et al. 

Shannon Bounds for Quadratic Rate-Distortion Problems

M. C. Gastpar; E. Sula 

Search for high-mass exclusive diphoton production with tagged protons in proton-proton collisions at √s=13 TeV

A. Tumasyan; W. Adam; J. W. Andrejkovic; T. Bergauer; S. Chatterjee et al. 

Batch Universal Prediction

M. Bondaschi; M. Gastpar 

Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression

L. Clarte; A. Vandenbroucque; G. Dalle; B. Loureiro; F. Krzakala et al. 

Mismatched Rate-Distortion Theory: Ensembles, Bounds, and General Alphabets

M. Kanabar; J. Scarlett 

Simultaneous Computation and Communication over MAC

M. Frey; I. Bjelaković; M. C. Gastpar; J. Zhu 

Unlabeled Principal Component Analysis and Matrix Completion

Y. Yao; L. Peng; M. C. Tsakiris 

Properties of the Strong Data Processing Constant for Rényi Divergence

L. Jin; A. R. Esposito; M. Gastpar 

The Persuasion Bottleneck

M. Gastpar; A. Rajesh 

Variational Characterizations of Sibson’s α-Mutual Information

A. R. Esposito; M. Gastpar; I. Issa 

Rectangular rotational invariant estimator for high-rank matrix estimation

F. Pourkamali; N. Macris 

Analysis of Diffusion Models for Manifold Data

A. J. George; R. Veiga; N. Macris 

Tackling Hardness using Spin Glass Physics: from Inference to Sampling through Diffusions

Data Heterogeneity in Linear Distributed Estimation and Learning

Noisy Quantum Communication and Computation

Search for high-mass exclusive diphoton production with tagged protons in proton-proton collisions at √s=13 TeV

A. Tumasyan; W. Adam; J. W. Andrejkovic; T. Bergauer; S. Chatterjee et al. 

Nonresonant central exclusive production of charged-hadron pairs in proton-proton collisions at √s=13 TeV

A. Hayrapetyan; A. Tumasyan; W. Adam; J. W. Andrejkovic; T. Bergauer et al. 

On the Convergence to the Non-equilibrium Steady State of a Langevin Dynamics with Widely Separated Time Scales and Different Temperatures

D. Alberici; N. Macris; E. Mingione 

Random matrix methods for high-dimensional machine learning models

Advances in Algorithms for Sampling, Optimization and Inference in Disordered Systems

Continual Mean Estimation Under User-Level Privacy

A. J. George; L. Ramesh; A. V. Singh; H. Tyagi 

Spectral Estimators for High-Dimensional Matrix Inference

On Speed and Advantage : Results in Information Velocity and Monitoring Problems

Matrix Inference in Growing Rank Regimes

F. Pourkamali; J. Barbier; N. Macris 

Metastability of the Potts Ferromagnet on Random Regular Graphs

A. Coja-Oghlan; A. Galanis; L. A. Goldberg; J. B. Ravelomanana; D. Stefankovic et al. 

Solving Non-linear Kolmogorov Equations in Large Dimensions by Using Deep Learning: A Numerical Comparison of Discretization Schemes

R. Marino; N. Macris 

Statistical limits of dictionary learning: Random matrix theory and the spectral replica method

J. Barbier; N. Macris 

Cosmology intertwined: A review of the particle physics, astrophysics, and cosmology associated with the cosmological tensions and anomalies

E. Abdalla; G. F. Abellan; A. Aboubrahim; A. Agnello; O. Akarsu et al. 

Information theoretic limits of learning a sparse rule

C. Luneau; N. Macris; J. Barbier 

Symmetry in design and decoding of polar-like codes

On the Extremal Mechanisms for Local Differential Privacy & Binary Maximal Leakage

C. Cadir; Y. Y. Shkel 

DSP-Assisted In-Vivo Health Monitoring for ≥ 50G PON

C. Füllner; A. K. Yadav; R. Bonk 

Wiretapped Commitment Over Binary Channels

A. K. Yadav; M. Mamindlapally; A. J. Budkuley 

On Measuring Linkability of Multiple Protected Biometric Templates Using Maximal Leakage

H. O. Shahreza; Y. Y. Shkel; S. Marcel 

Binary Maximal Leakage

R. D. Cung; Y. Y. Shkel; I. Issa 

Communication-Constrained Secret Key Generation: Second-Order Bounds

H. Hentila; Y. Y. Shkel; V. Koivunen 

On the (Im)possibility of Commitment over Gaussian Unfair Noisy Channels

A. Budkuley; P. Joshi; M. Mamindlapally; A. K. Yadav 

Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations

A. K. Yadav; Y. Shkel 

Mismatched Rate-Distortion Theory: Ensembles, Bounds, and General Alphabets

M. Kanabar; J. Scarlett 

On Speed and Advantage : Results in Information Velocity and Monitoring Problems

Unlabeled Principal Component Analysis and Matrix Completion

Y. Yao; L. Peng; M. C. Tsakiris 

Random matrix methods for high-dimensional machine learning models

On the (Im)possibility of Commitment over Gaussian Unfair Noisy Channels

A. Budkuley; P. Joshi; M. Mamindlapally; A. K. Yadav 

Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations

A. K. Yadav; Y. Shkel 

Time vs. Truth: Age-Distortion Tradeoffs and Strategies for Distributed Inference

Distributed Lossy Computation with Structured Codes: From Discrete to Continuous Sources

A. Pastore; S. H. Lim; C. Feng; B. Nazer; M. C. Gastpar 

Personalized Privacy-Preserving Distributed Learning on Heterogeneous Data

A. Pradeep; M. C. Gastpar 

Beyond worst-case analysis, with or without predictions

Social Learning under Randomized Collaborations

Y. Inan; M. Kayaalp; E. Telatar; A. H. Sayed 

Optima Age Over Erasure Channels

E. Najm; E. Telatar; R. Nasser 

Age-Optimal Causal Labeling of Memoryless Processes

Y. Inan; E. Telatar 

Second-Order Converse for Rate-Limited Common Randomness Generation

H. Hentila; Y. Shkel; V. Koivunen 

Safety in Numbers: Asymptotic Analysis of a Monitoring Problem

R. Inovan; E. Telatar 

A Revisitation of Low-Rate Bounds on the Reliability Function of Discrete Memoryless Channels for List Decoding

M. Bondaschi; M. Dalai 

Mismatched Decoding Reliability Function at Zero Rate

M. Bondaschi; A. G. Fabregas; M. Dalai 

The Gray-Wyner Network and Wyner’s Common Information for Gaussian Sources

E. Sula; M. Gastpar 

Age-Optimal Causal Labeling of Memoryless Processes

Y. Inan; E. Telatar 

Safety in Numbers: Asymptotic Analysis of a Monitoring Problem

R. Inovan; E. Telatar 

A Johnson-Lindenstrauss Framework for Randomly Initialized CNNs

I. Nachum; J. Hazla; M. C. Gastpar; A. Khina 

A Unified Discretization Approach to Compute–Forward: From Discrete to Continuous Inputs

A. Pastore; S. H. Lim; C. Feng; B. Nazer; M. C. Gastpar 

From Generalisation Error to Transportation-cost Inequalities and Back

A. R. Esposito; M. C. Gastpar 

Shannon Bounds on Lossy Gray-Wyner Networks

E. Sula; M. C. Gastpar 

Alpha-NML Universal Predictors

M. Bondaschi; M. C. Gastpar 

On Sibson’s α-Mutual Information

A. R. Esposito; A. Vandenbroucque; M. C. Gastpar 

Finite Littlestone Dimension Implies Finite Information Complexity

A. Pradeep; I. Nachum; M. C. Gastpar 

Lower-bounds on the Bayesian Risk in Estimation Procedures via f–Divergences

A. Vandenbroucque; A. R. Esposito; M. C. Gastpar 

The Price of Distributed: Rate Loss in the CEO Problem

A. Atalik; A. Kose; M. C. Gastpar 

Differential Entropy of the Conditional Expectation Under Additive Gaussian Noise

A. Atalik; A. Kose; M. Gastpar 

A Functional Perspective on Information Measures

On the Efficiency of Polar-Like Decoding for Symmetric Codes

K. Ivanov; R. L. Urbanke 

Secret Key Generation Using Short Blocklength Polar Coding Over Wireless Channels

H. Hentila; Y. Y. Shkel; V. Koivunen 

Symmetry in design and decoding of polar-like codes

Mutual information for low-rank even-order symmetric tensor estimation

C. Luneau; J. Barbier; N. Macris 

The Stability of Low-Density Parity-Check Codes and Some of its Consequences

W. Liu; R. Urbanke 

Almost-Reed-Muller Codes Achieve Constant Rates for Random Errors

E. Abbe; J. Hazla; I. Nachum 

A Fundamental Limit of Distributed Hypothesis Testing Under Memoryless Quantization

Y. Inan; M. Kayaalp; A. H. Sayed; E. Telatar 

Bell Diagonal and Werner State Generation: Entanglement, Non-Locality, Steering and Discord on the IBM Quantum Computer

E. Riedel Gårding; N. Schwaller; C. L. Chan; S. Y. Chang; S. Bosch et al. 

Adaptive Path Interpolation Method for Sparse Systems: Application to a Censored Block Model

J. Barbier; C. L. Chan; N. Macris 

Secrecy by Design With Applications to Privacy and Compression

Y. Y. Shkel; R. S. Blum; H. V. Poor 

Common Information Components Analysis

E. Sula; M. C. Gastpar 

Differential Entropy of the Conditional Expectation under Gaussian Noise

A. Atalik; A. Kose; M. Gastpar 

Optimal Policies for Age and Distortion in a Discrete-Time Model

Y. Inan; R. Inovan; E. Telatar 

A Statistical Physics approach to a multi-channel Wigner spiked model

D. Alberici; F. Camilli; P. Contucci; E. Mingione 

Positioning Left-hand Movement in Violin Performance: A System and User Study of Fingering Pattern Generation

Y-H. Jen; T-P. Chen; S-W. Sun; L. Su 

Learning, compression, and leakage: Minimising classification error via meta-universal compression principles

F. E. Rosas; P. A. M. Mediano; M. Gastpar 

Secret Key Generation Over Wireless Channels Using Short Blocklength Multilevel Source Polar Coding

H. Hentila; Y. Y. Shkel; V. Koivunen 

A Discretization Approach to Compute-Forward

A. Pastore; S. H. Lim; C. Feng; B. Nazer; M. Gastpar 

Zero-rate Reliability Function for Mismatched Decoding

M. Bondaschi; A. Guillen i Fabregas; M. Dalai