We’re interested in machine learning, optimization algorithms and text understanding, as well as several application domains.
2020
Self-supervised learning for time series classification
2020-08-09.LaMBERT: Light and Multigranular BERT
2020-07-01.CUMULATOR — a tool to quantify and report the carbon footprint of machine learning computations and communication in academia and healthcare
2020-06-19.Privacy-preserving and Personalized Federated Machine Learning for Medical Data
2020-06-18.Efficient second-order methods for model compression
2020-04-06.Automated Essay Scoring in Foreign Language Students Based on Deep Contextualised Word Representations
2020-03-23. LAK20 – 10th International Conference on Learning Analytics & Knowledge, Mars 23, 2020.Dynamic Model Pruning with Feedback
2020. 8th International Conference on Learning Representations (ICLR), Virtual Conference, Formerly Addis Ababa, Ethiopia, April 26-30, 2020.Forecasting intracranial hypertension using multi-scale waveform metrics
Physiological Measurement. 2020-01-01. Vol. 41, num. 1, p. 014001. DOI : 10.1088/1361-6579/ab6360.An Explicit Construction of Optimal Streaming Codes for Channels With Burst and Arbitrary Erasures
Ieee Transactions On Communications. 2020-01-01. Vol. 68, num. 1, p. 12-25. DOI : 10.1109/TCOMM.2019.2944372.Accelerating Gradient Boosting Machine
2020. 23rd International Conference on Artificial Intelligence and Statistics, Palermo, Sicily, Italy, June 3 – 5, 2020.On the Relationship between Self-Attention and Convolutional Layers
2020. Eighth International Conference on Learning Representations – ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020.Evaluating the search phase of neural architecture search
2020. ICRL 2020 Eighth International Conference on Learning Representations, Millennium Hall, Addis Ababa, ETHIOPIA, April 26-30, 2020.2019
An accelerated communication-efficient primal-dual optimization framework for structured machine learning
Optimization Methods & Software. 2019-08-06. DOI : 10.1080/10556788.2019.1650361.Stochastic Zeroth-Order Optimisation Algorithms with Variance Reduction
2019-06-21.A comparison of model-parallel training methods for deep learning
2019-06-18.Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication
2019-06-09. ICML 2019 – International Conference on Machine Learning, Long Beach, California, USA, 9-15 June 2019.Local SGD Converges Fast and Communicates Little
2019-05-06. ICLR 2019 – International Conference on Learning Representations, New Orleans, USA, May 6-9, 2019.Unsupervised Robust Nonparametric Learning Of Hidden Community Properties
Mathematical Foundations Of Computing. 2019-05-01. Vol. 2, num. 2, p. 127-147. DOI : 10.3934/mfc.2019010.Crosslingual Document Embedding as Reduced-Rank Ridge Regression
2019-02-13. WSDM ’19 – ACM International Conference on Web Search and Data Mining, Melbourne, Australia, February 11 – 15, 2019 . p. 744-752. DOI : 10.1145/3289600.3291023.Transformer-Based Multi-lingual Sentence Embeddings
2019.Efficient Greedy Coordinate Descent for Composite Problems
2019-01-01. 22nd International Conference on Artificial Intelligence and Statistics (AISTATS), Naha, JAPAN, Apr 16-18, 2019.Efficient Greedy Coordinate Descent for Composite Problems
2019. The 22nd International Conference on Artificial Intelligence and Statistics – AISTATS 2019, Naha, Okinawa, Japan, April 16-18, 2019. p. 2887-2896.Error Feedback Fixes SignSGD and other Gradient Compression Schemes
2019. 36th International Conference on Machine Learning (ICML) 2019, Long Beach, USA, June 9-15, 2019. p. 3252-3261.Overcoming Multi-model Forgetting
2019. ICML 2019 – 36th International Conference on Machine Learning, Long Beach, California, USA, June 09-15, 2019. p. 594-603.Open-Vocabulary Keyword Spotting with Audio and Text Embeddings
2019. INTERSPEECH 2019 – IEEE International Conference on Acoustics, Speech, and Signal Processing, Graz, Austria,Better Word Embeddings by Disentangling Contextual n-Gram Information
2019. NAACL 2019 – Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, Minnesota, USA, June 2-7. 2019.2018
Training DNNs with Hybrid Block Floating Point
2018-12-04. NeurIPS 2018 – Neural Information Processing Systems, Montréal Canada, December 2-8, 2018.Accelerated Stochastic Matrix Inversion: General Theory and Speeding up BFGS Rules for Faster Second-Order Optimization
2018-12-02. 32nd Annual Conference on Neural Information Processing Systems (NIPS), Montréal, Canada, December 2-8, 2018.Sparsified SGD with Memory
2018-12-02. NeurIPS 2018 – 32nd Annual Conference on Neural Information Processing Systems, Montréal, Canada, December 2-8, 2018.Optimal Affine-Invariant Smooth Minimization Algorithms
SIAM Journal on Optimization. 2018-09-19. Vol. 28, num. 3, p. 2384-2405. DOI : 10.1137/17M1116842.Unsupervised Learning of Representations for Lexical Entailment Detection
2018-09-04.Convex Optimization using Sparsified Stochastic Gradient Descent with Memory
2018-06-27.Detecting Steganography
2018-06-21.Unsupervised learning of sentence embeddings using compositional n-gram features
2018-05-01. NAACL 2018 – Conference of the North American Chapter of the Association for Computational Linguistics.Simple Unsupervised Keyphrase Extraction using Sentence Embeddings
2018-05-01. CoNLL 2018 – SIGNLL Conference on Computational Natural Language Learning.On Matching Pursuit and Coordinate Descent
2018-05-01. ICML 2018 – 35th International Conference on Machine Learning.Adaptive balancing of gradient and update computation times using global geometry and approximate subproblems
2018-05-01.Learning Word Vectors for 157 Languages
2018-02-19. Language Resources and Evaluation Conference, Miyazaki, Japan, May 7-12, 2018.A Distributed Second-Order Algorithm You Can Trust
2018. 35th International Conference on Machine Learning (ICML 2018), Stockholm, Sweden, 10-15 July 2018. p. 1358-1366.Accelerated Stochastic Matrix Inversion: General Theory and Speeding up BFGS Rules for Faster Second-Order Optimization
2018-01-01. 32nd Conference on Neural Information Processing Systems (NIPS), Montreal, CANADA, Dec 02-08, 2018.COLA: Decentralized Linear Learning
2018-01-01. 32nd Conference on Neural Information Processing Systems (NIPS), Montreal, CANADA, Dec 02-08, 2018.Training DNNs with Hybrid Block Floating Point
2018-01-01. NeurIPS 2018 – 32nd Conference on Neural Information Processing Systems, Montreal, CANADA, Dec 02-08, 2018.CoCoA: A General Framework for Communication-Efficient Distributed Optimization
Journal Of Machine Learning Research. 2018-01-01. Vol. 18.Some results on a class of mixed van der Waerden numbers
Rocky Mountain Journal of Mathematics. 2018. Vol. 48, num. 3, p. 885-904. DOI : 10.1216/RMJ-2018-48-3-885.Gene locations may contribute to predicting gene regulatory relationships
JOURNAL OF ZHEJIANG UNIVERSITY-SCIENCE B. 2018. Vol. 19, num. 1, p. 25-37. DOI : 10.1631/jzus.B1700303.Prediction of patient-reported physical activity scores from wearable accelerometer data: a feasibility study
2018. ICNR2018 – International Conference on NeuroRehabilitation, Pisa, Italy, October 16 – 20, 2018.2017
Asynchronous updates for stochastic gradient descent
2017-06-09.Fully Quantized Distributed Gradient Descent
2017.Safe Adaptive Importance Sampling
2017. Neural Information Processing Systems (NIPS), Long Beach, USA, December 4-9, 2017.On the existence of ordinary triangles
Computational Geometry. 2017. Vol. 66, p. 28-31. DOI : 10.1016/j.comgeo.2017.07.002.Learning Aerial Image Segmentation from Online Maps
IEEE Transactions on Geoscience and Remote Sensing. 2017. Vol. 55, num. 11, p. 6054-6068. DOI : 10.1109/TGRS.2017.2719738.Approximate Steepest Coordinate Descent
2017. ICML 2017 – International Conference on Machine Learning, Sydney, Australia, Aug 6-11, 2017.Generating Steganographic Text with LSTMs
2017. ACL Student Research Workshop 2017, Vancouver, Canada, July 30-August 4, 2017. p. 100-106. DOI : 10.18653/v1/P17-3017.Distributed Optimization with Arbitrary Local Solvers
Journal of Optimization Methods and Software. 2017. Vol. 32. DOI : 10.1080/10556788.2016.1278445.Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Features
2017
A Unified Optimization View on Generalized Matching Pursuit and Frank-Wolfe
2017. 20th International Conference on Artificial Intelligence and Statistics (AISTATS) 2017, Fort Lauderdale, California, United States, April 20-22, 2017.Leveraging Large Amounts of Weakly Supervised Data for Multi-Language Sentiment Classification
2017. International World Wide Web Conference (WWW) 2017, Perth, Australia, April 3-7, 2017. p. 1045-1052. DOI : 10.1145/3038912.3052611.Faster Coordinate Descent via Adaptive Importance Sampling
2017. 20th International Conference on Artificial Intelligence and Statistics (AISTATS) 2017, Fort Lauderdale, Florida, USA, April 20-22, 2017.2016
CoCoA: A General Framework for Communication-Efficient Distributed Optimization
2016.Screening Rules for Convex Problems
2016
Pursuits in Structured Non-Convex Matrix Factorizations
2016
SwissCheese at SemEval-2016 Task 4: Sentiment Classification Using an Ensemble of Convolutional Neural Networks with Distant Supervision
2016. [email protected] 2016, San Diego, CA, USA, June 16-17, 2016. p. 1124-1128.Primal-Dual Rates and Certificates
2016. ICML 2016 – International Conference on Machine Learning, USA, NY, New York City, June 19-24, 2016. p. 783-792.Audio Based Bird Species Identification using Deep Learning Techniques
2016. Conference and Labs of the Evaluation Forum (CLEF) 2016, Évora, Portugal, 5-8 September, 2016. p. 547-559.2015
L1-Regularized Distributed Optimization: A Communication-Efficient Primal-Dual Framework
2015
Swiss-Chocolate: Combining Flipout Regularization and Random Forests with Artificially Built Subsystems to Boost Text-Classification for Sentiment.
2015. [email protected] 2015, Denver, Colorado, USA, June 4-5, 2015. p. 608-612.On the Global Linear Convergence of Frank-Wolfe Optimization Variants
2015. Neural Information Processing Systems (NIPS) 2015, Montreal, Quebec, Canada, December 7-12, 2015. p. 496-504.Adding vs. Averaging in Distributed Primal-Dual Optimization
2015. ICML 2015 – International Conference on Machine Learning, Lille, France, 6-11 July 2015. p. 1973-1982.2014
An Equivalence between the Lasso and Support Vector Machines
Regularization, Optimization, Kernels, and Support Vector Machines; Chapman and Hall/CRC, 2014. p. 1-26.Swiss-Chocolate: Sentiment Detection using Sparse SVMs and Part-Of-Speech n-Grams.
2014. [email protected] 2014, Dublin, Ireland, August 23-24, 2014. p. 601-604.Communication-Efficient Distributed Dual Coordinate Ascent.
2014. Neural Information Processing Systems (NIPS) 2014, Montreal, Quebec, Canada, December 8-13 2014. p. 3068-3076.2013
Revisiting Frank-Wolfe: Projection-Free Sparse Convex Optimization
2013. ICML 2013 – International Conference on Machine Learning, Atlanta, GA, USA, 16-21 June 2013. p. 427-435.Block-Coordinate Frank-Wolfe Optimization for Structural SVMs
2013. ICML 2013 – International Conference on Machine Learning, Atlanta, GA, USA, 16-21 June 2013. p. 53-61.2012
Regularization Paths with Guarantees for Convex Semidefinite Optimization.
2012. International Conference on Artificial Intelligence and Statistics (AISTATS) 2012, La Palma, Canary Islands, April 21-23, 2012. p. 432-439.Optimizing over the Growing Spectrahedron
2012. European Symposia on Algorithms (ESA) 2012, Ljubljana, Slovenia, September 10-12, 2012. p. 503-514. DOI : 10.1007/978-3-642-33090-2_44.Approximating parameterized convex optimization problems
ACM Transactions on Algorithms. 2012. Vol. 9, num. 1, p. 10:1-10:17. DOI : 10.1145/2390176.2390186.An Exponential Lower Bound on the Complexity of Regularization Paths
JoCG – Journal of Computational Geometry. 2012. Vol. 3, num. 1, p. 168-195. DOI : 10.20382/jocg.v3i1a9.Optimizing over the Growing Spectrahedron
Algorithms – ESA 2012; Berlin Heidelberg: Springer, 2012. p. 503-514.2011
Sparse convex optimization methods for machine learning
ETH Zürich, 2011.Convex Optimization without Projection Steps
2011
2010
A Simple Algorithm for Nuclear Norm Regularized Problems.
2010. International Conference on Machine Learning (ICML) 2010, Haifa, Israel, June 21-24, 2010. p. 471-478.Approximating Parameterized Convex Optimization Problems.
2010. European Symposia on Algorithms (ESA) 2010, Liverpool, UK, September 6-8, 2010. p. 524-535. DOI : 10.1007/978-3-642-15775-2_45.Approximating Parameterized Convex Optimization Problems
European Symposia on Algorithms (ESA) 2010; Springer Berlin Heidelberg, 2010. p. 524-535.2009
A Combinatorial Algorithm to Compute Regularization Paths
2009