Adjunct Professor in the Computer Science Department at Purdue.

Adjunct Professor in the Statistics Department (by courtesy) at Purdue.

Room 3308, Melbourne Connect, Carlton, VIC 3053, Australia.

e-mail: jhonorio at unimelb.edu.au, jhonorio at purdue.edu, jhonorio at csail.mit.edu

Modern machine learning (ML) problems are combinatorial and non-convex, specially those involving latent variables, for which theoretical guarantees are quite limited. Furthermore, while quantitative guarantees (e.g., small test error) have been studied, qualitative guarantees (e.g., outlier robustness) are mostly lacking. My long-term research goal is to uncover the general foundations of ML and optimization that drives the empirical success across many specific combinatorial and non-convex ML problems. I aim to develop a set of optimization-theoretic frameworks and tools to bridge the aforementioned gaps, to further our understanding of continuous (possibly non-convex) relaxations of combinatorial problems, as well as our knowledge of non-convexity.

My aim is to generate correct, computationally efficient and statistically efficient algorithms for high dimensional ML problems. My research group has produced breakthroughs not only on classical worst-case NP-hard problems, such as learning and inference in structured prediction, community detection and learning Bayesian networks, but also on areas of recent interest such as fairness, meta learning, federated learning and robustness. [vita]

Prior to joining The University of Melbourne, I was Assistant Professor at Purdue and a postdoctoral associate at MIT CSAIL, working with Tommi Jaakkola. My Erdős number is 3: Jean Honorio → Tommi Jaakkola → Noga Alon → Paul Erdős.

*Current.*Hanbyul Lee (Stat PhD), Wenjie Li (Stat PhD), Vineet Malik (CS MS), Deepak Maurya (CS PhD).*Past.*Adarsh Barik (CS PhD 2023, postdoc at NUS), Chuyang Ke (CS PhD 2023), Kevin Bello (CS PhD 2021, postdoc at UChicago & CMU), Asish Ghoshal (CS PhD 2019).*Other co-authors.*Imon Banerjee (Stat PhD), Huiming Xie (Stat PhD).*Other past co-authors.*Donald Adams (CS BS), Site Bai (CS PhD), Gregory Dexter (CS PhD), Abdulrahman Alabdulkareem (CS BS), Longyun Guo (Ag PhD), Abi Komanduru (Eng PhD), Krishna Kesari (Eng MS), Yu-Jun Li (CS MS), Zitao Li (CS PhD), Jiajun Liang (Stat MS), Meimei Liu (Stat PhD), Raphael Meyer (CS BS), Yuki Ohnishi (Stat PhD), Keehwan Park (CS MS), Zhanyu Wang (Stat PhD), Zhaosen Wang (CS MS), Qiuling Xu (CS PhD), Yixi Xu (Stat PhD), Xiaochen Yang (Stat PhD), Qian Zhang (Stat MS), Yilin Zheng (CS MS).*Prospective.*Here is a note for students who are considering working with me.

Lee H., Mazumder R., Song Q.,

(Under submission.)

Invex Programs: First Order Algorithms and Their Convergence. (Preprint)

Barik A., Sra S.,

(Under submission.)

Minimax Optimal Rates For Robust GLMs Against Constant Proportion of Identifiable Outliers.

Maurya D.,

(Under submission.)

On the True Geometry and Sample Complexity of Outlier-Robust Sparse Precision Matrix Estimation (Preprint)

Maurya D.,

(Under submission.)

Outlier-Robust Estimation of a Sparse Linear Model Using Invexity. (Preprint)

Barik A.,

(Under submission.)

Partial Inference in Structured Prediction. (Preprint)

Ke C.,

(Under submission.)

Support Recovery in Sparse PCA with Non-Random Missing Data. (Preprint)

Lee H., Song Q.,

(Under submission.)

Learning Against Distributional Uncertainty: On the Trade-off Between Robustness and Specificity. (Preprint)

Wang S., Wang H.,

(Under submission.)

Distributional Robustness Bounds Generalization Errors. (Preprint)

Wang S., Wang H.,

(Under submission.)

A Novel Plug-and-Play Approach for Adversarially Robust Generalization. (Preprint)

Maurya D., Barik A.,

(Under submission.)

A Theoretical Study of the Effects of Adversarial Attacks on Sparse Regression. (Preprint)

Maurya D.,

(Under submission.)

Meta Learning for High-dimensional Ising Model Selection Using ℓ

Xie H.,

(Under submission.)

Meta Sparse Principal Component Analysis. (Preprint)

Banerjee I.,

(Under submission.)

On the Sharp Analysis of Online Blackbox Optimization.

Li W.,

(Under submission.)

Direct Estimation of Difference Between Structural Equation Models in High Dimensions. (Preprint)

Ghoshal A., Bello K.,

(Under submission.)

Exact Inference with Latent Variables in an Arbitrary Domain. (Preprint)

Ke C.,

(Under submission.)

Li W.,

Provable Guarantees for Sparsity Recovery with Deterministic Missing Data Patterns.

Ke C.,

Dual Convexified Convolutional Neural Networks.

Bai S., Ke C.,

Federated X-Armed Bandit.

Li W., Song Q.,

Recovering Exact Support in Federated lasso without Optimization.

Barik A.,

Ke C.,

Remove Model Backdoors via Importance Driven Cloning.

Xu Q., Tao G.,

Provable Computational and Statistical Guarantees for Efficient Learning of Continuous-Action Graphical Games.

Barik A.,

Lee H., Song Q.,

Exact Partitioning of High-order Models with a Novel Convex Tensor Cone Relaxation.

Ke C.,

Sparse Mixed Linear Regression with Guarantees: Taming an Intractable Problem with Invex Relaxation.

Barik A.,

A Simple Unified Framework for High Dimensional Bandit Problems.

Li W., Barik A.,

On the Fundamental Limits of Exact Inference in Structured Prediction.

Lee H., Bello K.,

Exact Partitioning of High-order Planted Models with a Tensor Nuclear Norm Constraint.

Ke C.,

Provable Sample Complexity Guarantees for Learning of Continuous-Action Graphical Games with Nonparametric Utilities.

Barik A.,

Information Theoretic Limits for Standard and One-Bit Compressed Sensing with Graph-Structured Sparsity.

Barik A.,

A Thorough View of Exact Inference in Graphs from the Degree-4 Sum-of-Squares Hierarchy.

Bello K., Ke C.,

Federated Myopic Community Detection with One-shot Communication.

Ke C.,

Barik A.,

Inverse Reinforcement Learning in the Continuous Setting with Formal Guarantees.

Dexter G., Bello K.,

A Lower Bound for the Sample Complexity of Inverse Reinforcement Learning.

Komanduru A.,

Meta Learning for Support Recovery in High-dimensional Precision Matrix Estimation.

Zhang Q., Zheng Y.,

A Le Cam Type Bound for Adversarial Learning and Applications.

Bello K., Xu Q.,

Information Theoretic Limits of Exact Recovery in Sub-hypergraph Models for Community Detection.

Liang J., Ke C.,

Information-Theoretic Bounds for Integral Estimation.

Adams D., Barik A.,

First Order Methods take Exponential Time to Converge to Global Minimizers of Non-Convex Functions.

Kesari K.,

Information-Theoretic Lower Bounds for Zero-Order Stochastic Gradient Estimation.

Alabdulkareem A.,

Regularized Loss Minimizers with Local Data Perturbation: Consistency and Data Irrecoverability.

Li Z.,

The Sample Complexity of Meta Sparse Regression.

Wang Z.,

Novel Change of Measure Inequalities with Applications to PAC-Bayesian Bounds and Monte Carlo Estimation.

Ohnishi Y.,

Randomized Deep Structured Prediction for Discourse-Level Processing.

Widmoser M., Pacheco M.,

PrivSyn: Differentially Private Data Synthesis.

Zhang Z., Wang T.,

Bello K.,

Provable Efficient Skeleton Learning of Encodable Discrete Bayes Nets in Poly-Time and Sample Complexity.

Barik A.,

Minimax Bounds for Structured Prediction Based on Factor Graphs.

Bello K., Ghoshal A.,

Information Theoretic Sample Complexity Lower Bound for Feed-Forward Fully-Connected Deep Networks.

Yang X.,

Technical report.

Bello K.,

Learning Bayesian Networks with Low Rank Conditional Probability Tables.

Barik A.,

On the Correctness and Sample Complexity of Inverse Reinforcement Learning.

Komanduru A.,

Reconstructing a Bounded-Degree Directed Tree Using Path Queries.

Wang Z.,

Optimality Implies Kernel Sum Classifiers are Statistically Efficient.

Meyer R.,

Cost-Aware Learning for Improved Identifiability with Multiple Experiments.

Guo L.,

Bello K.,

Computationally and Statistically Efficient Learning of Causal Bayes Nets Using Path Queries.

Bello K.,

Information-Theoretic Limits for Community Detection in Network Models.

Ke C.,

Statistically and Computationally Efficient Variance Estimator for Kernel Ridge Regression.

Liu M.,

Learning Maximum-A-Posteriori Perturbation Models for Structured Prediction in Polynomial Time. (Long presentation)

Ghoshal A.,

Learning Linear Structural Equation Models in Polynomial Time and Sample Complexity.

Ghoshal A.,

Learning Sparse Polymatrix Games in Polynomial Time and Sample Complexity.

Ghoshal A.,

On the Statistical Efficiency of Compositional Nonparametric Prediction.

Xu Y.,

The Error Probability of Random Fourier Features is Dimensionality Independent.

Li Y.,

Technical report.

Ghoshal A.,

On the Sample Complexity of Learning Graphical Games.

Information Theoretic Limits for Linear Prediction with Graph-Structured Sparsity.

Barik A.,

Learning Graphical Games from Behavioral Data: Sufficient and Necessary Conditions.

Ghoshal A.,

Information-Theoretic Limits of Bayesian Network Structure Learning.

Ghoshal A.,

Ghoshal A.,

Structured Prediction: From Gaussian Perturbations to Linear-Time Principled Algorithms.

Information-Theoretic Lower Bounds for Recovery of Diffusion Network Structures.

Park K.,

Variable Selection in Gaussian Markov Random Fields.

Invited book chapter in

Edited by Aravkin A., Deng L., Heigold G., Jebara T., Kanevski D., Wright S. (to be published on December, 2016)

On the Statistical Efficiency of ℓ

Technical report. [code]

Predictive Sparse Modeling of fMRI Data for Improved Classification, Regression, and Visualization Using the k-Support Norm.

Belilovsky E., Gkirtzou K., Misyrlis M., Konova A.,

Integration of PCA with a Novel Machine Learning Method for Reparameterization and Assisted History Matching Geologically Complex Reservoirs.

Tight Bounds for the Expected Risk of Linear Classifiers and PAC-Bayes Finite-Sample Guarantees.

Classification on Brain Functional Magnetic Resonance Imaging: Dimensionality, Sample Size, Subject Variability and Noise.

Invited book chapter in

Edited by Chen C.,

Improving Interpretability of Graphical Models in fMRI Analysis via Variable-Selection.

Predicting Cross-task Behavioral Variables from fMRI Data Using the k-Support Norm.

Misyrlis M., Konova A., Blaschko M.,

Medical Image Computing and Computer-Assisted Intervention.

Methylphenidate Enhances Executive Function and Optimizes Prefrontal Function in Both Health and Cocaine Addiction.

Moeller S.,

Integration of Principal Component Analysis and Streamline Information for the History Matching of Channelized Reservoirs.

Chen C., Gao G.,

Two-Sided Exponential Concentration Bounds for Bayes Error Rate and Shannon Entropy.

fMRI Analysis of Cocaine Addiction Using k-Support Sparsity.

Gkirtzou K.,

fMRI Analysis with Sparse Weisfeiler-Lehman Graph Statistics.

Gkirtzou K.,

Medical Image Computing and Computer-Assisted Intervention,

Variable Selection for Gaussian Graphical Models.

Can a Single Brain Region Predict a Disorder?

Two-person Interaction Detection Using Body-Pose Features and Multiple Instance Learning.

Yun K.,

IEEE Computer Vision and Pattern Recognition,

Dopaminergic Involvement During Mental Fatigue in Health and Cocaine Addiction.

Moeller S., Tomasi D.,

Enhanced Midbrain Response at 6-month Follow-up in Cocaine Addiction, Association with Reduced Drug-related Choice.

Moeller S., Tomasi D., Woicik P., Maloney T., Alia-Klein N.,

Digital Analysis and Visualization of Swimming Motion.

Kirmizibayrak C.,

Digital Analysis and Visualization of Swimming Motion.

Kirmizibayrak C.,

Conference on Computer Animation and Social Agents,

Dopaminergic contribution to endogenous motivation during cognitive control breakdown.

Moeller S., Tomasi D.,

Simple Fully Automated Group Classification on Brain fMRI.

Disrupted Functional Connectivity with Dopaminergic Midbrain in Cocaine Abusers.

Tomasi D., Volkow N., Wang R.,

Oral Methylphenidate Normalizes Cingulate Activity in Cocaine Addiction During a Salient Cognitive Task.

Goldstein R., Woicik P., Maloney T., Tomasi D., Alia-Klein N., Shan J.,

Learning Brain fMRI Structure Through Sparseness and Local Constancy.

Neural Information Processing Systems,

A Functional Geometry of fMRI BOLD Signal Interactions.

Langs G., Samaras D., Paragios N.,

Neural Information Processing Systems,

Dopaminergic Response to Drug Words in Cocaine Addiction.

Goldstein R., Tomasi D., Alia-Klein N.,

Anterior Cingulate Cortex Hypoactivations to an Emotionally Salient Task in Cocaine Addiction.

Goldstein R., Alia-Klein N., Tomasi D.,

Langs G., Samaras D., Paragios N.,