Publications

* below denotes equal contribution

Fast Machine Learning Inference



  1. DRONE: Data-aware Low-rank Compression for Large NLP Models
    Patrick H. Chen, Hsiang-fu Yu, Inderjit S. Dhillon, and Cho-jui, Hsieh
    In Advances in Neural Information Processing Systems (NeurIPS), 2021
  1. Clustering and Constructing User Coresets to Accelerate Large-scale Top-𝐾 Recommender Systems
    Jyun-yu Jiang*, Patrick H. Chen*, Cho-jui, Hsieh, and Wei Wang
    In International World Wide Web Conference (WWW), 2020
  1. Efficient Contextual Representation Learning With Continuous Outputs
    Liunian Harold Li, Patrick H. Chen, Cho-jui, Hsieh, and Kai-wei Chang
    In Transactions of the Association for Computational Linguistics (TACL), 2019
  1. Learning to Screen for Fast Softmax Inference on Large Vocabulary Neural Networks
    Patrick H. Chen, Si Si, Sanjiv Kumar, Yang Li, and Cho-jui, Hsieh,
    In International Conference on Learning Representations (ICLR), 2019

Machine Learning Model Compression



  1. DRONE: Data-aware Low-rank Compression for Large NLP Models
    Patrick H. Chen, Hsiang-fu Yu, Inderjit S. Dhillon, and Cho-jui, Hsieh
    In Advances in Neural Information Processing Systems (NeurIPS), 2021
  1. MulCode: A Multiplicative Multi-way Model for Compressing Neural Language Model
    Yukun, Ma* Patrick H. Chen*, and Cho-jui, Hsieh
    In Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019
  1. GroupReduce: Block-Wise Low-Rank Approximation for Neural Language Model Shrinking
    Patrick H. Chen, Si Si, Yang Li, Ciprian Chelba and Cho-jui, Hsieh
    In Advances in Neural Information Processing Systems (NeurIPS), 2018

Fundamental Machine Learning



  1. Overcoming Catastrophic Forgetting by Bayesian Generative Regularization
    Patrick H. Chen, Wei Wei, Cho-jui, Hsieh, and Bo Dai
    In Conference of Machine Learning (ICML), 2021
  1. Sign-OPT: A Query-Efficient Hard-label Adversarial Attack
    Minhao Cheng*, Simranjit Singh*, Patrick H. Chen , Pin-Yu Chen, Sijia Liu and Cho-Jui Hsieh
    In International Conference on Learning Representations (ICLR), 2020