>

Patrick H. Chen

Ph.D. Candidate
Dept. of Computer Science
UCLA

patrickchen [at] g [dot] ucla [dot] edu



Bio


I am a Ph.D. student in Computer Science at UCLA, supervised by Cho-Jui Hsieh. I obtained my Bachelor degree in Electrical Engineering and History from National Taiwan University. Before starting my Ph.D. journery, I worked with Shen-Shyang Ho as a Research Assistant at Nanyang Technological University


Research


My current research focsed on Efficient Machine Learning (EML). The goal of EML is to achieve a smaller model with fast inference speed on all devices. This includes studies of compressing machine learning models,approximating model inference operations, or acheving both simultaneoursly. In addition to EML, I am also keen on exploring fundamental problems of Machine Learning such as adversarial robustness or catastrophic forgetting.

Selected Publications [Full List]


  1. DRONE: Data-aware Low-rank Compression for Large NLP Models
    Patrick H. Chen, Hsiang-fu Yu, Inderjit S. Dhillon, and Cho-jui, Hsieh
    In Advances in Neural Information Processing Systems (NeurIPS), 2021
  1. GroupReduce: Block-Wise Low-Rank Approximation for Neural Language Model Shrinking
    Patrick H. Chen, Si Si, Yang Li, Ciprian Chelba and Cho-jui, Hsieh
    In Advances in Neural Information Processing Systems (NeurIPS), 2018
  1. Overcoming Catastrophic Forgetting by Bayesian Generative Regularization
    Patrick H. Chen, Wei Wei, Cho-jui, Hsieh, and Bo Dai
    In Conference of Machine Learning (ICML), 2021