About Me

I’m a M.S. student at Machine Learning and Artificial Intelligence (MLAI) lab in UOS/Yonsei, under the supervision of Prof. Jiyoung Jung (adviser) and Prof. Kyungwoo Song (co-adviser). Currently, I’m studying at Carnegie Mellon University as a visiting scholar.

For real-world AI applications, I think robustness, reliability, and multimodality are crucial to our intelligence system. To this end, I’ve been working on a robust adaptation of foundation models, multimodal representation learning, and model debiasing & calibration. Topics of interest:

  • Robust and Efficient Adaptation of Foundation Models
  • Debiased Representation Learning
  • Multimodal Learning

News

Oct. 2023. One paper accepted to NeurIPS 2023 Workshop DistShift
Sep. 2023. One paper accepted to NeurIPS 2023
Jun. 2023. One paper accepted to IEEE Access
Mar. 2023. Selected as a Carnegie Mellon University AI Intensive Program Scholarship Recipient (Visiting Scholar, Aug 2023 ~ Feb 2024)
Feb. 2023. One paper accepted to CVPR 2023
Feb. 2023. Outstanding paper award (1st place) at University of Seoul
May. 2022. One paper accepted to KDD 2022

Education

Publication (International)

(conference, journal)

  • Towards Calibrated Robust Fine-Tuning of Vision-Language Models
    Changdae Oh, Mijoo Kim, Hyesu Lim, Junhyeok Park, Euiseog Jeong, Zhi-Qi Cheng, Kyungwoo Song
    [paper]
    NeurIPS 2023 Workshop, DistShift

  • Geodesic Multi-Modal Mixup for Robust Fine-tuning
    Changdae Oh*, Junhyuk So*, YongTaek Lim, Hoyoon Byun, Minchul Shin, Jong-June Jeon, Kyungwoo Song
    [paper] [code]
    NeurIPS 2023

  • Robust Contrastive Learning with Dynamic Mixed Margin
    [paper] [code]
    Junhyuk So*, YongTaek Lim*, Yewon Kim*, Changdae Oh, Kyungwoo Song
    IEEE Access 2023

  • BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning
    [paper] [code]
    Changdae Oh, Hyeji Hwang, Hee-young Lee, YongTaek Lim, Geunyoung Jung, Jiyoung Jung, Hosik Choi, Kyungwoo Song
    CVPR 2023

  • Learning Fair Representation via Distributional Contrastive Disentanglement
    [paper] [code]
    Changdae Oh, Heeji Won, Junhyuk So, Taero Kim, Yewon Kim, Hosik Choi, Kyungwoo Song
    KDD 2022

Publication (Domestic)

  • Pre-trained Models Ensembling for Domain Generalization in Chemistry Classification
    Jinho Kang, Taero Kim, Yewon Kim, Changdae Oh, Jiyoung Jung, Rakwoo Chang, Kyungwoo Song
    CKAIA 2023

Preprints

  • Language Model-guided Student Performance Prediction with Multimodal Auxiliary Information
    Changdae Oh, Minhoi Park, Sungjun Lim, Kyungwoo Song

  • Bibimbap: Pre-trained Models Ensemble for Domain Generalization
    Jinho Kang, Taero Kim, Yewon Kim, Changdae Oh, Jiyoung Jung, Rakwoo Chang, Kyungwoo Song

  • Multimodal Learning for Social Event Analysis
    Changdae Oh, Hoyoon Byun, Minhoi Park, YongTaek Lim, Neil Kim, Kyungwoo Song

  • Interpolation-based Training-free Out-of-distribution Detection
    Hee-young Lee*, Hoyoon Byun*, Changdae Oh, Kyungwoo Song

  • TC-BERT: Large-scale Language Model for Korean Technology Documents
    [paper]
    Hyeji Hwang*, Changdae Oh*, Eunkyeong Lee, Taero Kim, Yewon Kim, Yunjeong Choi, Sungjin Kim, Hosik Choi, Kyungwoo Song

  • Multi-purpose Technology Commercialization Recommender System with Large-scale Korean Language Model
    Hyeji Hwang*, YongTaek Lim*, Changdae Oh*, Seungyeon Kim, Eunkyeong Lee, Yunjeong Choi, Sungjin Kim, Hosik Choi, Kyungwoo Song

  • Graph Perceiver IO: A General Architecture for Graph Structured Data
    [paper]
    Seyun Bae, Hoyoon Byun, Changdae Oh, Yoon-Sik Cho, Kyungwoo Song

(* equal contribution)

Projects

Carnegie Mellon University

University of Seoul

  • Education Contents Relationship Analysis with Multimodal Learning
    • TIPS, Dec. 2022 - Aug. 2023
    • related papers: Language Model-guided Student Performance Prediction with Multimodal Auxiliary Information (preprint)
  • Multimodal Learning for Social Event Analysis
    • HUSTLERS Corp., Oct. 2022 - Dec. 2022
    • related papers: Multimodal Learning for Social Event Analysis (preprint)
  • Multi-purpose Technology Commercialization Documents Recommendation
    • KISTI, Mar. 2022 - Nov. 2022
    • related papers: Multi-purpose Technology Commercialization Recommender System with Large-scale Korean Language Model (preprint)
  • Epidemiological Relevance Evaluation Technology for Vaccination Reactions
  • Keyword Extraction for Technology Commercialization Documents
    • KISTI, June. 2021 - Oct. 2021
    • related papers: TC-BERT: Large-scale Language Model for Korean Technology Documents (preprint)

Awards & Scholarships

  • DEI Scholarship Travel Awards, CVPR, Apr. 2023
  • (Scholarship; USD 41K) AI Intensive Program at Carnegie Mellon University, IITP and Sogang University, Mar. 2023
  • (1st place) Outstanding Paper Award, President’s prize, University of Seoul, Feb. 2023
  • (2nd place) Presentation Award, Workshop on Data-Driven Chemicals Management, University of Seoul, Feb. 2023
  • Student Travel Awards, KDD, Jul. 2022
  • Academic Excellence Scholarship (half-tuition), University of Seoul, Feb. 2021
  • Academic Excellence Scholarship (half-tuition), University of Seoul, Aug. 2020

Academic Services

  • KDD Student Volunteer, 2022