About Me
I’m a M.S. student at Machine Learning and Artificial Intelligence (MLAI) lab in UOS/Yonsei, under the supervision of Prof. Jiyoung Jung (adviser) and Prof. Kyungwoo Song (co-adviser). Currently, I’m studying at Carnegie Mellon University as a visiting scholar.
For real-world AI applications, I think robustness, reliability, and multimodality are crucial to our intelligence system. To this end, I’ve been working on a robust adaptation of foundation models, multimodal representation learning, and model debiasing & calibration. Topics of interest:
- Robust and Efficient Adaptation of Foundation Models
- Debiased Representation Learning
- Multimodal Learning
News
Oct. 2023. One paper accepted to NeurIPS 2023 Workshop DistShift
Sep. 2023. One paper accepted to NeurIPS 2023
Jun. 2023. One paper accepted to IEEE Access
Mar. 2023. Selected as a Carnegie Mellon University AI Intensive Program Scholarship Recipient (Visiting Scholar, Aug 2023 ~ Feb 2024)
Feb. 2023. One paper accepted to CVPR 2023
Feb. 2023. Outstanding paper award (1st place) at University of Seoul
May. 2022. One paper accepted to KDD 2022
Education
M.S. in Artificial Intelligence, University of Seoul (UOS)
Mar. 2022 - Aug. 2024 (expected)B.S. in Statistics, University of Seoul (UOS)
Mar. 2016 - Feb. 2022
Publication (International)
(conference, journal)
Towards Calibrated Robust Fine-Tuning of Vision-Language Models
Changdae Oh, Mijoo Kim, Hyesu Lim, Junhyeok Park, Euiseog Jeong, Zhi-Qi Cheng, Kyungwoo Song
[paper]
NeurIPS 2023 Workshop, DistShiftGeodesic Multi-Modal Mixup for Robust Fine-tuning
Changdae Oh*, Junhyuk So*, YongTaek Lim, Hoyoon Byun, Minchul Shin, Jong-June Jeon, Kyungwoo Song
[paper] [code]
NeurIPS 2023Robust Contrastive Learning with Dynamic Mixed Margin
[paper] [code]
Junhyuk So*, YongTaek Lim*, Yewon Kim*, Changdae Oh, Kyungwoo Song
IEEE Access 2023BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning
[paper] [code]
Changdae Oh, Hyeji Hwang, Hee-young Lee, YongTaek Lim, Geunyoung Jung, Jiyoung Jung, Hosik Choi, Kyungwoo Song
CVPR 2023Learning Fair Representation via Distributional Contrastive Disentanglement
[paper] [code]
Changdae Oh, Heeji Won, Junhyuk So, Taero Kim, Yewon Kim, Hosik Choi, Kyungwoo Song
KDD 2022
Publication (Domestic)
- Pre-trained Models Ensembling for Domain Generalization in Chemistry Classification
Jinho Kang, Taero Kim, Yewon Kim, Changdae Oh, Jiyoung Jung, Rakwoo Chang, Kyungwoo Song
CKAIA 2023
Preprints
Language Model-guided Student Performance Prediction with Multimodal Auxiliary Information
Changdae Oh, Minhoi Park, Sungjun Lim, Kyungwoo SongBibimbap: Pre-trained Models Ensemble for Domain Generalization
Jinho Kang, Taero Kim, Yewon Kim, Changdae Oh, Jiyoung Jung, Rakwoo Chang, Kyungwoo SongMultimodal Learning for Social Event Analysis
Changdae Oh, Hoyoon Byun, Minhoi Park, YongTaek Lim, Neil Kim, Kyungwoo SongInterpolation-based Training-free Out-of-distribution Detection
Hee-young Lee*, Hoyoon Byun*, Changdae Oh, Kyungwoo SongTC-BERT: Large-scale Language Model for Korean Technology Documents
[paper]
Hyeji Hwang*, Changdae Oh*, Eunkyeong Lee, Taero Kim, Yewon Kim, Yunjeong Choi, Sungjin Kim, Hosik Choi, Kyungwoo SongMulti-purpose Technology Commercialization Recommender System with Large-scale Korean Language Model
Hyeji Hwang*, YongTaek Lim*, Changdae Oh*, Seungyeon Kim, Eunkyeong Lee, Yunjeong Choi, Sungjin Kim, Hosik Choi, Kyungwoo SongGraph Perceiver IO: A General Architecture for Graph Structured Data
[paper]
Seyun Bae, Hoyoon Byun, Changdae Oh, Yoon-Sik Cho, Kyungwoo Song
(* equal contribution)
Projects
Carnegie Mellon University
- Robust Fine-Tuning of Visual Foundation Models
- Large-Scale Multimedia Analysis 11-775 2023f Course Project, Sep. 2023 - Present
- related papers: Towards Calibrated Robust Fine-Tuning of Vision-Language Models (NeurIPS 2023 Workshop DistShift)
- Revisiting Multimodal Neuron Analysis
- Introduction to Deep Learning 11-785 2023f Course Project, Sep. 2023 - Present
University of Seoul
- Education Contents Relationship Analysis with Multimodal Learning
- TIPS, Dec. 2022 - Aug. 2023
- related papers: Language Model-guided Student Performance Prediction with Multimodal Auxiliary Information (preprint)
- Multimodal Learning for Social Event Analysis
- HUSTLERS Corp., Oct. 2022 - Dec. 2022
- related papers: Multimodal Learning for Social Event Analysis (preprint)
- Multi-purpose Technology Commercialization Documents Recommendation
- KISTI, Mar. 2022 - Nov. 2022
- related papers: Multi-purpose Technology Commercialization Recommender System with Large-scale Korean Language Model (preprint)
- Epidemiological Relevance Evaluation Technology for Vaccination Reactions
- Ministry of Food and Drug Safety, Mar. 2022 - Aug. 2023
- Keyword Extraction for Technology Commercialization Documents
- KISTI, June. 2021 - Oct. 2021
- related papers: TC-BERT: Large-scale Language Model for Korean Technology Documents (preprint)
Awards & Scholarships
- DEI Scholarship Travel Awards, CVPR, Apr. 2023
- (Scholarship; USD 41K) AI Intensive Program at Carnegie Mellon University, IITP and Sogang University, Mar. 2023
- (1st place) Outstanding Paper Award, President’s prize, University of Seoul, Feb. 2023
- (2nd place) Presentation Award, Workshop on Data-Driven Chemicals Management, University of Seoul, Feb. 2023
- Student Travel Awards, KDD, Jul. 2022
- Academic Excellence Scholarship (half-tuition), University of Seoul, Feb. 2021
- Academic Excellence Scholarship (half-tuition), University of Seoul, Aug. 2020
Academic Services
- KDD Student Volunteer, 2022