Taehyeon Kim
M.S. Student
Logo Pohang University of Science and Technology (POSTECH)

I am an M.S. student at Efficient Computing Lab and Machine Learning Lab at POSTECH.

I am currently working on large model optimization, advised by Eunhyeok Park. My recent research interests include developing more effective methods for Parameter-Efficient Fine-Tuning (PEFT), as well as improving the efficiency of large model inference. More broadly, I am interested in understanding and exploiting low-dimensional structures in large language models to make both training and inference more efficient. I am particularly interested in methods that reduce computational and memory costs while preserving model performance.


News
2026
Two papers are accepted to EMNLP 2026 Main Conference! 🎉
Aug 21
I've been selected as LG Electronics Academic Scholar.
Jul 13
2025
I've started my M.S. program at POSTECH.
Jan 20
Selected Publications (view all )
TaRA: Training-Aware Low-Rank Adaptation Initialization
TaRA: Training-Aware Low-Rank Adaptation Initialization

Taehyeon Kim, Eunhyeok Park

The Conference on Empirical Methods in Natural Language Processing (EMNLP) 2026 Accepted

TaRA is a training-aware LoRA initialization that matches combined low-rank adapter gradients to full-rank gradients, improving optimization and consistently outperforming prior SVD-based initializations with minimal overhead.

TaRA: Training-Aware Low-Rank Adaptation Initialization

Taehyeon Kim, Eunhyeok Park

The Conference on Empirical Methods in Natural Language Processing (EMNLP) 2026 Accepted

TaRA is a training-aware LoRA initialization that matches combined low-rank adapter gradients to full-rank gradients, improving optimization and consistently outperforming prior SVD-based initializations with minimal overhead.

MOB-KV: Mixture-of-Basis for Key-Value Cache Compression
MOB-KV: Mixture-of-Basis for Key-Value Cache Compression

Jinseop Yeom*, Taehyeon Kim*, Eunhyeok Park (* equal contribution)

The Conference on Empirical Methods in Natural Language Processing (EMNLP) 2026 Accepted

MOB-KV makes adaptive low-rank KV cache compression practical by replacing costly online SVD with offline key bases, combining low-rank key compression and value quantization for strong memory-accuracy-latency trade-offs.

MOB-KV: Mixture-of-Basis for Key-Value Cache Compression

Jinseop Yeom*, Taehyeon Kim*, Eunhyeok Park (* equal contribution)

The Conference on Empirical Methods in Natural Language Processing (EMNLP) 2026 Accepted

MOB-KV makes adaptive low-rank KV cache compression practical by replacing costly online SVD with offline key bases, combining low-rank key compression and value quantization for strong memory-accuracy-latency trade-offs.

All publications
Education
  • Pohang University of Science and Technology (POSTECH)
    Pohang University of Science and Technology (POSTECH)
    Department of Computer Science and Engineering
    M.S. Student
    Jan. 2025 - present
  • Chungnam National University (CNU)
    Chungnam National University (CNU)
    B.S. in Computer Science and Engineering
    GPA: 4.33/4.5 (major: 4.4/4.5)
    Mar. 2021 - Feb. 2025
Honors & Awards
  • LG Electronics Academic Scholarship
    Fall 2026
  • Academic Excellence Full Scholarship, by CNU
    Entire semester (Fall 2021 - Spring 2024)
Teaching
  • TA: Implem. & Accel. ML (CSED510, AIGS510)
    Spring 2026