Hi, I'm Donghyeon Joo
Researching the Intersection of LLM Sparsity and Compute Efficiency
I am a fourth year Ph.D. Student in University of Maryland, College Park, advised by Professor Bahar Asgari in Computer Architecture and Systems Lab (CASL).
Research Focus
- • ML Level: Deriving sparsity in weights and KV cache to preserve model accuracy at high sparsity
- • System Level: GPU kernel support for sparse LLMs on existing compute platforms
- • Architecture Level: Novel architectural changes to better support sparsity and improve efficiency
- • Efforts in LLM reasoning, dynamically reconfigurable architecture, and RAG
Publications
⭐ I am a huge Star Wars fan, on a personal mission to name my papers with memorable planet names from the prequel/original trilogy ⭐
Conference Papers
🔥 MUSTAFAR: Promoting Unstructured Sparsity for KV Cache Pruning in LLM Inference
Authors: Donghyeon Joo, Helya Hosseini, Ramyad Hadidi, Bahar Asgari
NeurIPS 2025
PaperCodePosterSlidesRecording
"Where Obi-wan had the high ground"
🌃 CORUSCANT: Co-Designing GPU Kernel and Sparse Tensor Core to Advocate Unstructured Sparsity in Efficient LLM Inference
Authors: Donghyeon Joo, Helya Hosseini, Ramyad Hadidi, Bahar Asgari
MICRO 2025
PaperCodePosterSlidesRecording
"Where Palpatine WAS the senate"
PIPIRIMA: Predicting Patterns in Sparsity to Accelerate Matrix Algebra
Authors: Ubaid Bakhtiar, Donghyeon Joo, Bahar Asgari
DAC 2025
Journal Papers
SEGIN: Synergistically Enabling Fine-Grained Multi-Tenant and Resource Optimized SpMV
Authors: Helya Hosseini, Ubaid Bakhtiar, Donghyeon Joo, Bahar Asgari
CAL 2025
Preprints
🖥️ Characterizing LLM Kernel Access and Memory Interaction in Multi-Partition NUMA GPUs
Authors: Donghyeon Joo, Sooraj Puthoor, Nuwan Jayasena, Bahar Asgari
🪴 ENDOR: Hardware-Friendly Sparse Format for Offloaded LLM Inference
Authors: Donghyeon Joo, Ramyad Hadidi, Soheil Feizi, Bahar Asgari
"Where Ewoks were really cute"
Education
University of Maryland, College Park
Ph.D. Student in Computer Science
2023/Aug. – Present
Korea University
Bachelor of Engineering in Electrical Engineering
2017/Mar. – 2023/Feb.
Work Experience
Apple
Seattle, WA, USA
Position: AIML Intern, Apple Foundation Model Team
Mentor: Dongseong Hwang
Manager: Dr. Chung-Cheng Chiu
2026/May – 2026/Aug.
Developed efficient attention algorithms for long-context foundation models.
AMD
Austin, TX, USA
Position: Research Associate
Manager: Dr. Nuwan Jayasena
Mentor: Dr. Sooraj Puthoor
2025/Sep. – 2025/Dec.
Explored AMD GPU architecture design space for efficient AI/ML workloads.
SK Hynix America
San Jose, CA, USA
Position: AI Memory System Research Intern
Director: Dr. Jongryool Kim
2024/Jun. – 2024/Aug.
Investigated next-generation memory architecture designs to accelerate LLM inference.
Professional Service
IEEE Micro 2025
Reviewer
MLSys 2026
External Reviewer
IEEE Micro 2026
Reviewer
NeurIPS 2026
Reviewer
HPCA 2027
Reviewer
TACO 2026
Reviewer
