Hi, I'm Donghyeon Joo

Researching the Intersection of LLM Sparsity and Compute Efficiency

I am a fourth year Ph.D. Student in University of Maryland, College Park, advised by Professor Bahar Asgari in Computer Architecture and Systems Lab (CASL).

Research Focus

  • ML Level: Deriving sparsity in weights and KV cache to preserve model accuracy at high sparsity
  • System Level: GPU kernel support for sparse LLMs on existing compute platforms
  • Architecture Level: Novel architectural changes to better support sparsity and improve efficiency
  • Efforts in LLM reasoning, dynamically reconfigurable architecture, and RAG

Publications

I am a huge Star Wars fan, on a personal mission to name my papers with memorable planet names from the prequel/original trilogy

Conference Papers

🔥 MUSTAFAR: Promoting Unstructured Sparsity for KV Cache Pruning in LLM Inference

Authors: Donghyeon Joo, Helya Hosseini, Ramyad Hadidi, Bahar Asgari

NeurIPS 2025

PaperCodePosterSlidesRecording

"Where Obi-wan had the high ground"

🌃 CORUSCANT: Co-Designing GPU Kernel and Sparse Tensor Core to Advocate Unstructured Sparsity in Efficient LLM Inference

Authors: Donghyeon Joo, Helya Hosseini, Ramyad Hadidi, Bahar Asgari

MICRO 2025

PaperCodePosterSlidesRecording

"Where Palpatine WAS the senate"

PIPIRIMA: Predicting Patterns in Sparsity to Accelerate Matrix Algebra

Authors: Ubaid Bakhtiar, Donghyeon Joo, Bahar Asgari

DAC 2025

Journal Papers

SEGIN: Synergistically Enabling Fine-Grained Multi-Tenant and Resource Optimized SpMV

Authors: Helya Hosseini, Ubaid Bakhtiar, Donghyeon Joo, Bahar Asgari

CAL 2025

Preprints

🖥️ Characterizing LLM Kernel Access and Memory Interaction in Multi-Partition NUMA GPUs

Authors: Donghyeon Joo, Sooraj Puthoor, Nuwan Jayasena, Bahar Asgari

Paper

🪴 ENDOR: Hardware-Friendly Sparse Format for Offloaded LLM Inference

Authors: Donghyeon Joo, Ramyad Hadidi, Soheil Feizi, Bahar Asgari

Paper

"Where Ewoks were really cute"


Education

University of Maryland, College Park

Ph.D. Student in Computer Science

2023/Aug. – Present

Korea University

Bachelor of Engineering in Electrical Engineering

2017/Mar. – 2023/Feb.


Work Experience

🍎

Apple

Seattle, WA, USA

Position: AIML Intern, Apple Foundation Model Team

Mentor: Dongseong Hwang

Manager: Dr. Chung-Cheng Chiu

2026/May – 2026/Aug.

Developed efficient attention algorithms for long-context foundation models.

🔬

AMD

Austin, TX, USA

Position: Research Associate

Manager: Dr. Nuwan Jayasena

Mentor: Dr. Sooraj Puthoor

2025/Sep. – 2025/Dec.

Explored AMD GPU architecture design space for efficient AI/ML workloads.

🏢

SK Hynix America

San Jose, CA, USA

Position: AI Memory System Research Intern

Director: Dr. Jongryool Kim

2024/Jun. – 2024/Aug.

Investigated next-generation memory architecture designs to accelerate LLM inference.


Professional Service

IEEE Micro 2025

Reviewer

MLSys 2026

External Reviewer

IEEE Micro 2026

Reviewer

NeurIPS 2026

Reviewer

HPCA 2027

Reviewer

TACO 2026

Reviewer