ALGORITHM · ARCHITECTURE · SYSTEMS

Efficient AI, from models to machines.

I design efficient systems for emerging AI through algorithm, software, and hardware co-design—from low-bit inference to accelerators for emerging ML workloads and brain-inspired computing.

01 / EFFICIENT LLM INFERENCE

Scalable low-bit ML on everyday processors

Large models quickly become memory- and compute-bound at the edge. I develop end-to-end quantization frameworks, CUDA/CPU kernels, and small architectural extensions that make fine-grained low-bit execution practical on general-purpose CPUs.

T-SAR comparison of memory-based LUT execution and in-register LUT generation
T-SAR · Memory LUTs versus on-the-fly generation in SIMD registersPaper ↗
PolyQ motivation comparing uniform and fine-grained channel-wise quantization
PolyQ · Fine-grained precision fits fractional edge-memory budgets

Methods & keywords

  • Mixed-precision
  • Low-bit quantization
  • CPU SIMD
  • In-register computing
  • Compiler co-design
  • Edge LLMs

Related papers

View all publications

2026

  1. PolyQ: Codesigning End-to-End Quantization Framework for Scalable Edge CPU LLM Inference
    Hyunwoo Oh, Suyeon Jang, Hanning Chen, KyungIn Nam, Sanggeon Yun, Ryozo Masukawa, and Mohsen Imani
    ICCAD 2026 PolyQ: Codesigning End-to-End Quantization Framework for Scalable Edge CPU LLM Inference, Hyunwoo Oh et al.
    IEEE/ACM International Conference on Computer-Aided Design (ICCAD), San Jose, CA, USA, Nov 2026, pp. 1–9
    Accepted
  2. ExaGEMM: Exploration Framework for CPU-Driven ML Inference via Associative In-Register Computing for Low-Bit GEMM
    Hyunwoo Oh, Suyeon Jang, Hanning Chen, Sanggeon Yun, Ryozo Masukawa, and Mohsen Imani
    ICCAD 2026 ExaGEMM: Exploration Framework for CPU-Driven ML Inference via Associative In-Register Computing for Low-Bit GEMM, Hyunwoo Oh et al.
    IEEE/ACM International Conference on Computer-Aided Design (ICCAD), San Jose, CA, USA, Nov 2026, pp. 1–9
    Accepted
  3. T-SAR: A Full-Stack Co-design for CPU-Only Ternary LLM Inference via In-Place SIMD ALU Reorganization
    Hyunwoo Oh, KyungIn Nam, Rajat Bhattacharjya, Hanning Chen, Tamoghno Das, Sanggeon Yun, Suyeon Jang, Andrew Ding, Nikil Dutt, and Mohsen Imani
    DATE 2026 T-SAR: A Full-Stack Co-design for CPU-Only Ternary LLM Inference via In-Place SIMD ALU Reorganization, Hyunwoo Oh et al.
    Design, Automation and Test in Europe Conference (DATE), Verona, Italy, Apr 2026, pp. 1–7

02 / EMERGING ML ACCELERATORS

Accelerators for emerging ML workloads

Emerging ML workloads expose bottlenecks that conventional hardware handles poorly. I turn their compute, memory, and dataflow characteristics into specialized accelerators, carrying each design from algorithm and architecture co-design through implementation and end-to-end evaluation across vision, language, graph, and multimodal AI.

QUILL analysis of cache-locality, arithmetic-intensity, and bank-conflict bottlenecks in deformable attention
QUILL · The three bottlenecks: scattered access, low arithmetic intensity, and bank conflictsPaper ↗
QUILL cache-local deformable attention accelerator overview
QUILL · Mitigation through query reordering, caching, and fused executionPaper ↗

Methods & keywords

  • ML acceleration
  • Domain-specific architectures
  • Reconfigurable computing
  • Memory systems
  • Hardware–software co-design
  • Edge AI

Related papers

View all publications

2026

  1. DAC
    TRINE runtime-adaptive multimodal accelerator architecture
    TRINE: A Token-Aware, Runtime-Adaptive FPGA Inference Engine for Multimodal AI
    Hyunwoo Oh, Hanning Chen, Sanggeon Yun, Yang Ni, Suyeon Jang, Behnam Khaleghi, Fei Wen, and Mohsen Imani
    DAC 2026 TRINE: A Token-Aware, Runtime-Adaptive FPGA Inference Engine for Multimodal AI, Hyunwoo Oh et al.
    ACM/IEEE Design Automation Conference (DAC), Long Beach, CA, USA, Jul 2026, pp. 1–7
    Accepted
  2. QUILL: An Algorithm-Architecture Co-Design for Cache-Local Deformable Attention
    Hyunwoo Oh, Hanning Chen, Sanggeon Yun, Yang Ni, Wenjun Huang, Tamoghno Das, Suyeon Jang, and Mohsen Imani
    DATE 2026 QUILL: An Algorithm-Architecture Co-Design for Cache-Local Deformable Attention, Hyunwoo Oh et al.
    Design, Automation and Test in Europe Conference (DATE), Verona, Italy, Apr 2026, pp. 1–7
  3. RIFT: A Single-Bitstream, Runtime-Adaptive FPGA-Based Accelerator for Multimodal AI
    Hyunwoo Oh, KyungIn Nam, Rajat Bhattacharjya, Hanning Chen, Tamoghno Das, Sanggeon Yun, Suyeon Jang, Andrew Ding, Nikil Dutt, and Mohsen Imani
    DATE 2026 RIFT: A Single-Bitstream, Runtime-Adaptive FPGA-Based Accelerator for Multimodal AI, Hyunwoo Oh et al.
    Design, Automation and Test in Europe Conference (DATE), Verona, Italy, Apr 2026, pp. 1–3

2025

  1. A Multimodal AI Acceleration with Dynamic Pruning and Run-time Configuration
    Hyun Woo Oh, Hanning Chen, Sanggeon Yun, Yang Ni, Behnam Khaleghi, Fei Wen, and Mohsen Imani
    FCCM 2025 A Multimodal AI Acceleration with Dynamic Pruning and Run-time Configuration, Hyun Woo Oh et al.
    IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM), Fayetteville, AR, USA, May 2025

03 / BRAIN-INSPIRED COMPUTING

Brain-inspired learning and reasoning

Hyperdimensional computing represents information with distributed high-dimensional vectors, enabling noise-tolerant learning and reasoning. I codesign these representations with cache-oriented and memory-aware architectures for efficient perception and decisions.

TorR end-to-end brain-inspired object detection training and inference framework
TorR · End-to-end training and inference frameworkPaper ↗
TorR cache-gated associative aligner and HDC graph reasoner
TorR · Cache-gated HDC aligner and graph reasonerPaper ↗

Methods & keywords

  • Hyperdimensional computing
  • Associative memory
  • Partial-similarity reuse
  • Robust learning
  • Reasoning

Related papers

View all publications

2026

  1. DAC
    TorR brain-inspired object detection and reasoning framework
    TorR: Towards Brain-Inspired Task-Oriented Reasoning via Cache-Oriented Algorithm-Architecture Co-design
    Hyunwoo Oh, SungHeon Jeong, Suyeon Jang, Hanning Chen, Sanggeon Yun, Tamoghno Das, and Mohsen Imani
    DAC 2026 TorR: Towards Brain-Inspired Task-Oriented Reasoning via Cache-Oriented Algorithm-Architecture Co-design, Hyunwoo Oh et al.
    ACM/IEEE Design Automation Conference (DAC), Long Beach, CA, USA, Jul 2026, pp. 1–7
    Accepted
  2. HYPERDOA: Robust and Efficient DoA Estimation Using Hyperdimensional Computing
    Rajat Bhattacharjya, Woohyeok Park, Arnab Sarkar, Hyunwoo Oh, Mohsen Imani, and Nikil Dutt
    ICASSP 2026 HYPERDOA: Robust and Efficient DoA Estimation Using Hyperdimensional Computing, Rajat Bhattacharjya, Woohyeok Park, Arnab Sarkar, Hyunwoo Oh et al.
    IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, May 2026, pp. 20841-20845
  3. DecoHD: Decomposed Hyperdimensional Classification under Extreme Memory Budgets
    Sanggeon Yun, Hyunwoo Oh, Ryozo Masukawa, and Mohsen Imani
    DATE 2026 DecoHD: Decomposed Hyperdimensional Classification under Extreme Memory Budgets, Sanggeon Yun, Hyunwoo Oh et al.
    Design, Automation and Test in Europe Conference (DATE), Verona, Italy, Apr 2026, pp. 1–7
  4. LogHD: Robust Compression of Hyperdimensional Classifiers via Logarithmic Class-Axis Reduction
    Sanggeon Yun, Hyunwoo Oh, Ryozo Masukawa, Pietro Mercati, Nathaniel D Bastian, and Mohsen Imani
    DATE 2026 LogHD: Robust Compression of Hyperdimensional Classifiers via Logarithmic Class-Axis Reduction, Sanggeon Yun, Hyunwoo Oh et al.
    Design, Automation and Test in Europe Conference (DATE), Verona, Italy, Apr 2026, pp. 1–7

ACROSS THE STACK

From model transformations to RTL and real systems.

My goal is to make ambitious AI workloads deployable under real constraints—not only faster in isolation, but efficient end to end.

Browse all publications