SCU CoAI Lab
SCU CoAI Lab
Research
Publications
Teaching
People
Contact
LLM
oFFN: Outlier and Neuron-aware Structured FFN for Fast yet Accurate LLM Inference
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Duis posuere tellus ac convallis placerat. Proin tincidunt magna sed ex sollicitudin condimentum.
Geunsoo Song
,
Hoeseok Yang
,
Youngmin Yi
Cite
DOI
ACM Digital Library
Accelerating Retrieval Augmented Language Model via PIM and PNM Integration
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Duis posuere tellus ac convallis placerat. Proin tincidunt magna sed ex sollicitudin condimentum.
Je-Woo Jang
,
Junyong Oh
,
Youngbae Kong
,
Jae-Youn Hong
,
Sung-Hyuk Cho
,
Jeongyeol Lee
,
Hoeseok Yang
,
Joon-Sung Yang
PDF
Cite
DOI
ACM Digital Library
Grasp: Group-based Prediction of Activation Sparsity for Fast LLM Inference
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Duis posuere tellus ac convallis placerat. Proin tincidunt magna sed ex sollicitudin condimentum.
Jiho Shin
,
Hoeseok Yang
,
Youngmin Yi
Cite
DOI
IEEE Xplore
SparseInfer: Training-free Prediction of Activation Sparsity for Fast LLM Inference
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Duis posuere tellus ac convallis placerat. Proin tincidunt magna sed ex sollicitudin condimentum.
Jiho Shin
,
Hoeseok Yang
,
Youngmin Yi
Cite
DOI
IEEE Xplore
Cite
×