Peer Reviewed Conferences and Journals

2026

FBLayout: Optimizing Memory Layout for Efficient LLM Finetuning on Mobile GPUs

Kahou Tam, Wei Niu, Yu bao, Xiaomin Ouyang, ChengZhong Xu, Li Li

ACM International Conference on Mobile Systems, Applications, and Services, 2026 [MobiSys'26 ]

Structured Agent Distillation for Large Language Model Agents

J. Liu, Z. Kong, P. Dong, C. Yang, T. Li, Y. Xie, Y. Gong, X. Shen, P. Zhao, H. Tang, G. Yuan, W. Niu, W. Zhang, X. Lin, D. Huang, Y. Wang

International Conference on Autonomous Agents and Multiagent Systems, 2026 [AAMAS'26 ]

FlashMem: Supporting Modern DNN Workloads on Mobile with GPU Memory Hierarchy Optimizations

Zhihao Shu, Md Musfiqur Rahman Sanim, Hangyu Zheng, Kunxiong Zhu, Miao Yin, Gagan Agrawal, Wei Niu

International Conference on Architectural Support for Programming Languages and Operating Systems, 2026 [ASPLOS'26 ]

MetaBreak: Jailbreaking Online LLM Services via Special Token Manipulation

Wentian Zhu, Zhen Xiang, Wei Niu, Le Guan

IEEE Symposium on Security and Privacy, 2026 [S&P'26 ]

2025

Optimizing 3D Gaussian Splattering for Mobile GPUs

Md Musfiqur Rahman Sanim, Zhihao Shu, Bahram Afsharmanesh, AmirAli Mirian, Jiexiong Guan, Wei Niu, Bin Ren, Gagan Agrawal

Parallel Architectures and Compilation Techniques [PACT'25]

Mobile-3DCNN: An Acceleration Framework for Ultra-Real-Time Execution of Large 3D CNNs on Mobile Devices

W. Niu, M. Sun, Z. Li, Jou-an Chen, J. Guan, X. Shen, J. Liu, M. Zhang, Y. Wang, X. Lin, B. Ren

Transactions on Architecture and Code Optimization [TACO'25]

NeurLZ: An Online Neural Learning-based Method to Enhance Scientific Lossy Compression

W. Jia, Z. Hu, Y. Liu, B. Zhang, J. Wang, J. Liu, W. Niu, S. Kalafatis, J. Huang, S. Jin, D. Wang, J. Tian, M. Yin

ACM International Conference on Supercomputing 2025 [ICS'25]

AdaCM²: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction

Yuanbin Man, Ying Huang, Chengming Zhang, Bingzhe Li, Wei Niu, Miao Yin

2025 Conference on Computer Vision and Pattern Recognition [CVPR'25]

GaussianSpa: An “Optimizing-Sparsifying” Simplification Framework for Compact and High-Quality 3D Gaussian Splatting

Yangming Zhang, Wenqi Jia, Wei Niu, Miao Yin

2025 Conference on Computer Vision and Pattern Recognition [CVPR'25]

QuartDepth: Post-Training Quantization for Real-Time Depth Estimation on the Edge

X. Shen, W. Ma, J. Liu, C. Yang, R. Ding, Q. Wang, H. Ding, W. Niu, Y. Wang, P. Zhao, J. Lin, J. Gu

2025 Conference on Computer Vision and Pattern Recognition [CVPR'25]

Sparse Learning for State Space Models on Mobile

X. Shen*, H. Zheng*, Y. Gong, Z. Kong, C. Yang, Z. Zhan, Y. Wu, X. Lin, Y. Wang, P. Zhao, W. Niu

The 13th International Conference on Learning Representations [ICLR'25]

RoRA: Efficient Fine-Tuning of LLM with Reliability Optimization for Rank Adaptation

J. Liu, Z. Kong, P. Dong, C. Yang, X. Shen, P. Zhao, H. Tang, G. Yuan, W. Niu, W. Zhang, X. Lin, D. Huang, Y. Wang

International Conference on Acoustics, Speech, and Signal Processing [ICASSP'25]

2024

Toward Adaptive Large Language Models Structured Pruning via Hybrid-grained Weight Importance Assessment

J. Liu, Z. Kong, P. Zhao, C. Yang, X. Shen, H. Tang, G. Yuan, W. Niu, W. Zhang, X. Lin, D. Huang, Y. Wang

The 39th AAAI Conference on Artificial Intelligence [AAAI'25]

LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers

X. Shen, Z. Song, Y. Zhou, B. Chen, Y. Li, Y. Gong, K. Zhang, H. Tan, J. Kuen, H. Ding, Z. Shu, W. Niu, P. Zhao, Y. Wang, J. Gu

The 39th AAAI Conference on Artificial Intelligence [AAAI'25]

TSLA: A Task-Specific Learning Adaptation for Semantic Segmentation on Autonomous Vehicles Platform

J. Liu, Z. Kong, P. Zhao, W. Zeng, H. Tang, X. Shen, C. Yang, W. Zhang, G. Yuan, W. Niu, X. Lin, Y. Wang

IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems [TCAD'25]

Real-time Core-Periphery Guided ViT with Smart Data Layout Selection on Mobile Devices

Zhihao Shu*, Xiaowei Yu*, Zihao Wu, Wenqi Jia, Yinchen Shi, Miao Yin, Tianming Liu, Dajiang Zhu, Wei Niu

The 38th Annual Conference on Neural Information Processing Systems [NeurIPS'24]

Exploring Token Pruning in Vision State Space Models

Z. Zhan, Z. Kong, Y. Gong, Y. Wu, Z. Meng, H. Zheng, X. Shen, S. Ioannidis, W. Niu, P. Zhao, Y. Wang

The 38th Annual Conference on Neural Information Processing Systems [NeurIPS'24]

Fast and Memory-Efficient Video Diffusion Using Streamlined Inference

Z. Zhan, Y. Wu, Y. Gong, Z. Meng, Z. Kong, C. Yang, G. Yuan, P. Zhao, W. Niu, Y. Wang

The 38th Annual Conference on Neural Information Processing Systems [NeurIPS'24]

Towards Recognizing Food Types for Unseen Subjects

Jiexiong Guan, Junjie Wang, Wei Niu, Zhen Peng, Shuangquan Wang, Zhenming Liu, Gang Zhou, Bin Ren

ACM Transactions on Computing for Healthcare [Healthcare'24]

MobiTT: Speed-Oriented DNN Compression for Mobile with Tensor Train Decomposition

Miao Yin, Wei Niu

Workshop on Compute Platforms for Autonomous Vehicles (held with ASPLOS'24) [CAV'24]

SmartMem: Layout Transformation Elimination and Adaptation for Efficient DNN Execution on Mobile

Wei Niu, Md Musfiqur Rahman Sanim, Zhihao Shu, Jiexiong Guan, Xipeng Shen, Miao Yin, Gagan Agrawal, Bin Ren

International Conference on Architectural Support for Programming Languages and Operating Systems [ASPLOS'24 Fall]

NeurRev: Train Better Sparse Neural Network Practically via Neuron Revitalization

Gen Li, Lu Yin, Jie Ji, Wei Niu, Minghai Qin, Bin Ren, Linke Guo, Shiwei Liu, Xiaolong Ma

The Twelfth International Conference on Learning Representations [ICLR'24]

2023

Data Overfitting for On-Device Super-Resolution with Dynamic Algorithm and Compiler Co-Design

Gen Li, Zhihao Shu, Jie Ji, Minghai Qin, Fatemeh Afghah, Wei Niu, Xiaolong Ma

The European Conference on Computer Vision [ECCV'24]

A Scalable Real-time Semantic Segmentation Network for Autonomous Driving

Jun Liu, Chao Wu, Geng Yuan, Wei Niu, Wenbin Zhang, Houbing Herbert Song

Advanced Multimedia Computing for Smart Manufacturing and Engineering [AMC-SME'23]

SoD²: Statically Optimizing Dynamic Deep Neural Network Execution

Wei Niu, Gagan Agrawal, Bin Ren

International Conference on Architectural Support for Programming Languages and Operating Systems [ASPLOS'24 Spring]

Achieving Real-time DNN Execution on Mobile Devices with Compiler Optimizations

Wei Niu

Thesis Thesis

Decentralized Application-Level Adaptive Scheduling for Multi-Instance DNNs on Open Mobile Devices

Hsin-Hsuan Sung, Jiexiong Guan, Wei Niu, Jou-An Chen, Bin Ren, Xipeng Shen

2023 USENIX Annual Technical Conference [USENIX ATC'23]

Pruning Parameterization with Bi-level Optimization for Efficient Semantic Segmentation on the Edge

C. Yang, P. Zhao, Y. Li, W. Niu, J. Guan, H. Tang, M. Qin, B. Ren, X. Lin, Y. Wang

IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023 (acceptance rate: 2360/9155) [CVPR'23]

Towards High-Quality and Efficient Video Super-Resolution via Spatial-Temporal Data Overfitting

Gen Li, Jie Ji, Minghai Qin, Wei Niu, Bin Ren, Fatemeh Afghah, Linke Guo, Xiaolong Ma

IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023 (acceptance rate: 2360/9155) [CVPR'23]

Towards Real-Time Segmentation on the Edge

Y. Li, C. Yang, P. Zhao, G. Yuan, W. Niu, J. Guan, H. Tang, M. Qin, Q. Jin, B. Ren, X. Lin, Y. Wang

The 37th AAAI Conference on Artificial Intelligence [AAAI'23]

2022

SparCL: Sparse Continual Learning on the Edge

Z. Wang, Z. Zhan, Y. Gong, G. Yuan, W. Niu, T. Jian, B. Ren, S. Ioannidis, Y. Wang, J. Dy

The 36th Conference on Neural Information Processing Systems [NeurIPS'22]

Survey: Exploiting Data Redundancy for Optimization of Deep Learning

Jou-An Chen, Wei Niu, Bin Ren, Yanzhi Wang, Xipeng Shen

ACM Computing Surveys [CSUR]

GCD²: A Globally Optimizing Compiler for Mapping DNNs to Mobile DSPs

Wei Niu, Jiexiong Guan, Xipeng Shen, Yanzhi Wang, Gagan Agrawal, Bin Ren

The 55th IEEE/ACM International Symposium on Microarchitecture (Acceptance Rate: 83/369 = 22.5%) [MICRO'22]

Compiler-Aware Neural Architecture Search for On-Mobile Real-time Super-Resolution

Y. Wu, Y. Gong, P. Zhao, Y. Li, Z. Zhan, W. Niu, H. Tang, M. Qin, B. Ren, Y. Wang

Proceeding of European Conference on Computer Vision, 2022 [ECCV'22]

SPViT: Enabling Faster Vision Transformers via Soft Token Pruning

Z. Kong, P. Dong, X. Ma, X. Meng, W. Niu, M. Sun, X. Shen, G. Yuan, B. Ren, M. Qin, H. Tang, Y. Wang

Proceeding of European Conference on Computer Vision, 2022 [ECCV'22]

Automatic Mapping of the Best-Suited DNN Pruning Schemes for Real-Time Mobile Acceleration

Y. Gong, G. Yuan, Z. Zhan, W. Niu, Z. Li, P. Zhao, Y. Cai, S. Liu, B. Ren, X. Lin, X. Tang, Y. Wang

ACM Transactions on Design Automation of Electronic Systems [TDAES'22]

Mobile or FPGA? A Comprehensive Evaluation on Energy Efficiency and a Unified Optimization Framework

G. Yuan, M. Sun, W. Niu, Z. Li, Y. Cai, Y. Li, J. Liu, W. Jiang, X. Lin, B. Ren, X. Tang, Y. Wang

ACM Transactions on Embedded Computing Systems (TECS) [TECS'22]

Brief Industry Paper: Enabling Level-4 Autonomous Driving on a Single $1k Off-the-Shelf Card

Hsin-Hsuan Sung, Yuanchao Xu, Jiexiong Guan, Wei Niu, Yanzhi Wang, Bin Ren, Xipeng Shen

The 28th IEEE Real-Time and Embedded Technology and Applications Symposium - Brief Presentation Track [RTAS'22 BP]

BLCR: Towards Real-time DNN Execution with Block-based Reweighted Pruning

X. Ma, G. Yuan, Z. Li, Y. Gong, T. Zhang, W. Niu, Z. Zhan, P. Zhao, N. Liu, J. Tang, X. Lin, B. Ren, Y. Wang

The 23rd International Symposium on Quality Electronic Design, 2022 [ISQED'22]

2021

MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge

G. Yuan, X. Ma, W. Niu, Z. Li, Z. Kong, N. Liu, Y. Gong, Z. Zhan, C. He, Q. Jin, S. Wang, M. Qin, B. Ren, Y. Wang, S. Liu, X. Lin

The 35th Conference on Neural Information Processing Systems [NeurIPS'21]

HEALS: A Parallel eALS Recommendation System on CPU/GPU Heterogeneous Platforms

Qihan Wang, Wei Niu, Li Chen, Ruoming Jin, Bin Ren

The 28th IEEE International Conference on High Performance Computing, Data, & Analytics, 2021 (Acceptance Rate: 23%) [HiPC'21]

Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search

Z. Zhan, Y. Gong, P. Zhao, G. Yuan, W. Niu, Y. Wu, T. Zhang, M. Jayaweera, D. Kaeli, B. Ren, X. Lin, Y. Wang

International Conference on Computer Vision, 2021 [ICCV'21]

CoCoPIE: Enabling Real-Time AI on Off-the-Shelf Mobile Devices via Compression-Compilation Co-Design

Hui Guan, Shaoshan Liu, Xiaolong Ma, Wei Niu, Bin Ren, Xipeng Shen, Yanzhi Wang, Pu Zhao (author in alphabet order)

Communications of the ACM, 2021 (Featured Article) [CACM'21]

GRIM: A General, Real-Time Deep Learning Inference Framework for Mobile Devices based on Fine-Grained Structured Weight Sparsity

Wei Niu, Zhengang Li, Xiaolong Ma, Peiyan Dong, Gang Zhou, Xuehai Qian, Xue Lin, Yanzhi Wang, Bin Ren

IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021 [TPAMI'21]

ClickTrain: Efficient and Accurate End-to-End Deep LearningTraining via Fine-Grained Architecture-Preserving Pruning

C. Zhang, G. Yuan, W. Niu, J. Tian, S. Jin, D. Zhuang, Z. Jiang, Y. Wang, B. Ren, S. Song, D. Tao

The 35th ACM International Conference on Supercomputing (acceptance rate: 39/157) [ICS'21]

DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusion

Wei Niu, Jiexiong Guan, Yanzhi Wang, Gagan Agrawal, Bin Ren

The 42nd ACM SIGPLAN Conference on Programming Language Design and Implementation, 2021 (acceptance rate: 87/320) [PLDI'21]

NPAS: A Compiler-aware Framework of Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration

Z. Li*, G. Yuan*, W. Niu*, P. Zhao*, Y. Li, Y. Cai, X. Shen, Z. Zhan, Z. Kong, Q. Jin, Z. Chen, S. Liu, K. Yang, B. Ren, Y. Wang, X. Lin

IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021 (oral paper: top 5%, acceptance rate: 1593/7500) [CVPR'21]

Neural Pruning Search for Real-Time Object Detection of Autonomous Vehicles

Pu Zhao, Geng Yuan, Yuxuan Cai, Wei Niu, Qi Liu, Wujie Wen, Bin Ren, Yanzhi Wang, Xue Lin

The 58th Annual Design Automation Conference, 2021 [DAC'21]

2020

Real-Time Mobile Acceleration of DNNs: From Computer Vision to Medical Applications

Hongjia Li, Geng Yuan, Wei Niu, Yuxuan Cai, Mengshu Sun, Zhengang Li, Bin Ren, Xue Lin, Yanzhi Wang

Proceeding of Asia and South Pacific Design Automation Conference, 2021 [ASP-DAC'21]

YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design

Yuxuan Cai, Hongjia Li, Geng Yuan, Wei Niu, Yanyu Li, Xulong Tang, Bin Ren, Yanzhi Wang

The 35th AAAI Conference on Artificial Intelligence, 2021 (Acceptance Rate: 20.9%) [AAAI'21]

Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices

Wei Niu*, Mengshu Sun*, Zhengang Li*, Jou-An Chen, Jiexiong Guan, Xipeng Shen, Yanzhi Wang, Xue Lin, Bin Ren

The 35th AAAI Conference on Artificial Intelligence, 2021 (Acceptance Rate: 20.9%) [AAAI'21]

An Image Enhancing Pattern-based Sparsity for Real-Time Inference on Mobile Devices

X. Ma*, W. Niu*, T. Zhang, S. Liu, S. Lin, H. Li, X. Chen, J. Tang, K. Ma, B. Ren, Y. Wang

Proceeding of European Conference on Computer Vision, 2020 [ECCV'20]

A Privacy-Preserving-Oriented DNN Pruning and Mobile Acceleration Framework

Y. Gong, Z. Zhan, Z. Li, W. Niu, X. Ma, W. Wang, B. Ren, C. Ding, X. Lin, X. Xu, Y. Wang

Proceedings of the 2020 on Great Lakes Symposium on VLSI, 2020 [GLSVLSI'20]

2019

RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition

P. Dong, S. Wang, W. Niu, C. Zhang, S. Lin, Z. Li, Y. Gong, B. Ren, X. Lin, D. Tao

The 57th Annual Design Automation Conference, July, 2020 [DAC'20]

PCONV: The Missing but Desirable Sparsity in DNN Weight Pruning for Real-time Execution on Mobile Devices

Xiaolong Ma, Fu-Ming Guo, Wei Niu, Xue Lin, Jian Tang, Kaisheng Ma, Bin Ren, Yanzhi Wang

The 34th AAAI Conference on Artificial Intelligence, February, 2020 (Acceptance Rate: 1,591/7,737 = 20.6%) [AAAI'20]

PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning

Wei Niu, Xiaolong Ma, Sheng Lin, Shihao Wang, Xuehai Qian, Xue Lin, Yanzhi Wang, Bin Ren

The 25th International Conference on Architectural Support for Programming Languages and Operating Systems, March, 2020 [ASPLOS'20]

26ms Inference Time for ResNet-50: Towards Real-Time Execution of all DNNs on Smartphone

Wei Niu, Xiaolong Ma, Yanzhi Wang, Bin Ren

ICML Workshop, 2019 [ICML'19 Workshop]