Peer Reviewed Conferences and Journals

TSLA: A Task-Specific Learning Adaptation for Semantic Segmentation on Autonomous Vehicles Platform

J. Liu, Z. Kong, P. Zhao, W. Zeng, H. Tang, X. Shen, C. Yang, W. Zhang, G. Yuan, W. Niu, X. Lin, Y. Wang

IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems [TCAD'24]

Real-time Core-Periphery Guided ViT with Smart Data Layout Selection on Mobile Devices

Zhihao Shu*, Xiaowei Yu*, Zihao Wu, Wenqi Jia, Yinchen Shi, Miao Yin, Tianming Liu, Dajiang Zhu, Wei Niu

The 38th Annual Conference on Neural Information Processing Systems [NeurIPS'24]

Exploring Token Pruning in Vision State Space Models

Z. Zhan, Z. Kong, Y. Gong, Y. Wu, Z. Meng, H. Zheng, X. Shen, S. Ioannidis, W. Niu, P. Zhao, Y. Wang

The 38th Annual Conference on Neural Information Processing Systems [NeurIPS'24]

Fast and Memory-Efficient Video Diffusion Using Streamlined Inference

Z. Zhan, Y. Wu, Y. Gong, Z. Meng, Z. Kong, C. Yang, G. Yuan, P. Zhao, W. Niu, Y. Wang

The 38th Annual Conference on Neural Information Processing Systems [NeurIPS'24]

Towards Recognizing Food Types for Unseen Subjects

Jiexiong Guan, Junjie Wang, Wei Niu, Zhen Peng, Shuangquan Wang, Zhenming Liu, Gang Zhou, Bin Ren

ACM Transactions on Computing for Healthcare [Healthcare'24]

GWLZ: A Group-wise Learning-based Lossy Compression Framework for Scientific Data

Wenqi Jia, Sian Jin, Jinzhen Wang, Wei Niu, Dingwen Tao, Miao Yin

The 14th Workshop on AI and Scientific Computing at Scale using Flexible Computing Infrastructures

MobiTT: Speed-Oriented DNN Compression for Mobile with Tensor Train Decomposition

Miao Yin, Wei Niu

Workshop on Compute Platforms for Autonomous Vehicles (held with ASPLOS'24) [CAV'24]

SmartMem: Layout Transformation Elimination and Adaptation for Efficient DNN Execution on Mobile

Wei Niu, Md Musfiqur Rahman Sanim, Zhihao Shu, Jiexiong Guan, Xipeng Shen, Miao Yin, Gagan Agrawal, Bin Ren

International Conference on Architectural Support for Programming Languages and Operating Systems [ASPLOS'24 Fall]

NeurRev: Train Better Sparse Neural Network Practically via Neuron Revitalization

Gen Li, Lu Yin, Jie Ji, Wei Niu, Minghai Qin, Bin Ren, Linke Guo, Shiwei Liu, Xiaolong Ma

The Twelfth International Conference on Learning Representations [ICLR'24]

Data Overfitting for On-Device Super-Resolution with Dynamic Algorithm and Compiler Co-Design

Gen Li, Zhihao Shu, Jie Ji, Minghai Qin, Fatemeh Afghah, Wei Niu, Xiaolong Ma

The European Conference on Computer Vision [ECCV'24]

A Scalable Real-time Semantic Segmentation Network for Autonomous Driving

Jun Liu, Chao Wu, Geng Yuan, Wei Niu, Wenbin Zhang, Houbing Herbert Song

Advanced Multimedia Computing for Smart Manufacturing and Engineering [AMC-SME'23]

SoD²: Statically Optimizing Dynamic Deep Neural Network Execution

Wei Niu, Gagan Agrawal, Bin Ren

International Conference on Architectural Support for Programming Languages and Operating Systems [ASPLOS'24 Spring]

Achieving Real-time DNN Execution on Mobile Devices with Compiler Optimizations

Wei Niu

Thesis Thesis

Decentralized Application-Level Adaptive Scheduling for Multi-Instance DNNs on Open Mobile Devices

Hsin-Hsuan Sung, Jiexiong Guan, Wei Niu, Jou-An Chen, Bin Ren, Xipeng Shen

2023 USENIX Annual Technical Conference [USENIX ATC'23]

Pruning Parameterization with Bi-level Optimization for Efficient Semantic Segmentation on the Edge

C. Yang, P. Zhao, Y. Li, W. Niu, J. Guan, H. Tang, M. Qin, B. Ren, X. Lin, Y. Wang

IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023 (acceptance rate: 2360/9155) [CVPR'23]

Towards High-Quality and Efficient Video Super-Resolution via Spatial-Temporal Data Overfitting

Gen Li, Jie Ji, Minghai Qin, Wei Niu, Bin Ren, Fatemeh Afghah, Linke Guo, Xiaolong Ma

IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023 (acceptance rate: 2360/9155) [CVPR'23]

Towards Real-Time Segmentation on the Edge

Y. Li, C. Yang, P. Zhao, G. Yuan, W. Niu, J. Guan, H. Tang, M. Qin, Q. Jin, B. Ren, X. Lin, Y. Wang

The 37th AAAI Conference on Artificial Intelligence [AAAI'23]

SparCL: Sparse Continual Learning on the Edge

Z. Wang, Z. Zhan, Y. Gong, G. Yuan, W. Niu, T. Jian, B. Ren, S. Ioannidis, Y. Wang, J. Dy

The 36th Conference on Neural Information Processing Systems [NeurIPS'22]

Survey: Exploiting Data Redundancy for Optimization of Deep Learning

Jou-An Chen, Wei Niu, Bin Ren, Yanzhi Wang, Xipeng Shen

ACM Computing Surveys [CSUR]

GCD²: A Globally Optimizing Compiler for Mapping DNNs to Mobile DSPs

Wei Niu, Jiexiong Guan, Xipeng Shen, Yanzhi Wang, Gagan Agrawal, Bin Ren

The 55th IEEE/ACM International Symposium on Microarchitecture (Acceptance Rate: 83/369 = 22.5%) [MICRO'22]

SPViT: Enabling Faster Vision Transformers via Soft Token Pruning

Z. Kong, P. Dong, X. Ma, X. Meng, W. Niu, M. Sun, X. Shen, G. Yuan, B. Ren, M. Qin, H. Tang, Y. Wang

Proceeding of European Conference on Computer Vision, 2022 [ECCV'22]

Compiler-Aware Neural Architecture Search for On-Mobile Real-time Super-Resolution

Y. Wu, Y. Gong, P. Zhao, Y. Li, Z. Zhan, W. Niu, H. Tang, M. Qin, B. Ren, Y. Wang

Proceeding of European Conference on Computer Vision, 2022 [ECCV'22]

Automatic Mapping of the Best-Suited DNN Pruning Schemes for Real-Time Mobile Acceleration

Y. Gong, G. Yuan, Z. Zhan, W. Niu, Z. Li, P. Zhao, Y. Cai, S. Liu, B. Ren, X. Lin, X. Tang, Y. Wang

ACM Transactions on Design Automation of Electronic Systems [TDAES'22]

Mobile or FPGA? A Comprehensive Evaluation on Energy Efficiency and a Unified Optimization Framework

G. Yuan, M. Sun, W. Niu, Z. Li, Y. Cai, Y. Li, J. Liu, W. Jiang, X. Lin, B. Ren, X. Tang, Y. Wang

ACM Transactions on Embedded Computing Systems (TECS) [TECS'22]

Brief Industry Paper: Enabling Level-4 Autonomous Driving on a Single $1k Off-the-Shelf Card

Hsin-Hsuan Sung, Yuanchao Xu, Jiexiong Guan, Wei Niu, Yanzhi Wang, Bin Ren, Xipeng Shen

The 28th IEEE Real-Time and Embedded Technology and Applications Symposium - Brief Presentation Track [RTAS'22 BP]

BLCR: Towards Real-time DNN Execution with Block-based Reweighted Pruning

X. Ma, G. Yuan, Z. Li, Y. Gong, T. Zhang, W. Niu, Z. Zhan, P. Zhao, N. Liu, J. Tang, X. Lin, B. Ren, Y. Wang

The 23rd International Symposium on Quality Electronic Design, 2022 [ISQED'22]

MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge

G. Yuan, X. Ma, W. Niu, Z. Li, Z. Kong, N. Liu, Y. Gong, Z. Zhan, C. He, Q. Jin, S. Wang, M. Qin, B. Ren, Y. Wang, S. Liu, X. Lin

The 35th Conference on Neural Information Processing Systems [NeurIPS'21]

HEALS: A Parallel eALS Recommendation System on CPU/GPU Heterogeneous Platforms

Qihan Wang, Wei Niu, Li Chen, Ruoming Jin, Bin Ren

The 28th IEEE International Conference on High Performance Computing, Data, & Analytics, 2021 (Acceptance Rate: 23%) [HiPC'21]

Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search

Z. Zhan, Y. Gong, P. Zhao, G. Yuan, W. Niu, Y. Wu, T. Zhang, M. Jayaweera, D. Kaeli, B. Ren, X. Lin, Y. Wang

International Conference on Computer Vision, 2021 [ICCV'21]

CoCoPIE: Enabling Real-Time AI on Off-the-Shelf Mobile Devices via Compression-Compilation Co-Design

Hui Guan, Shaoshan Liu, Xiaolong Ma, Wei Niu, Bin Ren, Xipeng Shen, Yanzhi Wang, Pu Zhao (author in alphabet order)

Communications of the ACM, 2021 (Featured Article) [CACM'21]

GRIM: A General, Real-Time Deep Learning Inference Framework for Mobile Devices based on Fine-Grained Structured Weight Sparsity

Wei Niu, Zhengang Li, Xiaolong Ma, Peiyan Dong, Gang Zhou, Xuehai Qian, Xue Lin, Yanzhi Wang, Bin Ren

IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021 [TPAMI'21]

ClickTrain: Efficient and Accurate End-to-End Deep LearningTraining via Fine-Grained Architecture-Preserving Pruning

C. Zhang, G. Yuan, W. Niu, J. Tian, S. Jin, D. Zhuang, Z. Jiang, Y. Wang, B. Ren, S. Song, D. Tao

The 35th ACM International Conference on Supercomputing (acceptance rate: 39/157) [ICS'21]

DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusion

Wei Niu, Jiexiong Guan, Yanzhi Wang, Gagan Agrawal, Bin Ren

The 42nd ACM SIGPLAN Conference on Programming Language Design and Implementation, 2021 (acceptance rate: 87/320) [PLDI'21]

NPAS: A Compiler-aware Framework of Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration

Z. Li*, G. Yuan*, W. Niu*, P. Zhao*, Y. Li, Y. Cai, X. Shen, Z. Zhan, Z. Kong, Q. Jin, Z. Chen, S. Liu, K. Yang, B. Ren, Y. Wang, X. Lin

IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021 (oral paper: top 5%, acceptance rate: 1593/7500) [CVPR'21]

Neural Pruning Search for Real-Time Object Detection of Autonomous Vehicles

Pu Zhao, Geng Yuan, Yuxuan Cai, Wei Niu, Qi Liu, Wujie Wen, Bin Ren, Yanzhi Wang, Xue Lin

The 58th Annual Design Automation Conference, 2021 [DAC'21]

Real-Time Mobile Acceleration of DNNs: From Computer Vision to Medical Applications

Hongjia Li, Geng Yuan, Wei Niu, Yuxuan Cai, Mengshu Sun, Zhengang Li, Bin Ren, Xue Lin, Yanzhi Wang

Proceeding of Asia and South Pacific Design Automation Conference, 2021 [ASP-DAC'21]

YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design

Yuxuan Cai, Hongjia Li, Geng Yuan, Wei Niu, Yanyu Li, Xulong Tang, Bin Ren, Yanzhi Wang

The 35th AAAI Conference on Artificial Intelligence, 2021 (Acceptance Rate: 20.9%) [AAAI'21]

Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices

Wei Niu*, Mengshu Sun*, Zhengang Li*, Jou-An Chen, Jiexiong Guan, Xipeng Shen, Yanzhi Wang, Xue Lin, Bin Ren

The 35th AAAI Conference on Artificial Intelligence, 2021 (Acceptance Rate: 20.9%) [AAAI'21]

An Image Enhancing Pattern-based Sparsity for Real-Time Inference on Mobile Devices

X. Ma*, W. Niu*, T. Zhang, S. Liu, S. Lin, H. Li, X. Chen, J. Tang, K. Ma, B. Ren, Y. Wang

Proceeding of European Conference on Computer Vision, 2020 [ECCV'20]

A Privacy-Preserving-Oriented DNN Pruning and Mobile Acceleration Framework

Y. Gong, Z. Zhan, Z. Li, W. Niu, X. Ma, W. Wang, B. Ren, C. Ding, X. Lin, X. Xu, Y. Wang

Proceedings of the 2020 on Great Lakes Symposium on VLSI, 2020 [GLSVLSI'20]

RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition

P. Dong, S. Wang, W. Niu, C. Zhang, S. Lin, Z. Li, Y. Gong, B. Ren, X. Lin, D. Tao

The 57th Annual Design Automation Conference, July, 2020 [DAC'20]

PCONV: The Missing but Desirable Sparsity in DNN Weight Pruning for Real-time Execution on Mobile Devices

Xiaolong Ma, Fu-Ming Guo, Wei Niu, Xue Lin, Jian Tang, Kaisheng Ma, Bin Ren, Yanzhi Wang

The 34th AAAI Conference on Artificial Intelligence, February, 2020 (Acceptance Rate: 1,591/7,737 = 20.6%) [AAAI'20]

PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning

Wei Niu, Xiaolong Ma, Sheng Lin, Shihao Wang, Xuehai Qian, Xue Lin, Yanzhi Wang, Bin Ren

The 25th International Conference on Architectural Support for Programming Languages and Operating Systems, March, 2020 [ASPLOS'20]

26ms Inference Time for ResNet-50: Towards Real-Time Execution of all DNNs on Smartphone

Wei Niu, Xiaolong Ma, Yanzhi Wang, Bin Ren

ICML Workshop, 2019 [ICML'19 Workshop]

Peer Reviewed Conferences and Journals

2024

TSLA: A Task-Specific Learning Adaptation for Semantic Segmentation on Autonomous Vehicles Platform

Real-time Core-Periphery Guided ViT with Smart Data Layout Selection on Mobile Devices

Exploring Token Pruning in Vision State Space Models

Fast and Memory-Efficient Video Diffusion Using Streamlined Inference

Towards Recognizing Food Types for Unseen Subjects

GWLZ: A Group-wise Learning-based Lossy Compression Framework for Scientific Data

MobiTT: Speed-Oriented DNN Compression for Mobile with Tensor Train Decomposition

SmartMem: Layout Transformation Elimination and Adaptation for Efficient DNN Execution on Mobile

NeurRev: Train Better Sparse Neural Network Practically via Neuron Revitalization

2023

Data Overfitting for On-Device Super-Resolution with Dynamic Algorithm and Compiler Co-Design

A Scalable Real-time Semantic Segmentation Network for Autonomous Driving

SoD²: Statically Optimizing Dynamic Deep Neural Network Execution

Achieving Real-time DNN Execution on Mobile Devices with Compiler Optimizations

Decentralized Application-Level Adaptive Scheduling for Multi-Instance DNNs on Open Mobile Devices

Pruning Parameterization with Bi-level Optimization for Efficient Semantic Segmentation on the Edge

Towards High-Quality and Efficient Video Super-Resolution via Spatial-Temporal Data Overfitting

Towards Real-Time Segmentation on the Edge

2022

SparCL: Sparse Continual Learning on the Edge

Survey: Exploiting Data Redundancy for Optimization of Deep Learning

GCD²: A Globally Optimizing Compiler for Mapping DNNs to Mobile DSPs

SPViT: Enabling Faster Vision Transformers via Soft Token Pruning

Compiler-Aware Neural Architecture Search for On-Mobile Real-time Super-Resolution

Automatic Mapping of the Best-Suited DNN Pruning Schemes for Real-Time Mobile Acceleration

Mobile or FPGA? A Comprehensive Evaluation on Energy Efficiency and a Unified Optimization Framework

Brief Industry Paper: Enabling Level-4 Autonomous Driving on a Single $1k Off-the-Shelf Card

BLCR: Towards Real-time DNN Execution with Block-based Reweighted Pruning

2021

MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge

HEALS: A Parallel eALS Recommendation System on CPU/GPU Heterogeneous Platforms

Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search

CoCoPIE: Enabling Real-Time AI on Off-the-Shelf Mobile Devices via Compression-Compilation Co-Design

GRIM: A General, Real-Time Deep Learning Inference Framework for Mobile Devices based on Fine-Grained Structured Weight Sparsity

ClickTrain: Efficient and Accurate End-to-End Deep LearningTraining via Fine-Grained Architecture-Preserving Pruning

DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusion

NPAS: A Compiler-aware Framework of Unified Network Pruning and Architecture Search for Beyond Real-Time Mobile Acceleration

Neural Pruning Search for Real-Time Object Detection of Autonomous Vehicles

2020

Real-Time Mobile Acceleration of DNNs: From Computer Vision to Medical Applications

YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design

Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices

An Image Enhancing Pattern-based Sparsity for Real-Time Inference on Mobile Devices

A Privacy-Preserving-Oriented DNN Pruning and Mobile Acceleration Framework

2019

RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition

PCONV: The Missing but Desirable Sparsity in DNN Weight Pruning for Real-time Execution on Mobile Devices

PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning

26ms Inference Time for ResNet-50: Towards Real-Time Execution of all DNNs on Smartphone