S. Song

Most-cited papers

Evaluating Modern GPU Interconnect: PCIe, NVLink, NV-SLI, NVSwitch and GPUDirect
Ang Li, S. Song, Jieyang Chen, Jiajia Li +3 more
2019IEEE Transactions on Parallel and Distributed Systems338 citations Open access
Semantic Scholar
Superneurons: dynamic GPU memory management for training deep neural networks
Linnan Wang, Jinmian Ye, Yiyang Zhao, Wei Wu +4 more
2018ACM SIGPLAN Symposium on Principles & Practice of Parallel Programming307 citations Open access
Semantic Scholar
A Simplified and Accurate Model of Power-Performance Efficiency on Emergent GPU Architectures
S. Song, Chun-Yi Su, B. Rountree, Kirk W. Cameron
20132013 IEEE 27th International Symposium on Parallel and Distributed Processing168 citations
Semantic Scholar
DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales
Z. Yao, Reza Yazdani Aminabadi, Olatunji Ruwase, Samyam Rajbhandari +15 more
2023arXiv.org134 citations Open access
Semantic Scholar
Locality-Driven Dynamic GPU Cache Bypassing
C. Li, S. Song, Hongwen Dai, A. Sidelnik +2 more
2015International Conference on Supercomputing119 citations
Semantic Scholar
Randomness In Neural Network Training: Characterizing The Impact of Tooling
Donglin Zhuang, Xingyao Zhang, S. Song, Sara Hooker
2021Conference on Machine Learning and Systems112 citations
Semantic Scholar
AStitch: enabling a new multi-dimensional optimization space for memory-intensive ML training and inference on modern SIMT architectures
Zhen Zheng, Xuanda Yang, Pengzhan Zhao, Guoping Long +8 more
2022International Conference on Architectural Support for Programming Languages and Operating Systems104 citations
Semantic Scholar
GraphReduce: processing large-scale graphs on accelerator-based systems
Dipanjan Sengupta, S. Song, K. Agarwal, K. Schwan
2015International Conference for High Performance Computing, Networking, Storage and Analysis97 citations
Semantic Scholar
Locality-Aware CTA Clustering for Modern GPUs
Ang Li, S. Song, Wei-Feng Liu, Xu Liu +2 more
2017International Conference on Architectural Support for Programming Languages and Operating Systems84 citations
Semantic Scholar
Tartan: Evaluating Modern GPU Interconnect via a Multi-GPU Benchmark Suite
Ang Li, S. Song, Jieyang Chen, Xu Liu +2 more
2018IEEE International Symposium on Workload Characterization60 citations
Semantic Scholar
CUDAAdvisor: LLVM-based runtime profiling for modern GPUs
Du Shen, S. Song, Ang Li, Xu Liu
2018IEEE/ACM International Symposium on Code Generation and Optimization54 citations Open access
Semantic Scholar
Unified performance and power modeling of scientific workloads
S. Song, K. Barker, D. Kerbyson
2013International Workshop on Energy Efficient Supercomputing51 citations
Semantic Scholar
MalFox: Camouflaged Adversarial Malware Example Generation Based on Conv-GANs Against Black-Box Detectors
Fangtian Zhong, Xiu-Zhen Cheng, Dongxiao Yu, Bei Gong +2 more
2020IEEE transactions on computers50 citations Open access
Semantic Scholar
Exploring and Analyzing the Real Impact of Modern On-Package Memory on HPC Scientific Kernels
Ang Li, Wei-Feng Liu, M. R. B. Kristensen, B. Vinter +4 more
2017International Conference for High Performance Computing, Networking, Storage and Analysis49 citations
Semantic Scholar
Processing-in-Memory Enabled Graphics Processors for 3D Rendering
Chenhao Xie, S. Song, Jing Wang, Wei-Gong Zhang +1 more
2017International Symposium on High-Performance Computer Architecture45 citations
Semantic Scholar
COMET: A Novel Memory-Efficient Deep Learning Training Framework by Using Error-Bounded Lossy Compression
Sian Jin, Cheng-Ming Zhang, Xintong Jiang, Yunhe Feng +4 more
2021Proceedings of the VLDB Endowment43 citations
Semantic Scholar
MIC-SVM: Designing a Highly Efficient Support Vector Machine for Advanced Modern Multi-core and Many-Core Architectures
Yang You, S. Song, H. Fu, A. Márquez +5 more
2014IEEE International Parallel and Distributed Processing Symposium43 citations
Semantic Scholar
New-Sum: A Novel Online ABFT Scheme For General Iterative Methods
Dingwen Tao, S. Song, S. Krishnamoorthy, Panruo Wu +4 more
2016IEEE International Symposium on High-Performance Parallel Distributed Computing42 citations Open access
Semantic Scholar
Q-VR: system-level design for future mobile collaborative virtual reality
Chenhao Xie, Xie Li, Yang Hu, Huwan Peng +2 more
2021International Conference on Architectural Support for Programming Languages and Operating Systems40 citations Open access
Semantic Scholar
BSTC: A Novel Binarized-Soft-Tensor-Core Design for Accelerating Bit-Based Approximated Neural Nets
Ang Li, T. Geng, Tianqi Wang, M. Herbordt +2 more
2019International Conference for High Performance Computing, Networking, Storage and Analysis40 citations Open access
Semantic Scholar
EvoGraph: On-the-Fly Efficient Mining of Evolving Graphs on GPU
Dipanjan Sengupta, S. Song
2017ISC High Performance38 citations
Semantic Scholar
TSM2X: High-performance tall-and-skinny matrix-matrix multiplication on GPUs
Cody Rivera, Jieyang Chen, Nan Xiong, Jing Zhang +2 more
2020J. Parallel Distributed Comput.37 citations Open access
Semantic Scholar
The Power-Performance Tradeoffs of the Intel Xeon Phi on HPC Applications
Bo Li, Hung-Ching Chang, S. Song, Chun-Yi Su +3 more
20142014 IEEE International Parallel & Distributed Processing Symposium Workshops37 citations
Semantic Scholar
SFU-Driven Transparent Approximation Acceleration on GPUs
Ang Li, S. Song, Mark Wijtvliet, Akash Kumar +1 more
2016International Conference on Supercomputing36 citations Open access
Semantic Scholar
Investigating the Interplay between Energy Efficiency and Resilience in High Performance Computing
Li Tan, S. Song, Panruo Wu, Zi-Zhong Chen +2 more
2015IEEE International Parallel and Distributed Processing Symposium34 citations
Semantic Scholar
Warp-Consolidation: A Novel Execution Model for GPUs
Ang Li, Wei-Feng Liu, Linnan Wang, K. Barker +1 more
2018International Conference on Supercomputing33 citations Open access
Semantic Scholar
Scaling Support Vector Machines on modern HPC platforms
Yang You, H. Fu, S. Song, A. Randles +4 more
2015J. Parallel Distributed Comput.32 citations Open access
Semantic Scholar
Combating the reliability challenge of GPU register file at low supply voltage
Jingweijia Tan, S. Song, Kai-Ge Yan, Xin Fu +2 more
2016International Conference on Parallel Architectures and Compilation Techniques28 citations
Semantic Scholar
LP-BNN: Ultra-low-Latency BNN Inference with Layer Parallelism
T. Geng, Tianqi Wang, Chun-Shu Wu, Chen Yang +3 more
2019IEEE International Conference on Application-Specific Systems, Architectures, and Processors27 citations
Semantic Scholar
OO-VR: NUMA Friendly Object-Oriented VR Rendering Framework For Future NUMA-Based Multi-GPU Systems
Chenhao Xie, Fu Xin, Ming-Song Chen, S. Song
2019International Symposium on Computer Architecture24 citations Open access
Semantic Scholar
PIM-VR: Erasing Motion Anomalies In Highly-Interactive Virtual Reality World with Customized Memory Cube
Chenhao Xie, Xingyao Zhang, Ang Li, Xin Fu +1 more
2019International Symposium on High-Performance Computer Architecture24 citations
Semantic Scholar
Data Fusion in Infrastructure-Augmented Autonomous Driving System: Why? Where? and How?
Jian-Da Wang, Zhen-Dong Wang, Bo Yu, Jie Tang +3 more
2023IEEE Internet of Things Journal20 citations
Semantic Scholar
Chiplet Cloud: Building AI Supercomputers for Serving Large Generative Language Models
Huwan Peng, S. Davidson, Richard Shi, S. Song +1 more
2023arXiv.org20 citations Open access
Semantic Scholar
Enabling Highly Efficient Capsule Networks Processing Through A PIM-Based Architecture Design
Xingyao Zhang, S. Song, Chenhao Xie, Jing Wang +2 more
2019International Symposium on High-Performance Computer Architecture20 citations Open access
Semantic Scholar
Critical points based register-concurrency autotuning for GPUs
Ang Li, S. Song, Akash Kumar, E. Zhang +2 more
2016Design, Automation and Test in Europe20 citations
Semantic Scholar
MAPA: Multi-Accelerator Pattern Allocation Policy for Multi-Tenant GPU Servers
K. Ranganath, Joshua D. Suetterlein, Joseph Manzano, S. Song +1 more
2021International Conference for High Performance Computing, Networking, Storage and Analysis19 citations Open access
Semantic Scholar
Enabling scalability-sensitive speculative parallelization for FSM computations
Junqiao Qiu, Zhijia Zhao, Bo Wu, A. Vishnu +1 more
2017International Conference on Supercomputing19 citations Open access
Semantic Scholar
X: A Comprehensive Analytic Model for Parallel Machines
Ang Li, S. Song, Eric Brugel, Akash Kumar +2 more
2016IEEE International Parallel and Distributed Processing Symposium19 citations
Semantic Scholar
ClickTrain: efficient and accurate end-to-end deep learning training via fine-grained architecture-preserving pruning
Cheng-Ming Zhang, Geng Yuan, Wei Niu, Jian-Nan Tian +7 more
2020International Conference on Supercomputing18 citations Open access
Semantic Scholar
Vapro: performance variance detection and diagnosis for production-run parallel applications
Liyan Zheng, Ji-Dong Zhai, Xiongchao Tang, Haojie Wang +4 more
2022ACM SIGPLAN Symposium on Principles & Practice of Parallel Programming16 citations Open access
Semantic Scholar
Dr. Top-k: Delegate-Centric Top-k on GPUs
Anil Gaihre, Da Zheng, Scott Weitze, Ling-Da Li +4 more
2021International Conference for High Performance Computing, Networking, Storage and Analysis16 citations Open access
Semantic Scholar
Toward efficient interactions between Python and native libraries
Jialiang Tan, Yu Chen, Zhenming Liu, Bin Ren +3 more
2021ESEC/SIGSOFT FSE16 citations Open access
Semantic Scholar
Fast and Scalable Sparse Triangular Solver for Multi-GPU Based HPC Architectures
Chenhao Xie, Jieyang Chen, J. Firoz, Jiajia Li +4 more
2020International Conference on Parallel Processing16 citations Open access
Semantic Scholar
Orion: A Framework for GPU Occupancy Tuning
Ari B. Hayes, Ling-Da Li, Daniel G. Chavarría-Miranda, S. Song +1 more
2016International Middleware Conference16 citations Open access
Semantic Scholar
Enabling Efficient Real-Time Calibration on Cloud Quantum Machines
Yiding Liu, Zedong Li, Alan Robertson, Xin Fu +1 more
2023IEEE Transactions on Quantum Engineering14 citations Open access
Semantic Scholar
A novel memory-efficient deep learning training framework via error-bounded lossy compression
Sian Jin, Guan-Peng Li, S. Song, Dingwen Tao
2020ACM SIGPLAN Symposium on Principles & Practice of Parallel Programming14 citations Open access
Semantic Scholar
TeGraph: A Novel General-Purpose Temporal Graph Computing Engine
Cheng-Ying Huan, Hang Liu, Mengxing Liu, Yongchao Liu +5 more
2022IEEE International Conference on Data Engineering13 citations
Semantic Scholar
TEA: A General-Purpose Temporal Graph Random Walk Engine
Cheng-Ying Huan, S. Song, Santosh Pandey, Hang Liu +6 more
2023European Conference on Computer Systems12 citations Open access
Semantic Scholar
Brief Industry Paper: The Necessity of Adaptive Data Fusion in Infrastructure-Augmented Autonomous Driving System
Shaoshan Liu, Jian-Da Wang, Zhen-Dong Wang, Bo Yu +6 more
2022IEEE Real Time Technology and Applications Symposium12 citations Open access
Semantic Scholar
T-GCN: A Sampling Based Streaming Graph Neural Network System with Hybrid Architecture
Cheng-Ying Huan, S. Song, Yongchao Liu, Heng Zhang +5 more
2022International Conference on Parallel Architectures and Compilation Techniques12 citations Open access
Semantic Scholar