Shaden Smith

Most-cited papers

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick +387 more
2022arXiv.org3,070 citations
Semantic Scholar
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model
Shaden Smith, M. Patwary, Brandon Norick, P. LeGresley +16 more
2022arXiv.org873 citations
Semantic Scholar
DeepSpeed- Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale
Reza Yazdani Aminabadi, Samyam Rajbhandari, A. Awan, Cheng Li +7 more
2022International Conference for High Performance Computing, Networking, Storage and Analysis730 citations Open access
Semantic Scholar
ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep learning
Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, Shaden Smith +1 more
2021International Conference for High Performance Computing, Networking, Storage and Analysis588 citations
Semantic Scholar
SPLATT: Efficient and Parallel Sparse Tensor-Matrix Multiplication
Shaden Smith, Niranjay Ravindran, N. Sidiropoulos, G. Karypis
2015IEEE International Parallel and Distributed Processing Symposium224 citations Open access
Semantic Scholar
Tensor-matrix products with a compressed sparse tensor
Shaden Smith, G. Karypis
2015IA3@SC144 citations Open access
Semantic Scholar
Tensaurus: A Versatile Accelerator for Mixed Sparse-Dense Tensor Computations
Nitish Srivastava, Hanchen Jin, Shaden Smith, Hongbo Rong +2 more
2020International Symposium on High-Performance Computer Architecture128 citations
Semantic Scholar
Accelerating the Tucker Decomposition with Compressed Sparse Tensors
Shaden Smith, G. Karypis
2017European Conference on Parallel Processing63 citations Open access
Semantic Scholar
Bridging the Gap between HPC and Big Data frameworks
Michael J. Anderson, Shaden Smith, N. Sundaram, Mihai Capotă +4 more
2017Proceedings of the VLDB Endowment60 citations
Semantic Scholar
A Medium-Grained Algorithm for Sparse Tensor Factorization
Shaden Smith, G. Karypis
2016IEEE International Parallel and Distributed Processing Symposium58 citations
Semantic Scholar
Truss decomposition on shared-memory parallel systems
Shaden Smith, Xing Liu, Nesreen Ahmed, A. Tom +2 more
2017IEEE Conference on High Performance Extreme Computing51 citations
Semantic Scholar
Streaming Tensor Factorization for Infinite Data Sources
Shaden Smith, Kejun Huang, N. Sidiropoulos, G. Karypis
2018SDM43 citations
Semantic Scholar
Sparse Tensor Factorization on Many-Core Processors with High-Bandwidth Memory
Shaden Smith, Jongsoo Park, G. Karypis
2017IEEE International Parallel and Distributed Processing Symposium39 citations Open access
Semantic Scholar
An Exploration of Optimization Algorithms for High Performance Tensor Completion
Shaden Smith, Jongsoo Park, G. Karypis
2016International Conference for High Performance Computing, Networking, Storage and Analysis39 citations
Semantic Scholar
Memory-efficient parallel computation of tensor and matrix products for big tensor decomposition
Niranjay Ravindran, N. Sidiropoulos, Shaden Smith, G. Karypis
2014Asilomar Conference on Signals, Systems and Computers33 citations
Semantic Scholar
Exploring optimizations on shared-memory platforms for parallel triangle counting algorithms
A. Tom, N. Sundaram, Nesreen Ahmed, Shaden Smith +5 more
2017IEEE Conference on High Performance Extreme Computing31 citations
Semantic Scholar
Big Data Frequent Pattern Mining
D. Anastasiu, J. Iverson, Shaden Smith, G. Karypis
2014Frequent Pattern Mining30 citations
Semantic Scholar
Blocking Optimization Techniques for Sparse Tensor Computation
Jee W. Choi, Xing Liu, Shaden Smith, Tyler A. Simon
2018IEEE International Parallel and Distributed Processing Symposium29 citations Open access
Semantic Scholar
Constrained Tensor Factorization with Accelerated AO-ADMM
Shaden Smith, Alec Beri, G. Karypis
2017International Conference on Parallel Processing29 citations
Semantic Scholar
PIUMA: Programmable Integrated Unified Memory Architecture
S. Aananthakrishnan, Nesreen Ahmed, V. Cavé, Marcelo H. Cintra +27 more
2020arXiv.org19 citations
Semantic Scholar
Weighted-Sequence Problem: ASP vs CASP and Declarative vs Problem-Oriented Solving
Y. Lierler, Shaden Smith, M. Truszczynski, Alex Westlund
2012International Symposium on Practical Aspects of Declarative Languages15 citations Open access
Semantic Scholar
Big Data and Recommender Systems
D. Anastasiu, Evangelia Christakopoulou, Shaden Smith, Mohit Sharma +1 more
201611 citations
Semantic Scholar
DMS : Distributed Sparse Tensor Factorization with Alternating Least Squares
Shaden Smith, G. Karypis
201511 citations
Semantic Scholar
High Performance Streaming Tensor Decomposition
Yongseok Soh, Patrick Flick, Xing Liu, Shaden Smith +3 more
2021IEEE International Parallel and Distributed Processing Symposium10 citations
Semantic Scholar
HPC formulations of optimization algorithms for tensor completion
Shaden Smith, Jongsoo Park, G. Karypis
2017Parallel Computing9 citations Open access
Semantic Scholar
Scalable Label Propagation for Multi-Relational Learning on the Tensor Product of Graphs
Zhuliu Li, R. Petegrosso, Shaden Smith, David Sterling +2 more
2021IEEE Transactions on Knowledge and Data Engineering6 citations Open access
Semantic Scholar
RecFlex: Enabling Feature Heterogeneity-Aware Optimization for Deep Recommendation Models with Flexible Schedules
Zaifeng Pan, Zhen Zheng, Feng Zhang, Bing Xie +6 more
2024International Conference for High Performance Computing, Networking, Storage and Analysis5 citations
Semantic Scholar
Scalable Label Propagation for Multi-relational Learning on Tensor Product Graph
Zhuliu Li, R. Petegrosso, Shaden Smith, David Sterling +2 more
2018arXiv.org2 citations
Semantic Scholar
HEAT: A Highly Efficient and Affordable Training System for Collaborative Filtering Based Recommendation on CPUs
Cheng-Ming Zhang, Shaden Smith, Bai-Xi Sun, Jian-Nan Tian +5 more
2023International Conference on Supercomputing1 citations Open access
Semantic Scholar
Algorithms for Large-Scale Sparse Tensor Factorization
Shaden Smith
20191 citations
Semantic Scholar
Scalability and Distribution of Collaborative Recommenders
Evangelia Christakopoulou, Shaden Smith, Mohit Sharma, Alex Richards +2 more
2018Collaborative Recommendations1 citations
Semantic Scholar
CosmoGRaPH: Cosmological General Relativity and (Perfect fluid | Particle) Hydrodynamics
J. Mertens, Chi Tian, Shaden Smith
20200 citations
Semantic Scholar
Sparse Tensor Factorization with Alternating Least Squares
Shaden Smith, G. Karypis
20150 citations
Semantic Scholar
TR 14-014 Big Data Frequent Pattern Mining
D. Anastasiu, J. Iverson, Shaden Smith, G. Karypis
20140 citations
Semantic Scholar
LLMs meet Bloom’s Taxonomy: A Cognitive View on Large Language Model Evaluations
T. Huber, C. Niklaus, A. Conneau, Kartikay Khan-delwal +496 more
0 citations
Semantic Scholar