D. Panda

Most-cited papers

The MVAPICH project: Transforming research into high-performance MPI library for HPC community
D. Panda, H. Subramoni, Ching-Hsiang Chu, Mohammadreza Bayatpour
2020Journal of Computer Science76 citations Open access
Semantic Scholar
Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters: MPI or NCCL?
A. Awan, Ching-Hsiang Chu, H. Subramoni, D. Panda
2017European MPI Users Group Meeting52 citations
Semantic Scholar
Scalable Distributed DNN Training using TensorFlow and CUDA-Aware MPI: Characterization, Designs, and Performance Evaluation
A. Awan, Jereon Bédorf, Ching-Hsiang Chu, H. Subramoni +1 more
2018IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing50 citations Open access
Semantic Scholar
Designing High-Performance MPI Libraries with On-the-fly Compression for Modern GPU Clusters*
Qing-Hua Zhou, C. Chu, N. S. Kumar, P. Kousha +3 more
2021IEEE International Parallel and Distributed Processing Symposium46 citations
Semantic Scholar
BluesMPI: Efficient MPI Non-blocking Alltoall Offloading Designs on Modern BlueField Smart NICs
Mohammadreza Bayatpour, Nick Sarkauskas, H. Subramoni, J. Hashmi +1 more
2021ISC High Performance44 citations
Semantic Scholar
Performance Characterization of Using Quantization for DNN Inference on Edge Devices
Hyunho Ahn, Tianrun Chen, Nawras Alnaasan, A. Shafi +3 more
2023International Conference on Fog and Edge Computing40 citations
Semantic Scholar
Accelerating MPI All-to-All Communication with Online Compression on Modern GPU Clusters
Qing-Hua Zhou, P. Kousha, Quentin Anthony, Kawthar Shafie Khorassani +3 more
2022ISC High Performance39 citations
Semantic Scholar
OC-DNN: Exploiting Advanced Unified Memory Capabilities in CUDA 9 and Volta GPUs for Out-of-Core DNN Training
A. Awan, Ching-Hsiang Chu, H. Subramoni, Xiao-Yi Lu +1 more
2018International Conference on High Performance Computing34 citations
Semantic Scholar
SALaR: Scalable and Adaptive Designs for Large Message Reduction Collectives
Mohammadreza Bayatpour, Jahanzeb Maqbool Hashmi, Sourav Chakraborty, H. Subramoni +2 more
2018IEEE International Conference on Cluster Computing33 citations
Semantic Scholar
Accelerating TensorFlow with Adaptive RDMA-Based gRPC
Rajarshi Biswas, Xiao-Yi Lu, D. Panda
2018International Conference on High Performance Computing31 citations
Semantic Scholar
Is Singularity-based Container Technology Ready for Running MPI Applications on HPC Clouds?
Jie Zhang, Xiao-Yi Lu, D. Panda
2017International Conference on Utility and Cloud Computing27 citations
Semantic Scholar
EReinit: Scalable and efficient fault‐tolerance for bulk‐synchronous MPI applications
Sourav Chakraborty, I. Laguna, M. Emani, K. Mohror +3 more
2018Concurrency and Computation25 citations Open access
Semantic Scholar
Optimized large-message broadcast for deep learning workloads: MPI, MPI+NCCL, or NCCL2?
A. Awan, K. V. Manian, Ching-Hsiang Chu, H. Subramoni +1 more
2019Parallel Computing24 citations Open access
Semantic Scholar
Designing Efficient Shared Address Space Reduction Collectives for Multi-/Many-cores
J. Hashmi, Sourav Chakraborty, Mohammadreza Bayatpour, H. Subramoni +1 more
2018IEEE International Parallel and Distributed Processing Symposium24 citations
Semantic Scholar
Accelerating CPU-based Distributed DNN Training on Modern HPC Clusters using BlueField-2 DPUs
Arpan Jain, Nawras Alnaasan, A. Shafi, H. Subramoni +1 more
2021IEEE Symposium on High-Performance Interconnects23 citations
Semantic Scholar
Designing a ROCm-Aware MPI Library for AMD GPUs: Early Experiences
Kawthar Shafie Khorassani, J. Hashmi, Ching-Hsiang Chu, Chen-Chun Chen +2 more
2021ISC High Performance23 citations
Semantic Scholar
Scaling TensorFlow, PyTorch, and MXNet using MVAPICH2 for High-Performance Deep Learning on Frontera
Arpan Jain, A. Awan, H. Subramoni, D. Panda
2019Dynamic Languages Symposium21 citations
Semantic Scholar
A Novel Framework for Efficient Offloading of Communication Operations to Bluefield SmartNICs
K. Suresh, B. Michalowicz, B. Ramesh, Nick Contini +5 more
2023IEEE International Parallel and Distributed Processing Symposium20 citations
Semantic Scholar
Efficient Asynchronous Communication Progress for MPI without Dedicated Resources
Amit Ruhela, H. Subramoni, Sourav Chakraborty, Mohammadreza Bayatpour +2 more
2018European MPI Users Group Meeting20 citations
Semantic Scholar
Designing Dynamic and Adaptive MPI Point-to-Point Communication Protocols for Efficient Overlap of Computation and Communication
H. Subramoni, Sourav Chakraborty, D. Panda
2017ISC High Performance20 citations
Semantic Scholar
Performance Evaluation of MPI Libraries on GPU-Enabled OpenPOWER Architectures: Early Experiences
Kawthar Shafie Khorassani, Ching-Hsiang Chu, H. Subramoni, D. Panda
2019ISC High Performance19 citations
Semantic Scholar
Characterizing CUDA Unified Memory (UM)-Aware MPI Designs on Modern GPU Architectures
K. V. Manian, A. Ammar, Amit Ruhela, Ching-Hsiang Chu +2 more
2019GPGPU@ASPLOS19 citations
Semantic Scholar
Exploiting Hardware Multicast and GPUDirect RDMA for Efficient Broadcast
Ching-Hsiang Chu, Xiao-Yi Lu, A. Awan, H. Subramoni +2 more
2019IEEE Transactions on Parallel and Distributed Systems19 citations Open access
Semantic Scholar
Designing a Profiling and Visualization Tool for Scalable and In-depth Analysis of High-Performance GPU Clusters
P. Kousha, B. Ramesh, Kaushik Kandadi Suresh, Ching-Hsiang Chu +4 more
2019International Conference on High Performance Computing19 citations
Semantic Scholar
Large-Message Nonblocking MPI_Iallgather and MPI Ibcast Offload via BlueField-2 DPU
Nick Sarkauskas, Mohammadreza Bayatpour, Tu Tran, B. Ramesh +2 more
2021International Conference on High Performance Computing17 citations
Semantic Scholar
Adaptive and Hierarchical Large Message All-to-all Communication Algorithms for Large-scale Dense GPU Systems
Kawthar Shafie Khorassani, Ching-Hsiang Chu, Quentin Anthony, H. Subramoni +1 more
2021IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing17 citations
Semantic Scholar
High Performance MPI over the Slingshot Interconnect: Early Experiences
Kawthar Shafie Khorassani, Chen-Chun Chen, B. Ramesh, A. Shafi +2 more
2022Practice and Experience in Advanced Research Computing16 citations
Semantic Scholar
FALCON-X: Zero-copy MPI derived datatype processing on modern CPU and GPU architectures
J. Hashmi, Ching-Hsiang Chu, Sourav Chakraborty, Mohammadreza Bayatpour +2 more
2020J. Parallel Distributed Comput.14 citations Open access
Semantic Scholar
Efficient design for MPI asynchronous progress without dedicated resources
Amit Ruhela, H. Subramoni, Sourav Chakraborty, Mohammadreza Bayatpour +2 more
2019Parallel Computing14 citations Open access
Semantic Scholar
Highly Efficient Alltoall and Alltoallv Communication Algorithms for GPU Systems
Chen-Chun Chen, Kawthar Shafie Khorassani, Quentin Anthony, A. Shafi +2 more
2022IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum13 citations
Semantic Scholar
Enabling Reconfigurable HPC through MPI-based Inter-FPGA Communication
N. Contini, B. Ramesh, Kaushik Kandadi Suresh, Tu Tran +4 more
2023International Conference on Supercomputing12 citations Open access
Semantic Scholar
High Performance MPI over the Slingshot Interconnect
Kawthar Shafie Khorassani, Chen-Chun Chen, B. Ramesh, A. Shafi +2 more
2023Journal of Computational Science and Technology12 citations Open access
Semantic Scholar
Analyzing and Understanding the Impact of Interconnect Performance on HPC, Big Data, and Deep Learning Applications: A Case Study with InfiniBand EDR and HDR
Amit Ruhela, Shu-Lei Xu, K. V. Manian, H. Subramoni +1 more
2020IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum12 citations
Semantic Scholar
Implementing and Optimizing a GPU-aware MPI Library for Intel GPUs: Early Experiences
Chen-Chun Chen, Kawthar Shafie Khorassani, Goutham Kalikrishna Reddy Kuncham, Rahul Vaidya +4 more
2023IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing11 citations
Semantic Scholar
Efficient Training of Semantic Image Segmentation on Summit using Horovod and MVAPICH2-GDR
Quentin Anthony, A. Awan, Arpan Jain, H. Subramoni +1 more
2020IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum11 citations
Semantic Scholar
Cooperative Rendezvous Protocols for Improved Performance and Overlap
Sourav Chakraborty, Mohammadreza Bayatpour, J. Hashmi, H. Subramoni +1 more
2018International Conference for High Performance Computing, Networking, Storage and Analysis11 citations
Semantic Scholar
Optimizing Distributed DNN Training Using CPUs and BlueField-2 DPUs
Arpan Jain, Nawras Alnaasan, A. Shafi, H. Subramoni +1 more
2022IEEE Micro10 citations Open access
Semantic Scholar
INAM: Cross-stack Profiling and Analysis of Communication in MPI-based Applications
P. Kousha, Kamal Raj Sankarapandian Dayala Ganesh Ram, M. Kedia, H. Subramoni +6 more
2021Practice and Experience in Advanced Research Computing10 citations Open access
Semantic Scholar
Exploring Hybrid MPI+Kokkos Tasks Programming Model
S. Khuvis, K. Tomko, J. Hashmi, D. Panda
20202020 IEEE/ACM 3rd Annual Parallel Applications Workshop: Alternatives To MPI+X (PAW-ATM)10 citations
Semantic Scholar
FALCON: Efficient Designs for Zero-Copy MPI Datatype Processing on Emerging Architectures
J. Hashmi, Sourav Chakraborty, Mohammadreza Bayatpour, H. Subramoni +1 more
2019IEEE International Parallel and Distributed Processing Symposium10 citations
Semantic Scholar
MCR-DL: Mix-and-Match Communication Runtime for Deep Learning
Quentin Anthony, A. Awan, Jeff Rasley, Yuxiong He +4 more
2023IEEE International Parallel and Distributed Processing Symposium9 citations Open access
Semantic Scholar
DistMILE: A Distributed Multi-Level Framework for Scalable Graph Embedding
Yuntian He, Saket Gurukar, P. Kousha, H. Subramoni +2 more
2021International Conference on High Performance Computing9 citations
Semantic Scholar
Scalable MPI Collectives using SHARP: Large Scale Performance Evaluation on the TACC Frontera System
B. Ramesh, K. Suresh, Nick Sarkauskas, Mohammadreza Bayatpour +3 more
2020Workshop on Exascale MPI9 citations
Semantic Scholar
Dynamic Kernel Fusion for Bulk Non-contiguous Data Transfer on GPU Clusters
Ching-Hsiang Chu, Kawthar Shafie Khorassani, Qing-Hua Zhou, H. Subramoni +1 more
2020IEEE International Conference on Cluster Computing9 citations
Semantic Scholar
SimdHT-Bench: Characterizing SIMD-Aware Hash Table Designs on Emerging CPU Architectures*
Dipti Shankar, Xiao-Yi Lu, D. Panda
2019IEEE International Symposium on Workload Characterization9 citations
Semantic Scholar
Analyzing, Modeling, and Provisioning QoS for NVMe SSDs
Shashank Gugnani, Xiao-Yi Lu, D. Panda
2018International Conference on Utility and Cloud Computing9 citations
Semantic Scholar
Spark Meets MPI: Towards High-Performance Communication Framework for Spark using MPI
Kinan Al-Attar, A. Shafi, Mustafa Abduljabbar, H. Subramoni +1 more
2022IEEE International Conference on Cluster Computing8 citations
Semantic Scholar
Design and Characterization of InfiniBand Hardware Tag Matching in MPI
Mohammadreza Bayatpour, S. M. Ghazimirsaeed, Shu-Lei Xu, H. Subramoni +1 more
2020IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing8 citations
Semantic Scholar
High-Performance Adaptive MPI Derived Datatype Communication for Modern Multi-GPU Systems
Ching-Hsiang Chu, J. Hashmi, Kawthar Shafie Khorassani, H. Subramoni +1 more
2019International Conference on High Performance Computing8 citations
Semantic Scholar
Leveraging Network-level parallelism with Multiple Process-Endpoints for MPI Broadcast
Amit Ruhela, B. Ramesh, Sourav Chakraborty, H. Subramoni +2 more
20192019 IEEE/ACM Third Annual Workshop on Emerging Parallel and Distributed Runtime Systems and Middleware (IPDRM)8 citations
Semantic Scholar