journalarticle

Boosting the Throughput and Accelerator Utilization of Specialized CNN Inference Beyond Increasing Batch Size

J. Kosaian, Amar Phanishayee, Matthai Philipose, Debadeepta Dey, R. Vinayak

International Conference on Machine Learning2021 22 citations31 references

Looking for the full paper…

Export

Papers open inside SciRah from the original publisher or repository; SciRah never hosts them.

Abstract

No abstract is available from our sources. Use “Read paper” to view it.

TL;DRFoldedCNNs is proposed, a new approach to CNN design that increases inference throughput and utilization beyond large batch size and rethink the structure of inputs and layers of specialized CNNs to boost arithmetic intensity. (Semantic Scholar)

Plain-language summary

AI illustration of the topic of “Boosting the Throughput and Accelerator Utilization of Specialized CNN Inference Beyond Increasing Batch Size”

Boosting the Throughput and Accelerator Utilization of Specialized CNN Inference Beyond Increasing Batch Size

Abstract

Plain-language summary

Discussion