Prevalent large CNN models pose a significant challenge in terms of computing resources for resource-constrained devices at the Edge. Distributing the computations and coefficients over multiple edge devices collaboratively has been well studied but …
Automated Distributed CNN Inference at the Edge
High-throughput CPU-GPU CNN inference pipeline