Dynamically Throttleable Neural Networks

Sek Chai, PhD

Chief Technology Officer and Co-Founder

Latent AI

Friday, October 7 2022

11 AM CST – 12 PM CST

Join from the webinar link

https://utsa.webex.com/utsa/j.php?MTID=m432873fd789a104abcb6de4cd4e6bd57

Deep learning model inferences are typically processed with statically defined allocation of compute and memory resources. However, real-world conditions are often varying and thereby, a static runtime inference is neither optimal from an accuracy or efficiency perspective. The problem lies in the current approaches that build model runtime that occupy a single point in the trade-space between performance and resource use. In this presentation, we present a new way to run your neural network dynamically to minimize the working footprint for both memory and compute horsepower. Such an approach enables a runtime that is highly agile, can self-regulate, and could afford new benefits from a robustness perspective.