On Accelerating Deep and Bayesian Neural Architectures

Deep artificial neural networks are a prominent approach for decision-making in scenarios involving uncertainty. These networks have significantly enhanced performance in various prediction tasks, such as image recognition, speech processing, and signal analysis. However, their utilization demands substantial computational resources and memory. On the other hand, there is a growing need to implement machine learning techniques on resource-constrained devices, including Internet of Things (IoT) devices, edge devices, and mobile platforms.

In this talk, we will start by examining prior research focused on accelerating Deep Neural Networks (DNNs) through compression techniques, particularly quantization, pruning, and architecture optimization. While DNNs excel at operating under uncertainty, they are incapable of reasoning about uncertainty itself. Detecting situations where a neural architecture cannot provide a well-founded prediction is crucial. Consequently, probabilistic models have recently garnered significant interest.

We will provide a brief overview of these models and discuss potential avenues to address their substantially increased computational demands.

About Prof. Dr. Holger Fröning

Prof. Dr. Holger Fröning is a Full Professor at Heidelberg University and the head of the Computing Systems Group at the Ziti Institute. He specializes in the intersection of hardware and machine learning, contributing significantly to advancements in computer systems and their applications in machine learning. His expertise and leadership in these fields have established him as a prominent figure in both academic and practical aspects of computer science.

Join In: On-Site or via Zoom

We invite you to an engaging talk by Prof. Dr. Holger Fröning. Registration is not required for this event. Choose to be part of the audience in person at CYSEC, S220| 9 and 10, Technische Universität Darmstadt, or connect with us online through Zoom.

Zoom Link: https://tu-darmstadt.zoom-x.de/j/63451098163?pwd=WTFFNUYvVFJDWW5hV2JhdFRVVzhmdz09

Date & Time: 24th January, 4:15-5 pm