2022 Volume 26 Issue 5 Pages 131-140
Using less electric power or speeding up processing is catching the interests of researchers in deep learning. Quanti-zation has offered distillation mechanisms that substitute floating numbers for integers, but little has been suggested about the floating numbers themselves. The use of Q-format notation reduces computational overheads that frees resources for the in-troduction of more operations. Our experiments, conditioned on varying regimes, introduce automatic differentiation on algo-rithms like the fast Fourier transforms and Winograd minimal filtering to reduce computational complexity (expressed in total number of MACs) and suggest a path towards the assistive intelligence concept. Empirical results show that, under specific heuristics, the Q-format number notation can overcome the shortfalls of floating numbers, especially for embedded systems. Further benchmarks like the FPBench standard give more details by comparing our proposals with common deep learning operations.
