> I don't know if anything similar exists in actual hardware.

Closest thing in actual hardware is a systolic array architecture. Green Array, Parallela and Google's new machine learning processors are examples.