Yes, I agree, tensor cores are awesome, if your framework of choice doesn't have some rough edges you inevitably hit when you try to do advanced models on e.g. V100, but which work just fine on TPU. I think the presented Turing card is a masterpiece, just given I was hitting 11GB limit with some semantic segmentation and multi-object detection a year ago, I am obviously disappointed that this wasn't increased, and I am forced to buy RTX 5000 instead ($2300) or used K80/P40. Also, for a gaming card outside a few RTX games I doubt it will give adequate value to gamers that expected 144Hz or faster VR and similar goodies. For raytracing and as a fusion of RT and DL it's truly redefining computer graphics.
Tensors cores were built for training. For inference they added the int8 instructions (dp4a) which have lower precision. The Turing also has int4, and for inference this card blows the Volta out of the water since the v100 was only ~TOPS for int8. The Turing is 250 TOPS for int8 and 500 TOPS for int4.
