Not necessarily. Temperature determines which way heat energy flows, it says nothing about how fast it flows. I can hold my hand in an oven at 500 degrees with no problem because the transfer is very slow. Briefly touching a much cooler 150 degree piece of metal would give me a nasty burn, because of how quickly the heat transfers.