Chapter 11 of The Idea Factory by Jon Gertner (a book about Bell Labs) has a fun story about the first transatlantic telephone cable, completed in 1956. According to him, telegraph cables were attempted as early as the 1850s, but the first successful one was in 1866, between Canada and Ireland.