Plate tectonic reconstructions are usually constrained by the correlation of lineaments of surface geology and crustal structures. This procedure is, however, largely dependent on and complicated by assumptions on crustal structure and thinning and the identification of the continent-ocean transition. We identify two geophysically and geometrically similar upper mantle structures in the North Atlantic and suggest that these represent remnants of the same Caledonian collision event. The identification of this structural lineament provides a sub-crustal piercing point and hence a novel opportunity to tie plate tectonic reconstructions. Further, this structure coincides with the location of some major tectonic events of the North Atlantic post-orogenic evolution such as the occurrence of the Iceland Melt Anomaly and the separation of the Jan Mayen microcontinent. We suggest that this inherited orogenic structure played a major role in the control of North Atlantic tectonic processes.