The Quarrymen (who later of course changed their name to The Beatles) recorded their first song in 1958...a cover of Buddy Holly's "That'll Be The Day". Buddy's version was released to radio on this day in 1957 (May 25th) but here's the more obscure cover by The Quarrymen: