Fall in love with Taylor Swift's touring partner

Vance Joy has us reaching for tissues as he performs "Mess Is Mine" in PEOPLE's Music Lounge