Even the most distinguished career has to start somewhere. For Billy Joel's life as a chart-topping solo artist, that first step started in a Los Angeles piano bar.

As any Joel fan will tell you, his career really started during his Long Island youth, with stints in a series of bands that included the Hassles and an organ-fueled heavy metal duo dubbed Attila. And his first solo LP, 1971's Cold Spring Harbor, was released before he took that fateful piano bar job – but all of those early stabs at stardom went nowhere.

It was actually the failure of the Harbor record – which was infamously mastered at the wrong speed, leaving Joel sounding like a singing chipmunk – that started his brief tenure as a barfly serenade singer. Angered by the label's mismanagement of the album and chafing under the constraints of a terrible contract, he decided to walk away from everything while he paused to take stock and re-evaluate.

"I dropped out of sight," Joel told Alec Baldwin during an appearance on Baldwin's Here's the Thing show. "I had to get out of this horrible deal that I’d signed. I signed away everything – the copyrights, publishing, record royalties, everything. My first child. I gave it all away, and I said, 'I’ve got to get out of this deal,' and I hid in L.A. and I worked in a piano bar under the name Bill Martin."

It wasn't the way Joel dreamed his career would go as a Beatles-loving teen, but a change of fortune loomed on the horizon. While touring behind Cold Spring Harbor, he'd done a show at Philadelphia's WMMR, and his performance of the non-album track "Captain Jack" quickly entered heavy rotation on the station's airwaves. Among Joel's new fans were some key execs at Columbia Records, and soon plans were afoot to try and wrest him from that punitive contract and get him onto the Columbia roster.

While Columbia's efforts weren't 100 percent effective – Joel's first label, Family Productions, would take a piece of everything he did through 1986's The Bridge – they did get him signed, and once he had major-label machinery behind him, Joel was free to begin building a career in earnest. The fruits of those efforts arrived in stores in November 1973, in the form of his second solo album, Piano Man.

Listen to Billy Joel Perform 'Piano Man'

Just the fact that it was mastered at the right speed was a step in the right direction for Joel, but he'd also stepped up his game in terms of songwriting; where Cold Spring Harbor had been a very stark, ballad-heavy affair, Piano Man bore the first hints of the eclectic, full-bodied sound he'd pursue for the balance of his career. With producer Michael Stewart behind the boards and surrounded by a band of session aces, Joel flexed his chops as an arranger, working elements of country, rock, sweeping orchestral pop, and classic Tin Pan Alley balladry into the mix.

But while "Captain Jack" might have been the song that got the ball rolling, it was the album's title track that ended up quickly providing the record's signature moment – and becoming one of the defining anthems of Joel's career. And it all got started back in an L.A. piano bar called the Executive Room.

In fact, as Joel admitted in a 2010 interview, he didn't even have to invent the characters in the lyrics. "John was the bartender. Paul was this real estate guy who wanted to write the great American novel and Davey was a guy who was in the Navy," he recalled. "It’s a true story and I knew when I was doing the gig, I said, ‘I gotta get a song out of this’ and it worked out. Even the girl in the song, that says ‘And the waitress is practicing politics, as the businessmen slowly get stoned’ – that was my first wife. She was working there too, as a waitress."

Released on Nov. 9, 1973, Piano Man proved to be the first Billy Joel album to gain any real traction on the charts, where it broke the Billboard Top 30 in 1974. But it would take him several more years – and a few more middling releases – before he'd really become a household name with 1977's The Stranger. And as he later reflected during his conversation with Baldwin, the record wasn't as much of a hit as people might remember.

"Piano Man was not a hit record," he noted. "It was a turntable hit. In other words, it didn’t sell through, but this is back in the early ‘70s. In those days, they still had FM progressive radio. Disc jockeys could spin whatever they wanted." He'd have to endure additional commercial struggles to get there, but soon enough, there would come a point when disc jockeys would be spinning all the Billy Joel hits anyone could ask for – and they all started with Piano Man.

Rock's 100 Most Underrated Albums

You know that LP that it seems like only you love? Let's talk about those.

More From Ultimate Classic Rock