As A Dying Dream, they released an EP, Now or Never on Frontline Records. A year later, they signed to Mediaskare Records, where they re-recorded and re-released the EP with an additional track and bonus live footage. Not long after, they changed their name to The Ghost Inside, and released a full length studio album entitled Fury and the Fallen Ones.

Their second album, titled Returners, was released on June 8, 2010 via Mediaskare Records.

On February 24, 2011, it was announced that KC Stockbridge and The Ghost Inside mutually parted ways and that Andrew Tkaczyk had been filling in on drums. Andrew was formerly the drummer and main songwriter in the band For the Fallen Dreams.[1] As of January 10, 2012, the band has been signed to Epitaph Records.[2]

Their first release for Epitaph Records Get What You Give was produced by A Day to Remember's Jeremy McKinnon[3] and debuted at No. 88 on the Billboard Top 200.[4]

In 2012, the band headlined the Alternative Press Tour along with Miss May I.

In 2013, the band toured the world with their breakthrough album, Get What You Give.