Jerry Larabee (Richard Barthelmess)is a gangster who can play piano and sing, mostly to entertain his girl Alice (Betty Compson), who is quite visibly thrilled by his crooning. But as the result of a gangland shootout he had with rival mobster Spadoni (Louis Natheaux), Larabee must do a stretch in prison. The kindly warden (William Holden) sees a potential for redemption in him, and talks Mary into giving him up, so he will break all contact with his previous life. Through his musical talents, Jerry is soon doing radio broadcasts with the prison orchestra, and one of his own compositions, "Weary River" is a smash hit with listeners. In no time, he's released, with a concert tour lined up. unfortunately, hecklers cause the overly sensitive ex-gunman to lose his confidence and he's a flop. Down on his luck, he drifts back to his old gang buddies and Mary, who's never stopped loving him. After learning that his stint up the river was a frame-up by Spadoni, a showdown is arranged at their hangout, a small café. A grim wait until the agreed minute is interrupted by the appearance of the Warden, who's been tipped off by Mary. He saves Jerry from the resulting shootout and arrival of the police force. Spadoni's dead, and now avenged, and apparently reformed as well, the warden's happy to let Larabee go free to marry Mary.