He is a yakuza boss. In his youth, Kintarou's father took the fall for him, allowing him to move to Tokyo and move up the yakuza ranks.

(Source: AniDB)