I've created a monster

My cockatiel (new name Mac, long story) hates his cage now. He wants out all the time. He rides on my shoulder anywhere and everywhere. I tried the top of the cage, no go. table? same thing. Anyone have ideas on how to entertain him in his cage? He has two hanging toys, doesn't touch them.
At least he gives me kisses all the time, nuzzles my cheek and hair. But he pitches a hissy fit when I put him back in the cage.