The 30 year old striker was told by manager Roy Keane that he was not in the former Sunderland bosses plans, and was allowed to join League one side Colchester on loan until the end of the season.
Speaking of his desire to stay away from Town, Lisbie told the local press: "Once a manager tells you, without seeing you play a single game, that you can go on loan then it becomes very difficult to say that you would want to play for him again.
"I don't want to go back. Even if it came to the point where they wanted me back I think I would speak to both clubs and explain my situation.
"I just felt like the club didn't want me. If I had to go back then I would, but I don't want to be going from club-to-club at this stage of my career. I want to be settled and I'm enjoying my time back at Colchester."