A spokesperson said: "As this case shows, we do not hesitate to send offenders back to prison, where necessary, if they break the rules."
They added they could not comment on what Bannister's licence conditions were.
The stalker is now expected to remain in custody until he completes the 12-month sentence he was already serving.
After Bannister went to Tweedy's home for a fourth time last year, the Fight For This Love singer revealed she felt forced to hire personal security.
She said her child was scared and she was nervous every time she opened the gates to her house.
"Each time he returns, the worry of his intentions intensifies," she said in a victim impact statement read out in court.

