If you unban him now it's will only going to make it worse down the line for the board.
If you thought his behaviour in the first place was bad enough to ban him by accepting him back your giving a green flag to all those who seem to look up to him to mimic his behaviour also.
