Ex-paramilitaries are trying to destroy me: Former peace commissioner