Visiting soccer fans banned from showing team colors