Shares of On fell more than 11 percent after the company announced that CEO Martin Hoffmann's would step down in May.