Go to: Admin panel -> Manage -> Forms -> Contact Information
I do not know what removing the phone number will do, but it might break quick searches. So make sure if you are going to remove it you record what was there so that you can add it back in if breaks something.
Also the Full Name field already has a label.