Can you wear gray pants with navy blue sweater?

Yes, for exercise or to just go grocery shopping or just a casual day, but it sounds like a physical education uniform requirement.