If trying a bathing suit on, definitely yes. Otherwise it depends on the suit and your level of modesty. Most men’s suits have a mesh “undergarment” and women’s suits are designed to wear without underwear.