Yes, it’s recommended to sponge exposed skin with tepid water, avoid cold baths / showers.

Yes use a relatively cool and soft face washer is alright, also check of baby is wrapped up too much, give plenty of ventilation will help bring temperature down.

A cool damp face washer does help with fevers. As do bathing them in a tepid bath. Make sure they stay hydrated too, very important