Cat's normal body temp is about 102º.
So if it's "toasty" to you, your cat is probably hot as hell.
Yes, a fever can make them pant. Touch the cats ears, if the feel hot; wipe them down (the external part) with an alcohol swab or alcohol on a piece of toilet paper. It will help to cool them down.