Your core temperature stays near 37°C (98.6°F) because the hypothalamus runs a negative feedback loop. Neurons in its preoptic area sense the temperature of blood flowing through the brain, and peripheral thermoreceptors in the skin send early warnings about the environment.
When you're too warm, skin arterioles vasodilate so more warm blood reaches the surface, and sweat glands release sweat. Heat leaves by radiation, conduction, convection, and evaporation. In a cool environment, radiation can remove much of your heat at rest. Evaporation becomes especially important during exercise or in hot weather. Humid air slows evaporation, which is why humid heat feels worse.
When you're too cold, skin arterioles vasoconstrict to reduce heat loss, and skeletal muscles shiver. Brown fat can also produce heat without shivering, while thyroid hormone affects metabolic heat production over a longer time scale. Behavior counts too, like putting on a jacket.
A fever doesn't mean thermoregulation has broken. Pyrogens released during infection raise the hypothalamic set point, so you feel chills and shiver until your temperature climbs to the new target.
Worked example. How much heat does evaporating 1 L of sweat remove? Water absorbs about 2,400 J/g when it evaporates, and 1 L of sweat is about 1,000 g. So 1,000×2,400=2,400,000 J=2,400 kJ. A 70 kg body needs about 70×3.5=245 kJ to warm by 1°C, so this sweat removes roughly 2,400÷245≈10°C worth of heat. Sweat that drips off without evaporating removes almost none of that.