Finite moments refer to the expected values of powers of a random variable, which provide important information about its distribution. These moments help in understanding the shape and characteristics of probability distributions by summarizing key aspects like central tendency and variability. Finite moments exist when the expected value of the absolute value of the random variable raised to a power is finite.