Moments are quantitative measures that capture the shape and characteristics of a probability distribution. They provide insights into various aspects of a distribution, such as its central tendency, variability, and tail behavior. The most commonly used moments are the first moment (mean), the second moment (variance), and higher-order moments that describe skewness and kurtosis.