A probability distribution is a mathematical function that describes the likelihood of different outcomes in a random variable. It helps in understanding how the probabilities are spread over the values that the variable can take, providing a framework for predicting the behavior of systems at the molecular level. In the context of entropy, probability distributions are crucial as they relate to the number of microstates associated with a particular macrostate, impacting the entropy of a system.