Power series representation is a method used to express functions as an infinite sum of terms, where each term is a coefficient multiplied by a variable raised to a power. This technique is especially useful in probability theory for representing probability generating functions, which summarize the probabilities of discrete random variables. By using power series, we can derive various properties of distributions and compute moments more easily.