Composition of functions, denoted as f ∘ g, is a mathematical operation that combines two functions to create a new function. It involves applying one function to the output of another function, effectively nesting the functions together. This concept allows for the creation of more complex functions by combining simpler ones, providing a powerful tool in various areas of mathematics.