Rotation formulas are mathematical expressions used to describe the transformation of coordinates when an object or coordinate system is rotated around a specific axis. These formulas are essential in understanding the behavior of objects and coordinate systems in two-dimensional and three-dimensional spaces.