The process by which the endocrine system evolves and changes in structure and function from birth through old age, impacting hormone production and regulation. It encompasses both the maturation of this system during childhood and adolescence, as well as its gradual decline in efficiency as part of the natural aging process.