A phrase marker is a visual representation used in syntax to show the hierarchical structure of phrases within a sentence. It helps in understanding how different phrases function together and their relationships to one another, particularly in identifying constituents and their roles.