公公 refers to one's paternal grandfather. He is the father of one's father.
祖父(zǔfù): One's paternal great-grandfather.
祖母(zǔmǔ): One's paternal great-grandmother.
曾祖父(céngzǔfù): One's paternal great-great-grandfather.