We don’t really have any hints of what happened to Joseph after Jesus’ birth. He doesn’t seem to be in the picture during Jesus’ ministry, so we can assume he passed away sometime between Jesus’ teenage years and Jesus’ 30s. But we do know that if Joseph did not choose to kill marry (for what people would’ve perceived to be adultery) that he would’ve earned a bad reputation amongst his peers.

The passage above hints, in a somewhat derogatory way, that Joseph had thrown away his reputation when he continued his marriage with Mary after he discovered her pregnancy. They don’t even refer to him by name.