I think that, while it's a noble endeavor to know what the back-stories are, those are the stuff of Hollywood movies. To add something here or to comment on why Joseph didn't have a response or why it isn't recorded if he had one, would not be good exegesis.
I could say that it was because Joseph doesn't have major role in any of the Gospels, but Mary's is seen to be by Jesus's side until death and even at the resurrection.
Or, that there are theories that Joseph was actually in his 80's when he married Mary (based on some of the Apocryphal writings) so he most likely died between the story of the boy Jesus in the temple and the start of his ministry. This would mean that Joseph didn't play a big part in the majority of the Gospel writers story leaving one to conclude that he just wasn't that important to include what he thought.
He lived forty years unmarried [from birth]; thereafter his wife remained under his care forty-nine years, and then died. And a year after her death, my mother, the blessed Mary, was entrusted to him by the priests, that he should keep her until the time of her marriage. She spent two years in his house; and in the third year of her stay with Joseph, in the fifteenth year of her age, she brought me forth on earth by a mystery which no creature can penetrate or understand, except myself, and my Father and the Holy Spirit, constituting one essence with myself.
The History of Joseph the Carpenter §14
The whole age of my father, therefore, that righteous old man, was one hundred and eleven years, my Father in heaven having so decreed.
The History of Joseph the Carpenter §15
This would mean that if he married Mary at the age of 89 (after Jesus was born) and died at 111, that would mean Jesus would have only been 22 when Joseph died. That is from an apocryphal writing though from the 5th century so is likely not an authority that we can trust but it shows one very early theory and could be possibly true. He would have been alive during the youthful temple visit but not when Jesus started his ministry.
The third was that, since Joseph was not of any blood relation to Jesus, the writers diminished his role other than the fulfillment of the line of David. After that Joseph has no significance.
However, all three of those answers are fully conjecture and cannot be supported by Scripture in any way (outside of the Apocryphal Writings) so it is a question without a real answer.