First: You shouldn't care about what others think.
I can understand why your husband thinks it's too late for him. I am also in my 50's and my daughter has a 6 months old son and I could never do that again. It's not just now but if that newborn is 20 your husband is 71.
I also have a mail filter, I have been hosting my own mail server for the last 25 years.