Imagine watching a movie mid-way. In the movie, a seemingly innocent man is playing with his kids and then some policemen knock at his door, arrest him, and take him away. You might think this is so horrible! “Why did this happen? He doesn’t deserve it!” But having come in mid-way, while the movie was in progress, you may not have witnessed what had already happened. Perhaps the man had earlier committed some fraud or scam, or conspired a murder.
So, based on superficial appearances, one might say, “Oh, he was such nice father. Why did he have to suffer so?”