Is it really appointed unto a man once to die and then the judgment? Let me ask you a question. How many times did Lazarus die? Unless you believe he is physically alive today then you know that Lazarus died and was raised from the dead, but then some years later he died a natural death again. He died twice. Plus, what about all those thousands of people in our day who were clinically dead for some time and then came back?
So maybe, just maybe this verse has been used out of context.