Depends on the particular mail provider. For example, Google for example, in any case, will make the face a box and say that he deleted everything, even if the FBI comes with a warrant, although it certainly does not delete anything.
Yahoo, too, probably keeps it forever, but he won't give anything to the police either - he keeps it only for the gebni.