I have had a few delivery people knock on my door for signature required deliveries (usually for my wife). I don't think I'm too scared, it is more of the complication re who you say you are and sign as that prevents me opening the door.
If it was the police then I would open it no problem and would not expect them to give me any grief re my mode!