That's a good point - never thought to do that. Although my prob is ordering two or three items, so without opening and taking delivery, you'd never be sure whats being returned.
Although this hasn't happened with QVC (yet), I've had deliveries of things be dumped on neighbours before if they have struggled to deliver it to me. On one occasion I couldn't even retrieve one such parcel. Personally I would always make sure I've got the parcel safe and return it, it will cost money to return it but I'd rather that than nothing at all.
It doesn't matter if you can retrieve it or its lost, so long as you haven't signed for it you will get your money back. If you haven't signed for it, refuse delivery and it goes missing on the way back, all they do is send you a letter to sign to say you never recieved it, and again, you'll still get your money back. So why add more expense that isn't necessary?
I've had a courier sign my name for me, more than once. Hermes & Yodel have both done it, Yodel when it was chucked over the fence but Hermes lady came to my door! Better safe than sorry.