Umm… is it (less?) rude if you ask politely and offer your own discard over in exchange?
Also, I can corroborate that US players sometimes decline this exact offer. While I don’t think it’s considered “rude” here, I think the decline is more for “sexy” points…