If you view a 'daylight white' patch under 3000K light, it will have an orangish (warm) appearance that your brain accepts as 'white'. If you have a critical eye, you will know 'warm lighting'.
The danger of print evaluation under a warm light is that you might not be able to judge with accuracy what is truly neutral, and you might correct to overly warm/cool final print. OTOH, if as you say "your clients don't evaluate under neutral conditions either, does it really matter?!" Hard to argue against that.
Put another way, if we cannot control if our clients use overly cool monitors or overly warm monitors or even ones that have an off tint to evaluate our images, "Does it really matter" that we correct our images to neutral? I still say, 'Yes' because we do not want a critical eye with a neutral set of evaluation conditions to find fault with our inappropriately adjusted image!
Does it truly matter? I'd say "Probably it does not truly matter...as color printers judging color balance in our darkrooms and less than perfect print viewing conditions (open window light can be remarkably cool or warm, depending upon weather and time of day) we got along for decades for most circumstances. But as 'keeper of the faith' we owe it to others to get it as close as we can, and be the bearer of the standard.
And deleterious conditions are not 'daylight'...it is ALL bright light!