Smart homes are indeed mostly build out of supporting laziness, but there are ways to avoid some of these problems.
If you've already sold your soul and have a home device with speech control, it's actually pretty easy to go and get a smart outlet device to control some lights. A single phrase without any screen or authentication and you're controlling your lights. If it breaks or gets outdated, you can always take it out in 10 seconds. Basically, if you do go for a smart home, keep it dumb and overridable.
If you've already sold your soul and have a home device with speech control, it's actually pretty easy to go and get a smart outlet device to control some lights. A single phrase without any screen or authentication and you're controlling your lights. If it breaks or gets outdated, you can always take it out in 10 seconds. Basically, if you do go for a smart home, keep it dumb and overridable.