I have always unplugged my keyboards from the power point on the wall.I have owned 2 yamaha PSR's in the last 10 years, on which the ON/OFF switch on the KB would NOT turn off.
Interestingly ,the switch on the KB never ever refused to work when I was turning the KB on.