I’ve covered the lights on several of my devices with black nail polish. It works pretty well. Some of them have angles that it won’t adhere to very well, but even then it’s a lot less obnoxious.

One coat to dim slightly, 3-4 to block light effectively.