You can filter out the UPB signals, but it would be my last resort. I have a large LED message display in my kitchen, where UPB signals would show up as dots walking across the display. For that I used a plug-in UPB filter, and it did work. The problem with filtering power to a light switch, and meeting code, requires you to install another outlet box to put the filter in, and it has to have a cover that is accessible. You also have to add up all the max. wattage of the fixtures that switch controls, and your filter has to be rated for that wattage, even if your actual wattage is much less.
I think a better route to go would be to get a switch designed for LED lighting. For example, Lutron has the C.L. dimmer line if its not a UPB switch, if it is, HAI released a UPB LED light dimmer in August. These should not flicker with LED lights.