AFAIK, petroleum or “synthetic” lubes(Permatex green/purple and VersaChem blue as well as CRC black) will swell rubber. I’ve had problems using Permatex lube or the little packet in a set of pads on slide pins.The issue with Syl-Glyde and many of the others with a castor oil or petroleum base oil is their longevity is much shorter than a true silicone paste lube. However if switching to silicone, the old lube needs cleaned out which is fairly easy with brake clean or even gasoline, but once you put silicone lube on, it's very difficult to remove it all and I feel like there's no reason to switch back so it's a non-issue, except for that certain group of people who would put it on their caliper sliders (as I do), then later want to paint the calipers, and find the paint won't stick to any area that the silicone paste came in contact with... though I suppose enough wire brush action to remove a layer of metal should do the trick.
The Toyota stuff works well for me. It doesn’t last long but I apply a small smear every time the pads are replaced.