I'm slightly allergic to peanuts now and every tree nut except for almonds, so I'd choose almond butter. LOL.
I think the brand matters. Since almond butter is more niche, it probably has less sugar than peanut butter. I used to eat a lot of peanut butter before it started to bother me. There is a big difference between Skippy and the "healthy" peanut butter. Skippy tastes a lot better.
I've been eating sunflower butter. It's more expensive than peanut butter and the oil separates so you need to mix it back together. The taste is excellent.