Strange. I find that in Ubuntu the swappiness setting does make a difference. With it set to zero, "top" reports no swap used until all of RAM is used.
Most servers run Red Hat or CentOS, which may handle it differently.
It could be that Redhat changes the MMU to be more swappy, but we have no way of knowing that. We are on 5.x and 6.x is mainline. The 6.x MMU could handle swap differently.