It's pretty much the shift getting in gear, most cars don't hop into gear quickly while downshifting, but instead slowly ramp-up the RPM's creating a great deal of heat and clutch-pack wear. I've seen some people toss their car into first gear at 40 mph, and the rpm's take about 2 seconds to go from under 2k rpm's to 5,000 rpm's which has got to be bad.
You say that you keep it under 2k RPM when downshifting, that should be pretty good. Just as long as it doesn't seem to slowly ramp up the speed when you downshift. Whenever I downshift, I will usually slow down to the speed that it would usually upshift out of the next gear beyond what I am trying to get into when I am accelerating at a very slow speed, so for example I'll put it in first gear after I am down 20mph or less, and second gear I'll be going less than 40mph. I've found out that when downshifting if I give it a little bit of gas until it is in the lower gear, it will reduce any 'ramp-up' in rpm and make the shift a little easier on the transmission.
If there is a stop sign before going downhill, as in half of the hills I go down, I will put it in the lower gear ahead of time.
Most people would recommend shorter intervals on ATF when it is used in mountainous ranges and some people on these forums might mention that using synthetic ATF could provide better protection and possibly longer fluid life as well.