The manual words are not that explicit and says nothing about "topping off". The way it's written, if someone changed their oil and couldn't find 0W-16 then they could use 0W-20, but change it back to 0W-16 at the next oil change ... which could be 10,000 miles later.
So if 0W-20 is going to "damage" the engine it would certainly do in within 10,000 miles of use. If that was the case, Toyota wouldn't have that statement in the owner's manual. Plus, there is not one word or big WARNING box in the owner's manual saying that using anything but 0W-16 is going to damage the engine. If that was the case, Toyota would have it all over the owner's manual.