I've always been impressed with how light and clear chevron conventional oils pour out of the bottle compared to others, even full syn oils.
Otherwise yes, oil gets dirty by using it. Color isn't an indication of condition necessarily however.
An engine that gets routine changes with quality oil at moderate intervals will sometimes turn oil darker more slowly because the engine was clean inside already when it was poured in.
An engine that has been neglected can be more likely to turn oil dark more quickly due to the contaminants that were already inside the engine when the oil was poured in, that are now being picked up into suspension by the new oil.
And of course diesels turn it dark real quick, and all engines are different. Some accumulate fuel in the oil, have higher or lower oil temp, or have more or less oil shearing components, turbos, direct injection, egr... all things can affect how the oil performs and how quickly (or not) it changes color. Not to mention end user operating style.
The only vehicle I change oil based on color is my old hot rod truck. Odometer is broken (probably only 1k miles yearly), and it usually takes 3-5 years for it to start to darken significantly.