Yes, first start by replacing both bulbs and then test to see if they work. If so, replace any other bulbs in those lenses as long as everything is all apart for easy access.
Quick story...
A driver on the road tells my buddy that his rear brake lights don't work. So my buddy asks me for help...