For ladders, yes. But take Horizon Forbidden West for example. Most rocks and cliff faces are climbable, but you can’t tell by just looking at them. You have to use your focus, their version of yellow paint, to see where you can and can’t go.

I find the whole yellow paint argument to be stupid. Back in the day, level design was so spartan, that if you saw a ladder, you could reasonably infer that you could climb the ladder. Nowadays, level design has become so rich in detail that you need a way to differentiate between objects you can interact with and objects that are just placed for fluff.