Maybe I should have said looks and feels right. I seriously doubt there are many who could consistently differentiate the tonal difference between rosewood and ebony fretboards, all other things equal.
I'm sure that you're right in most cases.
However, we have to remember that when we hear something, the sound has to be
interpreted by our brains. It isn't just "there it is." This is why, for example, your brain can filter out background noise at a party and concentrate on what the person you're talking to is saying. This ability to interpret takes place in real time.
We all know about people with perfect pitch, but very few have it. On the other hand, most folks have a sense of relative pitch, but that also varies from person to person.
There are folks who "can't carry a tune," and folks who have a great sense of pitch. There's a reason for this, and it's that ear/brain interpretation - processing thing. I think it works almost like eye/hand coordination. A pro baseball player has a much more developed sense of eye-hand coordination than I do. I'm a pretty poor athlete for that reason.
On the other hand, I've always had a knack for identifying notes and intervals. I hear formant and color differences between various note pitches. A lot of people don't.
So we're all different, and all of our abilities to perceive this stuff, and to even truly understand what to listen for, are going to vary wildly. With the concession that I may in fact be overestimating my ability, I think I might be pretty decent at being able to hear and interpret these differences.
EDIT: It occurred to me as I'm sitting here this morning with a mug of coffee that it doesn't matter at all if anyone can consistently identify whether this guitar and that guitar were built with this kind of wood or that kind of wood. What matters is whether or not they sound different from one another.
If a person can say that this one sounds different from that one, it's a little brighter, or a little darker, or a little fuller, or a little thinner - well, that's enough.
Now as to how you achieve that, over time the experience of luthiers and players can offer some guidance, but the results of wooden instrument building can't be 100% consistent.
In an amp thread I posted, I stated that inconsistency is also variety and individuality. That's not a bad thing!