They are smarter than you think. No mob wants to face certain death. If they have no chance of winning, they will sit idly by and pretend they don't notice you.
Then there are those skellies and orc pawns. I can be level 70, and a skelly in commons will attack me. Must be cuz they got no brains.
(check out how a commons skelly is set up
)