most people find me annoying
7 out of 40 is not 'most', 21 out of 40 is 'most'.
This sort of situation is one that requires external evidence and not the use of the imagination.
If you want to believe most people find you annoying, that is fine, it is entirely up to you.
Myself, I would want to know specifically what it was that I was doing that was annoying them, then I could decide whether:
a) They were right and I would change my behaviour
b) They were wrong and I would carry on as I was
Roger