i’ve never received explicit feedback about others being unnerved by it, but an implicit expectation of not remembering a situation or detail feels present
fwiw i try to remember very specific things about e.g. what i talked about with people, what i liked about interacting with them, and usually that goes over very well, ime people are very flattered