Save a describing text or some keywords with every user you want to remember.
Friendly person, funny or like-minded could be reasonable keywords to save.
Use this as a safe reminder that will not be visible to anyone but yourself.
Find users by searching within the saved texts on the Relations tab of your own profile.