Who says you have to be fair? Do what ever is right for you. If others don't like it, too bad.
E.g. My aunt's name is Kathleen and there are very, very few people who are allowed to use a nickname with her (the exception being her husband who can call her Katie). She set her boundaries that worked for her and it works.
