You are probably right if you are adding someone with any mutual friends. If you can frame it more as "I saw you comment on x's status so I added you" that is fine.