I think there are a lot of us who have never actually said the word "fanfic" to anyone else who we don't already know likes fanfic.
When I was TAing a senior-level 1 credit computer programming class, I caught one of my students looking at fanfiction.net on one of the computers instead of working on her program, and I kicke her out of class instead of admitting that I knew exactly what she was looking at :p .
There are probably quite a few of us who would never utter the words "fanfic" or "Lois and Clark" in public.