In one episode, Lex remarks to Nigel that they are really a couple of street fighters, or something to that effect. We know that Lex has a rags-to-riches story, so I'd suggest the same for Nigel. I like the wrong-side-of-the-tracks to scholarship at Oxford or Cambridge to MI-6 (the MI-6 part is cannon) to rogue idea.
