I want to blame Robert Heinlein for this. There are likely examples of prior art but I know Heinlein really pushed that whole 'Geniuses make their own rules about sex' narrative.