You can't have only male genetic matter ... not if they have chromosomes like everything else. Even if male fauns are the homologous sex (have, say, two X chromosomes rather than XY), that leaves the problem that all the OTHER species would have to have heterologous sex chromosomes ... and that simply isn't the case for mammals, which I would classify all of the above except Dryads as (Dryads are just weird, and plant genetics are COMPLICATED)

I second the dying race idea though.