I seem to remember reading that because of the type of DNA exchanged, the DNA exchange came almost exclusively from homo sapien males fucking neanderthal females. So probably our species’ men were often rapey back then too.