I think that the most likely explanation is that both environment and genetics are factors. In order to view inequality of outcome as proof of inequality of opportunity, you have to believe that group differences are due entirely to environmental conditions. That's a rather extreme position to take.