I think the vestigial structures remain because there is no selection pressure against them because there is no disadvantage associated with their continued existence, they will likely continue to exist until and unless they are deleted by genetic drift across the population or environmental conditions change to such an extent that the structure becomes either beneficial or harmful and can then be selected for or against.