Women attending islamic talks at masjid without a mahram

If the speaker, who is an Alim, knows or should have reasonable cause to believe that women will be travelling to the Masjid on their own at night, without niqab, should he still give a talk or refuse to do so?