From my understanding, if a neutral is swayed that they become the alignment to which they switched to and win under their new factions win conditions so there is a chance that a neutral switches over to a new faction and they still lose. That is just my thoughts so not sure if they are correct.