I don’t think he actually loves her the way he does with the other 3. At best he could offer her a place in his household, but it would not be as a partner.

Sylphie would be able to detect that there isn’t true love between them and that would be what could end their marriage.