Leaving rented property, legal rights?

Shouldn't you be more worried about the possible implications of leaving with "our little one" who belongs to your ex as much as he/she belongs to you. He is legally entitled to fight you in court irrespective of the state of your relationship