How do I remove/delete a baby from my list?

Swipe left on the baby's name to add it to the archive. In the archive, you can either swipe left on the name again to restore the baby to your main list or delete it permanently.