This she was able to do all the more effectively because the father soon left the son in her charge and returned to the United States in the employ of the French government, and before long became attached to the army under La Fayette. This could not have been later than 1781, the year of Cornwallis' surrender, and Audubon would then have been twenty-one, but this does not square with his own statements. After the war the father still served some years in the French navy, but finally retired from active service and lived at La Gerbetiere in France, where he died at the age of ninety-five, in 1818.

Audubon says of his mother: "Let no one speak of her as my step-mother. I was ever to her as a son of her own flesh and blood and she was to me a true mother." With her he lived in the city of Nantes, France, where he appears to have gone to school. It was, however, only from his private tutors that he says he got any benefit. His father desired him to follow in his footsteps, and he was educated accordingly, studying drawing, geography, mathematics, fencing, and music. Mathematics he found hard dull work, as have so many men of like temperament, before and since, but music and fencing and geography were more to his liking. He was an ardent, imaginative youth, and chafed under all drudgery and routine. His foster-mother, in the absence of his father, suffered him to do much as he pleased, and he pleased to "play hookey" most of the time, joining boys of his own age and disposition, and deserting the school for the fields and woods, hunting birds' nests, fishing and shooting and returning home at night with his basket filled with various natural specimens and curiosities. The collecting fever is not a bad one to take possession of boys at this age.