Buttigieg shared more on Saturday and tweeted a photo of him and Chasten, each cradling a newborn.
“Chasten and I are infinitely grateful for all the kind wishes since we first shared the news that we were going to be parents,” the secretary wrote on his personal Twitter account. “We are pleased to welcome Penelope Rose and Joseph August Buttigieg into our family.”
He did not disclose any further details about the babies, such as whether they are twins.
Buttigieg, 39, has spoken publicly about his desire to become a father since campaigning for the Democratic presidential nomination in 2020.
Buttigieg, the former mayor of South Bend, Indiana, and Chasten, 32, were married in June 2018. Buttigieg’s father Joseph died six months after the wedding.