The couple wed Saturday at The Lodge in Canberra, marking the first time an Australian prime minister.