The twice Olympic gold medallist, who dominated 1,500m swimming for a decade, had been an ambassador for the Alannah and Madeline Foundation. He has been relieved of his duties with the charity after pictures emerged of the apartment he destroyed during an argument with his wife, singer Candice Alley, last October.
The pictures were published in Australian newspapers on Sunday, and showed holes smashed in walls, furniture tipped upside down and a bedroom door apparently kicked in.
Hackett, who recently separated from Alley after five years and two children together, originally played the incident down as an "unfortunate misunderstanding". He also recently angrily denied having a drinking problem in an interview with the Sydney Morning Herald.
"I, like most Australians, enjoy having a drink with my mates. However, to say that I'm a party animal or go out regularly is hurtful," he said.
"Like when I was swimming I'm completely focused on what I'm trying to achieve and providing for my family."