The X Men Origins: Wolverine star topped People magazine’s annual poll last year and although he was delighted by the honour, the actor admits he is ready to pass the title onto someone else so he can stop looking after himself.
He said: "The pressure's off. I can be a slob again. I thought there were thousands of other guys that deserved it, but it's been a great year."
Despite his comments, Hugh insists he would happily accept the accolade if it were offered again.
He added to People magazine: "I want to be the first to have it back. That would be fantastic!"
Previous stars named Sexiest Man Alive include Matt Damon, George Clooney, Johnny Depp, Matthew McConaughey and Jude Law.
Although he is a pin-up for many women, Hugh is happily married to actress Deborra-Lee Furness, who he wed in 1996.
The Australia star recently revealed he and Deborra always make time to just be with one another to keep the romance in their relationship alive.
He said: "Make sure you have a date night just the two of you together, without the kids."
The 41-year-old actor has two adopted children, Oscar, nine, and Ava, four, with his wife, who he met on the set of Australian TV show 'Correlli'.
Click here for more Entertainment News