The ambitious businessman said he wants his project to "inspire and innovate".
Some of the fortresses eldest parts date back to 1775 and saw Napoleon use it as a defence.
It later served as military barracks in the Crimean War and both World Wars.
In 1956 it was given to the HM Prison Service and became a Young Offenders Institution until 2002.
There's still a 1970s prison block with over 60 cells across three floors on the abandoned site and an anti-suicide net is still in place.
A swing hangs over the netting, and Mr De Min explained he was lowered 130-ft down into the on-site well.
He said: "I was hoisted down to fetch a sample of water to see how pure it was.
"There's a jar of the water in my office, it's crystal clear, perfect, and means we have our own water source which fits in with our sustainability ethos."
It was then used as an Immigration Detention Centre up until 2015.
The Citadel is made up of a whopping 54 buildings totally around 220,000 square feet.
Below lurks around 30,000 square feet of eerie tunnel networks.
Now, the atmospheric location is sometimes used as a film set, including an upcoming Marvel movie Kraven the Hunter starring Aaron Taylor-Johnson.
Mr De Min even landed himself a small role as an extra, playing an inmate.
Despite it's dark history, the entrepreneur is determined to forge an entirely new future - although it could take up to 25 years.
"What we're hoping to do is to install a stage complete with lighting and speakers for a Dragons' Den-style TV show, where budding entrepreneurs will pitch ideas for innovations in business and technology," he said.
"In front of the stage will sit five potential investors, all well-known billionaire businessman. I've had the greenlight from Sky TV to start production."