Built by the Dutch East India Company between 1666 and 1679, the Castle is the oldest existing colonial building in South Africa. It replaced an older fort called the Fort de Goede Hoop which was constructed from clay and timber and built by Jan van Riebeeck upon his arrival at the Cape of Good Hope in 1652.