The ruins of the castle stand in the town of Dudley, fortification on this site dates back to 1071 following the Norman invasion in 1066.