Taunton Castle was built in the 12th century and stands on the site of fortification that have been protecting the county town for much longer.