The building was used as a palace by the Dukes of Medinaceli and was later provisional guest quarters for bishops on their way to the Diocese of Segorbe. Currently it is undergoing renovations.