In 1572 it was the Cellebroeders monastery located. From 1572 to 1723 the building served as Dolhuys or Dolhuijs. This meant that mentally ill or insane were collected in the location. Dolhuys was thus an early and primitive forerunner of today's psychiatric institutions. In 1723 it was sold Dolhuis and the residents moved to Leprooshuis in Vriesstraat. The building was privately owned.