Mental asylums are often depicted as dark, feared places of torment and scandal. Yet slowly the negative perceptions surrounding them have receded. This chapter explores whether there is a boundary that exists between community and asylum as Gittins argued or whether the relationship is more flexible and fluid. It deepens this emerging reinterpretation by examining how those living and working around former asylum sites in two local communities in the North West of England view their abandoned asylum as those sites progressed through conversion to residential accommodation. The study reveals the diverse meanings and interpretations of these sites, challenging the conventional interpretation of an asylum, for all times and all purposes, stigmatisation.