Trinity Almshouses, Mile End Road, Tower Hamlets, Chapel dilapidation