All Saints' Church was located on the west side of High Street on its corner with Pencerrig Street. It was built in 1896-7 to designs of architect E.M.Bruce Vaughan. Larger than usual for this architect, even with a substantial south-east tower towards the road, an addition of 1909 not at first intended. To the rear were built two storey halls by the same architect. The church became derelict and was demolished in 1994.

Sources:
J.Newman, Buildings of Wales: Glamorgan (1995), p.373.
https://www.flickr.com/photos/bigaldaviesishere/5155045188/

David Leighton, RCAHMW, 22 December 2014