St Matthew's church is located on the north side of Ralph Street at its junction with Dorothy Street. It was built in 1907 to designs of architects Evans, Williams & Evans of Pontypridd. It was built in Lancet style and was notable for its red terracotta arcades. Interior features also included a reredos with copper silhouettes of Christ and the twelve Apostles.
The church closed in about 2010 but no further information on its fate is recorded.

Sources:
J.Newman, Buildings of Wales: Glamorgan (1995), p.522.
http://blog.stuartherbert.com/photography/2010/09/17/merthyr-road-the-terracotta-church/

David Leighton, RCAHMW, 13 January 2015