The Stepney Arms Hotel, originally the Ship and Castle before becoming the Stepney Arms, was probably built c.1828. Locally, the inn was nicknamed the `Slaughter House? due to the availability and price of strong drink. The business was also served as a Royal Mail coaching inn in the nineteenth-century owing to its situation on Park and Water Streets, as well as an inland revenue office from c.1840-41.

The hotel was a large, Victorian-style building with later Edwardian and modern extensions to the rear. The building faced Park Street to the south-east, presenting two large three-storey blocks. The western block was of four bays with oriel windows in the second and third storeys of the first and fourth bays, the first storey and the second and third bays of the second and third storeys having large sash windows. The eastern block was of two bays, with a similar oriel windows in the second and third storey of the second bay, sash windows in the second and third storey of the first bay, and a large service door in the centre of the first storey. Formerly, the inn was entered through a porch in the western wall of the eastern bock, but sometime after the turn of the twentieth century a -storey wing was added between the two blocks with three windows and a large arched double-door entrance. To the rear of the western block was a side elevation with a blocked door and arched window, likely formerly a stable block but later used as the women's toilets.

Internally, in modern times the downstairs of the building served as a public house and club, containing four bars. The upstairs contained around twenty bedrooms and other assorted rooms such as storerooms, offices, and a kitchen. The most notable internal feature was a Victorian twin curving staircase extending between the ground and first floors which had a wrought-iron balustrade and a wooden handrail and was lit by three large clear- and stained-glass windows with floral patterns in their centres.

The building fell into disuse in 2004 and deteriorated into a state of disrepair. By 2008, it was decided that the site should be demolished. The site is now (2018) occupied by the Ffwrnes theatre.

(Sources: Richard Scott Jones, Archaeological Standing Building Recording: Stepney Hotel, Upper Park Street, Llanelli, Carmarthenshire (Cambrian Archaeological Projects Ltd.: 2008))
A.N. Coward, RCAHMW 10.05.2018