Joseph Parry was born in No.4 Chapel Row on May 21st 1841. His father, Daniel, came from Pembrokeshire and his mother came from Camarthenshire. He was one of eight children and at nine years of age he began work at Robblin's pit which was on the hillside above Ynysfach. He later worked with his father in one of the Cyfartha puddling mills. At the age of thirteen he left Merthyr with his family for Danville, Pennsylvania.
Once settled in America he soon showed a talent for music and his compositions were successful at many Welsh Eisteddfodau.
In 1868 he returned to Britain to study the Royal Academy and in 1874 he became professor of music at the university college of Wales, Aberystwyth.