Steinberg was born in Winnipeg to Jewish parents. His father Alexander Steinberg was a cantor and conductor. He went on to study music at the Royal Conservatory of Music and music education at the University of Toronto. Throughout his career, Steinberg focused on Jewish and Canadian music.