The greatest torment and mental suffering Joseph had was because this people would not live up to their privileges

From the journal of Heber C Kimball:
“The greatest torment [Joseph} had and the greatest mental suffering was because this people would not live up to their privileges. There were many things he desired to reveal that we have not learned yet, but he could not do it. He said sometimes that he felt pressed upon and as though he were pent up in an acorn shell, and all because the people did not and would not prepare themselves to receive the rich treasure of wisdom and knowledge that he had to impart. He could have revealed a great many things to us if we had been ready; but he said there were many things that we could not receive because we lacked the diligence and faithfulness that were necessary to entitle us to those choice things of the kingdom” (Extract from the Journal of Heber C. Kimball,” Times and Seasons 2:1841, 6:1845.)