Br. Brigham Spoke on the folly of apostasy, and the lying Spirit that Apostates give way to after turning away from the truth. Said that while Joseph And Oliver were translating the Book of Mormon, they had a revelation that the order of Patriarchal Marriage and the Sealing was right. Oliver said unto Joseph, '"Br. Joseph, why don't we go into the Order of Polygamy, and practice it as the ancients did? We know it is true, then why delay?'" Joseph's reply was '"I know that we know it is true, and from God, but the time has not yet come.'" This did not seem to suit Oliver, who expressed a determination to go into the order of Plural Marriage anyhow, although he was ignorant of the order and pattern and the results. Joseph said, '"Oliver if you go into this thing it is not with my faith or consent.'" Disregarding the counsel of Joseph, Oliver Cowdery took to wife Miss Annie Lyman, cousin to Geo. A. Smith. From that time he went into darkness and lost the spirit. Annie Lyman is still alive, a witness to these things.
[Source: Diary of Charles Lowell Walker. Andrew Karl Larson, ed. Logan: Utah State University Press, 1980. 349, in The Complete Discourses of Brigham Young, Ed. Richard S. Van Wagoner, Smith-Pettit Foundation, Salt Lake City (2009), http://bit.ly/BY-discourses]