If you watch the Brady Bunch backwards, you find out they killed Oliver, and the grief over his "disappearance" caused the family to split with the mom taking the girls and the dad taking the boys.