The ordering of octahedral Al3+, Fe3+, and Mg2+ cations in dioctahedral 2:1 phyllosilicates was studied theoretically. Quantum mechanical calculations based on density functional theory (DFT) were performed for optimizing different cation distributions along the octahedral sheet. Three systems of two species (Al3+/Mg2+, Al3+/Fe3+, and Fe3+/Mg2+) were studied to obtain the cation exchange potentials Jn as first, second, third, and fourth nearest neighbors. Monte Carlo (MC) simulations based on the previously calculated cation exchange potentials Jn of these binary systems showed ordering phase transition in the distribution of the octahedral cations, with different ordering patterns. Ordered phases are depending on composition and on third and fourth neighbor range interactions. The effect of hydrostatic pressure can affect the cation ordering of the octahedral sheet. The two-species model was extended to a three-species ordering MC simulation model. In our case, we do not find perfect long-range ordering in the three-species systems. Instead we find some domains with different ordering patterns.