Optomagnetic studies of the effect of mixing of electronic states of a rare-earth ion in erbium-yttrium aluminate-garnet