Yes it's called a lazy eye - mine is slowly getting worse and going that way.
Usually (well with me) It's because my right has been damaged by glaucoma and has very little sight left.
Now if you have normal vision as you move your eyes they generally move together but fine tune a little automatically: wider apart or closer together depending on the distance of the object you are focusing on. It's how you judge distance and see 3D as it all goes to the brain for processing.
Now (with me) when one eye is blind or lost most of its vision, the brain adjusts and start to ignore that input and so it can drift on its own. Then in my case the bad eye can catch a bit of a brightly lit object and the brain automatically kicks in and tries to adjust it back again but then hasn't got enough input to lock it all up, so it drift the other way.
This can only get worse as the sight in that eye slowly gets worse with age. (But I have had an op to relieve the pressure and so more rapid damage has been stopped) (The good eye gets done next year to save that from going down hill)