grow apart: stop having a close relationship because time, interests, etc, have changed.

*Although Lucy and Tim had grown apart, they lived together for the sake of their children.