Will movement of a retaining wall affect my house?

No. So long as your house has been built correctly with its own independent footings for support, or if the retaining wall has been purposely built to support any part of the house. There is, however, a chance of the retaining wall collapsing onto your house, depending upon how close to your house the wall is.