It has happened to me more times than I care to count. In fact, it is such a common occurrence during the late spring and summer months that I have grown to accept it and expect it. Just when I think I have the bite figured out, the fish up and move.
Big water walleye are roamers, plain and simple. They are nomadic in nature and will be on one piece of structure for a few hours and then be gone.