Generally, of course, the answer is "Much of the time."
However, on Michael Bach's Optical Illusions site, the answer is "Almost all of the time."
I'd seen a few of these before, but they're always worth another look. That site has a huge number of excellent illusions, including explanations.
