Hi,
At the calibration step there is no pattern recognition. So this is not the cause of your pb. The feature detection and correspondences are made by the user (Marker tool).
Have a look at http://www.realviz.com/board/viewtopic.php?t=884 , where i tried to summerize some tips for placing markers.
Your idea of placing markers on the walls is good, but be sure they are well distributed in 3d (not all in the same plane).
For rooms, placing a central object that is seen in allmost all shots is also a good help for calibration.
Hope it helps,
Stef