Peephole Cam Not Tight on Door

I just got a peephole cam, and even when I tighten the nut as far as it will go, the camera is still loose on the door. Is it OK to use washers to fill in the gap, or am I doing something wrong? Perhaps the width of our door is narrower than most doors, but I didn't think so. I am not sure why I am having this problem.