Hello !
Elastics are really strong constraints (as it fix the 3D coordinates of your track). Therefore it's not unusual to have poorer score for the 3D residual because the corresponding 2D tracks are always a little noisy. But the final result should be exactly adjusted.
About tracks that get out of frame, you have several solution to handle this. Setting 2D key type will have no effect on the 3D solve.
Either you just filter the computed camera path in the graph editor.
Or you interpolate the 2D track when the track disappear, to keep it smooth. To do so, just select the frame range and use "2D Tracking / Interpolate Track". This will fill the holes, even if the track gets out of frame.
Once you have some solid manual 2D tracks, do not hesitate to launch an automatic tracking that will generally smooth the camera path.