Could there be a kinect conspiracy?

I just purchased the new kinect for the xbox and the detail in the camera and the sensitivity of the mic is amazing. Because of this new "TECHNOLOGY" who really has access to watch and hear everything that goes on in your house? the government? microsoft? please chime in. should i unplug kinect every time i'm not using it? or is this as safe and secure as "they" want you to believe it is?