As long as you are out of the line of sight for the speaker, your voice will not be amplified over the system. To be safe, it is best to turn off the microphone, or place your hand over the sensor when having private conversations.