How early do you start teaching kids a second language?

Even though my oldest hasn't mastered English yet I keep wondering if exposure to a second language early would benefit him. Are there any dual language speakers here and if so at what age did you learn your second language?