The time I'm not spending with my kid has to be worth it, so when I sat down with my agents after I was ready to go back to work, I told them: It's all about the directors