Math is a language. Just like with any other language, the earlier you start, the better you can get at it.