Can the certification authority track my e-mails down?

Using a client certificate does not threaten your private life.

The certification authority does not know that you are signing an e-mail. It does not know either who this e-mail is sent to. There is no communication between your e-mail software and the certification authority.

Nevertheless, if you bought a class 2 or higher client certificate, your signature has a legal value and your exchanges are binding!