Explanation

The phrasal verb "turn to" means to address or appeal to someone, which fits the context of him criticizing you.