Therapy Help, please

Hello everyone. I have a dilemma: I am trying to move on from my first therapist, whom I considered too conservative to deal with issues like sexuality. Meanwhile, my current and second therapist seems helpful and sensitive in demeanor. However, he has a criminal background: he had intercourse with a patient within three months of their final session (technically, they did not seem to be patient and counselor anymore) and additionally kept clients’ confidential files at her house illegally. He was put on probation for I think about a year. This was 12 years ago, his actions. He has told me he was rightfully punished and indicated he would have accepted whatever punishment the Board of Counselors would have given him. In his defense, he remarked that he was allowed to continue practicing.
What should I do? Should I look for a different therapist altogether?