Can I be sued for libel or slander?

I found out that my husband had a 3 year affair with a woman who works for the bank he used to deal with. I want to go into the bank and "call her out" and embarr her. I contacted the bank and found that they will not fire someone even if they had an affair with a bank customer, so I would only be doing it so that the people she works with know what kind of person she is. Could she sue me for libel or slander? I would not be lying about her having an affair with my husband and he would back me up if questioned.