Not unless you have an oral hsv2 infection. However, even if you have an hsv2 infection in your mouth then it's still very unlikely that you will infect them. This is essentially because hsv2 is not accustomed to that part of the body. If an initial oral infection of hsv2 occured, the chance of reaccurance is the lowest of all herpes reaccurances (less than 1% chance a year). Additionally, non-symptomatic viral shedding only occurs about 0.06% of the time, or about 1 day in 5 years.

If the infection isn't oral then you shouldn't have to worry if it's just plain oral sex. Herpes viral shedding occurs at the sites of the infections (where lesions occur during an outbreak) and not elsewhere in the body. Your immune system does a good job at isolating the disease after the initial infection and prevents it from spredding elsewhere.

I hope this helps!