De-oil and neutralize. Then re-oil heavily. Then just keep it oiled going forward.

I do not think that all rust blue solutions say to use baking soda in their instruction steps, but anyone who knows better will do so as a precaution. I personally use Mark Lees bluing solution at it is very fast acting and the instructions specifically say to use baking soda after the last cycle.

As an update it has been 3 weeks since I wiped them down the one time with oil and the rust hasn't come back, so it may have just been a random thing. If the rust doesn't come back, I don't think I will bother with neutralizing.