Where Shouldn't You Use Baking Soda to Clean? Some issues that may arise when using baking soda are that you use too much or don’t rinse the area thoroughly. This can “leave a chalky white ...