Can I use baking soda to bathe my baby? Did you know that using baking soda bath powder for babies helps to reduce itching, remove odors, and dirt? Just try giving your baby a bath with baking soda powder to see if it works.