For removing the baking soda, a very warm rag may work better than a sponge, but, again you'll need to rinse frequently. I would also use a steel pad when scrubbing the oven racks, it will provide a rougher scrub than a soft sponge.
Thanks for the tips, Sandra! I'll definitely try them! :)