How to deter my dog from 'marking his territory'?

When u put him down and u must watch carefully to see what he is up to and if he starts with the smelling thing and about to lift his leg, tell him NO in a stern voice and pick him up and take him outside. Mine use to do that, and it got to where I would say"dont you dare" and he would stop.