Being slowed doesn't stop you from shifting as a move action, it's only moving INTO a difficult terrain square that costs two speed and you can shift out of difficult terrain as well.
So, basically, if you're standing on a lone difficult terrain square while slowed, you could shift out of it or...