I don't recall seeing any mention of swing speed on any weapons, although I don't know how dated the tooltips I've seen may or may not have been. But I'd imagine there won't be swing speed differences between different types of one handers and two handers (obviously two handers will likely be slower than one), for the balance reason you've brought up and for simplicity. Although I'm sure there will be stats that let us swing/attack faster.