The caveat is that free accounts come with restrictions on certain features that could be used to disrupt the game experience of other users.
If you don't want to purchase Guild Wars 2 right away, you can play the entire core version of the game entirely for free.