Your previous character name will show up as a "former name" on the character page for 6 months. The old name can also be used for the same time to recover the account in the Lost Account Interface or to search the character in the Characters section.
An exception to this is when the character name gets locked due to being offensive. In that case it will not show up on the chracter character page as a former name.