Once you click that Edit button on one of your comments, all you can do is complete the edit. You cannot cancel your edit inline, and must reload the thread page instead.

There should be a standard Cancel button.