Yes, you can edit the default texts/captions in most of Magazine templates. However, for some templates with special fonts used or the text has already been a part of the template, the captions/texts may not be available for edition.
Sample template with editable captions/texts
Sample template without editable captions/texts
