This was raised as a feature request in a recent post in the Elementor Facebook Group. That request was to have a thumbnail image of the template in the templates listing.
Perhaps at some point, Elementor will provide this enhancement, but in the meantime, this video will show you how you can get this now.
The tutorial requires this plugin: Featured Image From URL