Right now I am just using nautilus (default GNOME file manager) but in past I was using Thunar (default XFCE file manager). I’d be pretty surprised if whatever file manager you are currently using doesn’t support SFTP out of the box. Typically you can just enter something like sftp://myhost.example into the location bar. They may also have a dedicated network connection section with a wizard to add it.