I recently inquired about this r/gnome here, wanting to know if there was something already implemented. Seems like that is not the case. Sushi is an option, but its not as seamless as something built in. I used to use the file preview regularly and it seems to be missing like a sore thumb in Nautilus.