What are you expecting it to look like? The default GTK4 theme looks very similar to GTK3’s Adwaita - see the following screenshot of the demo for an example:
If you want your app to look like a modern GNOME app, you will need to use libadwaita:
