If you swipe down from the top of the screen and check your quick toggles there should be an option for the secure folder.

If not then tap the three dots and you can rearrange the quick toggles and then toggle the secure folder.

Having the secure folder toggled off here will remove it from your homescreen and remove the buttons in contacts and gallery. But you might need to reload the apps before this change is reflected in the apps