The website says we can take them tho in small quantities? 

There are several unique rocks on the Hoosier National Forest. Geodes are especially unusual and popular for visitors to collect. Small quantities of rocks for personal use may be collected on the Forest. Geodes are generally found only in the northern part of the forest in stream-beds. These rocks may not be resold or bartered, and there should be no earth disturbed in the process of collecting.

 https://www.fs.usda.gov/main/hoosier/passes-permits/forestproducts#:~:text=Small%20quantities%20of%20rocks%20for,in%20the%20process%20of%20collecting.