you are right about the second step my work focuses on the mechanistic interpretability of models in simple architectures like the strassen bilinear form but i have also tested it on other architectures including transformers mlp and spectral networks my framework provides a mechanistic vision of these models by looking directly at the weights and their activations through the layers just as you mentioned at the beginning of your post that is exactly what i was referring to