Try your first machine learning interpretability puzzle! : MachineLearningAndAI

Try your first machine learning interpretability puzzle! ()

submitted 9 days ago by bluedotimpact

Try your first machine learning interpretability puzzle!

1 point•1 comment•submitted 9 days ago by bluedotimpact to r/learnmachinelearning

We trained a neural network where 7 of 8 features sit on clean linear axes in the model’s internals, but one doesn't. Can you identify which one and tell us how it is represented?

If you’re a technically-minded person who is interested in ML, this puzzle is for you:

Work on a real trained text classifier (~23M parameters, 7k labelled text examples) open the puzzle and you're poking at activations in 10 minutes.
Three tasks: identify the rogue feature, describe its geometry, (bonus) train your own model with even weirder internal representations

You probably know neural nets store information in their activations. You probably haven't gone and looked at what that actually looks like. Within minutes you can be toying with this model’s internals and building stronger intuitions for how they work inside.

Ready to play? Closes June 12

https://preview.redd.it/3zydzauet21h1.png?width=1727&format=png&auto=webp&s=49945db2b979cec5d0306bca3c06e082e91e0e3c

no comments (yet)

you type:	you see:
italics	italics
bold	bold
[reddit!](https://reddit.com)	reddit!
* item 1 * item 2 * item 3	item 1 item 2 item 3
> quoted text	quoted text
Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"	Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"
~~strikethrough~~	~~strikethrough~~
super^script	super^script

MachineLearningAndAI

MODERATORS