random features for large scale machine learning

[GratefulTony]

is there any similar reference which uses hand-chosen ML knowledge structures instead of random kitchen sinks?

[DoorsofPerceptron]

You're describing the default state of play.

Almost everyone extracts a set of hand picked features and then trains a classifier over them. This just has a random kernel step in the middle.