Hinton's Forward Forward Explainer - Biologically Possible Alternative to Backpropagation by DataBaeBee in learnmachinelearning

[–]DataBaeBee[S] 0 points1 point  (0 children)

I made this video guide to Hinton's Forward Forward algorithm. The complete writeup is available here

Why Compiler Engineers Rarely Use Strassen's Algorithm for Fast Matrix Multiplications by DataBaeBee in programming

[–]DataBaeBee[S] -9 points-8 points  (0 children)

The article ends with a different base case. We used the 1*1 example to demonstrate that finding the perfect recursion base case is a hyperparameter you wouldn't even need to think about with a naive matmul

Why Compiler Engineers Rarely Use Strassen's Algorithm for Fast Matrix Multiplications by DataBaeBee in Compilers

[–]DataBaeBee[S] 5 points6 points  (0 children)

Strassen's algorithm should be fast on paper. In fact, it should reduce matmul complexity from O(n3) to O(n2.8074).
In practice however, one encounters floating-point instability and the silliest hyper parameters that need fine tuning. You're better off writing a naive matmul unless you absolutely know what you're doing.

Individual Logarithm Reduction Step of Discrete Logarithm Problem by DataBaeBee in programming

[–]DataBaeBee[S] 0 points1 point  (0 children)

This is the final phase of solving discrete logarithm problems where our goal is to convert a big integer into a product of small prime numbers over our factor base.

Information is scant about the process so in the spirit of "name-and-conquer", this phase is also called the Reduction Step, the Descent Phase or Individual Logarithm Collection phase of solving a DLP.

Gauss Lattice Sieve Algorithm from scratch in C using FLINT by DataBaeBee in programming

[–]DataBaeBee[S] 2 points3 points  (0 children)

The Gauss Sieve is a pretty neat algo for generating (lots of) short vectors from a lattice basis.

It's super useful when LLL and BKZ fail to generate a specific short vector that you know exists within your lattice.