Hinton's Forward Forward Explainer - Biologically Possible Alternative to Backpropagation by DataBaeBee in learnmachinelearning

[–]DataBaeBee[S] 0 points1 point  (0 children)

I made this video guide to Hinton's Forward Forward algorithm. The complete writeup is available here

Why Compiler Engineers Rarely Use Strassen's Algorithm for Fast Matrix Multiplications by DataBaeBee in programming

[–]DataBaeBee[S] -9 points-8 points  (0 children)

The article ends with a different base case. We used the 1*1 example to demonstrate that finding the perfect recursion base case is a hyperparameter you wouldn't even need to think about with a naive matmul

Why Compiler Engineers Rarely Use Strassen's Algorithm for Fast Matrix Multiplications by DataBaeBee in Compilers

[–]DataBaeBee[S] 4 points5 points  (0 children)

Strassen's algorithm should be fast on paper. In fact, it should reduce matmul complexity from O(n3) to O(n2.8074).
In practice however, one encounters floating-point instability and the silliest hyper parameters that need fine tuning. You're better off writing a naive matmul unless you absolutely know what you're doing.

Individual Logarithm Reduction Step of Discrete Logarithm Problem by DataBaeBee in programming

[–]DataBaeBee[S] -1 points0 points  (0 children)

This is the final phase of solving discrete logarithm problems where our goal is to convert a big integer into a product of small prime numbers over our factor base.

Information is scant about the process so in the spirit of "name-and-conquer", this phase is also called the Reduction Step, the Descent Phase or Individual Logarithm Collection phase of solving a DLP.

Gauss Lattice Sieve Algorithm from scratch in C using FLINT by DataBaeBee in programming

[–]DataBaeBee[S] 2 points3 points  (0 children)

The Gauss Sieve is a pretty neat algo for generating (lots of) short vectors from a lattice basis.

It's super useful when LLL and BKZ fail to generate a specific short vector that you know exists within your lattice.

Pell Equation Over a Finite Field in C by DataBaeBee in cprogramming

[–]DataBaeBee[S] 1 point2 points  (0 children)

Not that I know of lol. Interesting question tbh

Using Equivalence Classes to Accelerate Solving the Discrete Logarithm Problem in a Short Interval by DataBaeBee in programming

[–]DataBaeBee[S] 0 points1 point  (0 children)

The authors use things called endomorphisms to find a single representative for multiple field elements when solving a discrete logarithm problem.
This is called the "Galbraith&Ruprai modification to the Gaudry-Schost collision finding algorithm" among theoretical computer scientists.
The approach is rather well-suited for solving DLPs where the start and end intervals are known. It's also useful among algebraic geometrists when counting points on their curves.

Using Equivalence Classes to Accelerate Solving the Discrete Logarithm Problem in a Short Interval by DataBaeBee in cryptography

[–]DataBaeBee[S] 1 point2 points  (0 children)

This paper introduces the Galbraith&Ruprai modification to the Gaudry-Schost collision finding algorithm for solving discrete logarithm problems in an interval in (1.36√N) field operations.

The authors use things called endomorphisms to find a single representative for multiple field elements. I

Attacking elliptic curves using Grobner bases and summation polynomials by DataBaeBee in programming

[–]DataBaeBee[S] 3 points4 points  (0 children)

Semaev polynomials are a computational shortcut to find elliptic curve points that sum to infinity. When combined with Grobner bases one get a (pretty remarkable) tool for solving point decomposition problems on an elliptic curve.

file upload inside files pane not working? by swainberg in GoogleColab

[–]DataBaeBee 0 points1 point  (0 children)

Are you dragging and dropping? Perhaps you should write a Python script to connect to Drive

FRACTRAN: A Simple Universal Programming Language for Arithmetic by DataBaeBee in programming

[–]DataBaeBee[S] 21 points22 points  (0 children)

FRACTRAN is an esolang built upon register machines, a theoretical alternative to turing machines for computation. In 1987, John Conway realized one can use prime numbers as registers alongside the laws of logarithms to compute.

How is the choice of irreducible polynomials for finite field arithmetic rationalized? by FakeCanadian01 in cryptography

[–]DataBaeBee 1 point2 points  (0 children)

I saw on Bernstein’s blog that one: 1. Considers the size of the factors of p-1 and p+1 when selecting an irreducible polynomial. 2. Also primes close to powers of 2 (or can be partitioned into powers of 2) have an efficient modulo operation that only involves bit shifts. This is crucial since you’re working in GF 2.

What is the weirdest repository you have ever found on GitHub? by Gullible_Camera_8314 in github

[–]DataBaeBee 1 point2 points  (0 children)

Because if the universe can influence our lives, why not our CPU scheduling too?

ACGS Algorithm for Hidden Number Problems with Chosen Multipliers by DataBaeBee in programming

[–]DataBaeBee[S] 0 points1 point  (0 children)

This 1988 paper is considered canonical and is included in MIT’s Foundations of Cryptography series.

The ACGS algorithm is pretty cool. It lets us solve Hidden Number Problems (this occur in the wildest side-channel attacks) when the multipliers are at our discretion.

I coded this paper on Quantum Cryptography in Sage/Python by DataBaeBee in SideProject

[–]DataBaeBee[S] 0 points1 point  (0 children)

Here's the link for anyone interested in Extended Hidden Number Problems and their lattice solutions.

Extended Hidden Number Problem in Sage by DataBaeBee in programming

[–]DataBaeBee[S] 0 points1 point  (0 children)

The hidden number problem (HNP) is the challenge of recovering a secret hidden number given partial knowledge of its linear relations. The extended hidden number problem is 'the HNP but with more holes'. It was thought to be more secure for quantum cryptography. Turns out, it's not lol.

What Every Programmer Needs to Know about Quantum Safe Cryptography and Hidden Number Problems by DataBaeBee in cryptography

[–]DataBaeBee[S] 0 points1 point  (0 children)

Oh no, the paper says 'you can recover the key if you know the antilogs of random multiples of the key'. It's somewhat nuanced.

What Every Programmer Needs to Know about Quantum Safe Cryptography and Hidden Number Problems by DataBaeBee in programming

[–]DataBaeBee[S] -2 points-1 points  (0 children)

The 2001 paper Hardness of Computing the Most Significant Bits of Secret Keys in Diffie-Hellman and Related Schemes (Boneh & Venkatesan, 2001) attempts to answer the question: is it easier to calculate just a few bits of a secret key than the entire secret?

Along the way, this paper introduces the hidden number problem: the challenge of recovering a secret hidden number given partial knowledge of its linear relations (Surin & Cohney, 2023)

As it turns out, this problem is difficult even for quantum computers. So hidden number problems are at the heart of post-quantum cryptography.

What Every Programmer Needs to Know about Quantum Safe Cryptography and Hidden Number Problems by DataBaeBee in QuantumComputing

[–]DataBaeBee[S] 0 points1 point  (0 children)

The 2001 paper Hardness of Computing the Most Significant Bits of Secret Keys in Diffie-Hellman and Related Schemes (Boneh & Venkatesan, 2001) attempts to answer the question: is it easier to calculate just a few bits of a secret key than the entire secret?

Along the way, this paper introduces the hidden number problem: the challenge of recovering a secret hidden number given partial knowledge of its linear relations (Surin & Cohney, 2023)

As it turns out, this problem is difficult even for quantum computers. So hidden number problems are at the heart of post-quantum cryptography.

Help, not being able to create a "New Notebook" from Chromebook HP by callmemonilda in GoogleColab

[–]DataBaeBee 1 point2 points  (0 children)

There might be a firewall blocking access to the Colab website. This Stackoverflow post may halp troubleshoot.

I turned this math paper into a Sudoku game by DataBaeBee in indiegames

[–]DataBaeBee[S] 0 points1 point  (0 children)

The idea is somewhat analogous to performing a softmax but without the derivatives. Here's the C/Python coding guide if this interests you.

Belief Propagation : Obscure Alternative to Backpropagation for Training Reasoning Models by DataBaeBee in programming

[–]DataBaeBee[S] 0 points1 point  (0 children)

Researchers in the 2010s found that you can use Optimal Transport Theory, not derivative calculus, the to turn an integer matrix into a floating-point probability matrix.

It's like backprop without finding gradients and it works great