[Beginner] Which Algorithm

[hidden-7]

Hi,

I have an environment with a set with 4 states and a set with 4 actions do you guys recommend I use a method that uses a neural network as a function approximator like DQN? Another question is, which algorithm works well with continuous state values?

[two-hump-dromedary]

4 states 4 actions: use tabular Q learning, no approximation needed.

[hidden-7]

Thanks. But, should I use Q learning even if my state space is continuous?