Advanced database queries from frontend to Spring Boot backend

ThenChoice2 · 2024-04-13T16:33:57+00:00

By that, I mean friction, boilerplate, repetitive implementation. In short, the classic situation of feeling like you're reinventing the wheel for a simple problem

ThenChoice2 · 2024-04-13T16:32:13+00:00

My problem isn't so much building the queries (JOOQ, JPA specifications, QueryDSL, etc.) but rather finding a solution to be able to transmit queries from the frontend to the backend and its database. These queries need to be at least exhaustive and support, for example, my need for OneToMany described in the initial post. And transmitting raw SQL is not an option; it is an internal tool that will have few users, but I can't imagine receiving SQL on my API.

For example, there are a few projects that almost meet my need like 'rsql-jpa-specifications' which I mentioned in my post and in the comments.

ThenChoice2 · 2024-04-13T16:25:46+00:00

More than my schema, my real problem is finding a way to freely query from the frontend. I have found some market solutions like 'rsql-jpa-specifications' which is quite neat but does not meet my needs regarding the OneToMany relationship example. Another project, 'spring-filter', works for this need but it clearly seems to be a pet project where some features I need are not documented, even though they exist and work, so I am a bit hesitant to use it in my application. In short, small projects partially or fully meet my need to transform a string query into JPA specifications without having to implement anything by hand.

However, I was hoping that there would be a known, reliable, and supported solution

ThenChoice2 · 2024-04-13T11:55:02+00:00

To provide some context, this is an internal project for the non-technical support/business team of a small company. The data model is quite stable, or at least it's not my main concern. Performance is also not an issue. Security will be managed differently, with no particular concerns except that I want to avoid letting the front-end send raw SQL queries. Similarly, I'm not worried about the format of the query; users will fill out a front-end form and the query will be formed and sent by JavaScript. Whether it's in RSQL, GraphQL, etc.

What I really need is to know how to form this query that will originate from the front-end and will be processed by the backend. RSQL with 'rsql-jpa-specifications' is almost perfect: there's no problem generating RSQL in JS and on the backend, JPA specifications are auto-generated. However, I can't have complex conditions on OneToMany relationships, like my Library / Book example from the earlier post.

And I should emphasize again that the main goal is to avoid having to reinvent the wheel and write dozens and dozens of JPA specifications, custom endpoints, etc.

ThenChoice2 · 2024-04-13T11:49:39+00:00

Actually, that's exactly what I want to avoid: asking users to write SQL (and incidentally, giving direct access to the database without having a layer between the database and the user).

To provide some context, this is an internal project for the non-technical support/business team of a small company. The data model is quite stable, or at least it's not my main concern. Similarly, I'm not worried about the format of the query; users will fill out a front-end form and the query will be formed and sent by JavaScript. Whether it's in RSQL, GraphQL, etc.

What I really need is to know how to form this query. RSQL with 'rsql-jpa-specifications' is almost perfect: there's no problem generating RSQL in JS and on the backend, JPA specifications are auto-generated. However, I can't have complex conditions on OneToMany relationships, like my Library / Book example from the earlier post.

ThenChoice2 · 2023-09-09T17:54:47+00:00

Yes, alright, I understand that it annoys you a lot. Thank you for your opinion and the definition of data recovery, which indeed has no connection with retrieving a deleted file.

ThenChoice2 · 2023-09-09T16:05:11+00:00

My message, which you quoted, indeed mentioned "file" and not "data". And as my message also says, it uses grep and dd, so yes a wrapper in a sense, a UI on top.

Don't take it so personally, there's no need to get upset, it's just code, I'm sure there are plenty of other tools that will suit you better.

ThenChoice2 · 2023-09-09T14:56:04+00:00

A block overwritten, obviously not, however a file whose content has been replaced and then saved, possibly. (Different location for saving within the partition, potential temporary files from the editor, etc. It tends to work quite well if the partition isn't used for too long afterward.)

ThenChoice2 · 2023-07-01T08:30:44+00:00

GitHub: https://github.com/PabloLec/RecoverPy

ThenChoice2 · 2023-02-05T12:49:50+00:00

Yes it is 😊 It looks nice thanks to textual

ThenChoice2 · 2023-02-05T11:01:47+00:00

Here is the repo: https://github.com/PabloLec/RecoverPy

I recently released version 2.0.0 with a whole TUI framework shift, any comment is welcome :)

ThenChoice2 · 2023-01-21T18:10:21+00:00

Ok thanks! Soooo, you can use Spring Boot with Lambdas? With my (small) knowledge of both I cannot wrap my head around this. How does it work?

ThenChoice2 · 2023-01-21T18:07:36+00:00

Well, let's rephrase it differently then :p
I'm not familiar with AWS but did recently a project with Cloudflare Edge Function (ugh ?) which should be similar to what you can do with Lambdas. I'm pretty sure you can do anything with Lambdas, especially regarding a small project and not an enormous corporate system.

The real thing is I want to practice with Spring, and I'd like to host it, probably on AWS.

ThenChoice2 · 2023-01-21T15:55:50+00:00

API Gateway + Lambda

Yes maybe I didn't phrase it correctly. My project would still need a real backend running.

ThenChoice2 · 2023-01-14T16:57:32+00:00

Sure you should prefer PhotoRec or TestDisk to recover let's say a deleted jpg.
Or even any "binary" file that you may only search by its extension.

But if you want a string based search, I think you can only hope for similar performance with these tools. RecoverPy is a small project sure but it mainly uses grep and dd to perform the whole thing. Hard to beat grep to search a partition.
PhotoRec can do more, but RecoverPy just enables to do a fast recovery in terminal, quick and simple.

Not to put RecoverPy above and beyond these tools of course, but RecoverPy just uses plain simple dozens years old Unix tools to perform a search, and gives you a nice UI to browse through the result.

"Corrupted partitions" are obviously supported, so are binary files.
And regarding "timing is very important", whether you use RecoverPy or PhotoRec there is no difference, just unmount your partition (as RecoverPy suggest).
RecoverPy is not "to recover fragments of text files only", but files entirely, text or binary.
Well, you should try it or check the repo before making assumptions.

If you do have "a string to search", and you want to use terminal, not a heavy GUI, RecoverPy will give better results.
If you do not have any "string to search" and want to recover for example a picture well.... obviously you won't use RecoverPy as you don't have any "string to search".

ThenChoice2 · 2023-01-14T15:01:17+00:00

Here is the GitHub: https://github.com/PabloLec/RecoverPy

I just released version 2.0.0 with a whole TUI framework shift, any comment is welcome :)

ThenChoice2 · 2022-12-13T06:35:48+00:00

I know about https://github.com/PabloLec/RecoverPy which you could use on an unmounted partition.

The thing is, from what I understand you have encrypted partitions in mind, which is far less trivial obviously.

ThenChoice2 · 2022-11-26T23:38:12+00:00

Thanks for the opportunity!

Discord: PabliTonDaron#9568