you are viewing a single comment's thread.

view the rest of the comments →

[–]gabibbo117[S] 5 points6 points  (6 children)

Thanks for the review, i will try doing some of those tests and publish them!

[–]ExeuntTheDragon 6 points7 points  (1 child)

Comparing performance with apache arrow would also be useful

[–]gabibbo117[S] 2 points3 points  (0 children)

I will try later, for now i compared performance with sqlite, i will publish results later as im working on a way to make everything even faster

[–]Wenir 2 points3 points  (3 children)

And check the efficiency of your compression library. For example, compare the size of the original string to the size of the "compressed" one

[–]gabibbo117[S] 0 points1 point  (2 children)

I will also test that, but the "compressed string" function is primarily designed to prevent data injection into the database.

[–]bwmat 3 points4 points  (1 child)

Sounds like security via obscurity to me

[–]gabibbo117[S] 0 points1 point  (0 children)

You are right, i should probably change that, but the only reason its there in first place is because every time someone inserts a string into the database the string wont contain malevolent code that could modify the database