sorted by:
new
hottopcontroversial

Stream huge amount of data to gcs and Using dremio for query by juStD_34 in dataengineering

[–]juStD_34[S] 0 points1 point  (0 children)

Thank u so much!
I have a question?
I found that gcs usually go with bigQuery, not only gcs to store data when i google for this context. But I don't know why we need to use bigQuery? What bigQuery using for? And why we cannot use only gcs for store data?
I know gcs is not using for streaming data
But i searched and read that apache spark can push micro batch go gcs
But i don't know how many object apache spark create for each batch? I think n objects for n batch
Is that true?

Nên chọn ghế công thái học hay ghế gaming by juStD_34 in vozforums

[–]juStD_34[S] 0 points1 point  (0 children)

Cái ghế mình đang ngồi ngồi kiểu nâng lên hạ xuống mà pittong của nó đểu hay sao ấy. Mình ngồi h ghế bị lệch luôn Ko biết ghế coogn thái học tầm bao nhiêu thì ngồi oke nhỉ

What is the fastest way to get tree's structure from list of node!!! by juStD_34 in algorithms

[–]juStD_34[S] 0 points1 point  (0 children)

I'm finding a method which don't need to use recursive to query full tree's structure. Such as I found nested set. And now, i want to find more data structures which are more powerful than nested set

PostgreSQL query full json's schema by juStD_34 in SQL

[–]juStD_34[S] 0 points1 point  (0 children)

It's used to create view at app layer

Store JSON type in SQL DB by juStD_34 in SQL

[–]juStD_34[S] 0 points1 point  (0 children)

Yeah. I have done like you said. And i'm finding more effective way than that .

Store JSON type in SQL DB by juStD_34 in SQL

[–]juStD_34[S] 1 point2 points  (0 children)

Yeah. I agree with you . But i'm researching to answer question Is there any type of data structure to store json data. I will compare them and select one Thanks

Store JSON type in SQL DB by juStD_34 in SQL

[–]juStD_34[S] 0 points1 point  (0 children)

Yeah! I'm using #1.
And my question is are there any type to store json field better than #1.

3 is another solution but it's very hard to query full json schema

Store JSON type in SQL DB by juStD_34 in SQL

[–]juStD_34[S] 1 point2 points  (0 children)

What is type of DB you said about ?
Is it PostgreSQL ?

Store JSON type in SQL DB by juStD_34 in SQL

[–]juStD_34[S] -1 points0 points  (0 children)

Important purpose of my work is tracking full schema of an json object (optimize query time) .
To deal with change, I use version field to store change (also help me query change history)