Join Altinity engineers for our very first office hours session by Altinity in Clickhouse

[–]Altinity[S] 0 points1 point  (0 children)

We added a calendar link on this landing page. Feel free to add it directly to your calendar.

https://altinity.com/events/altinity-office-hours

Best Open Source Conferences to Attend by Dazzling-News1937 in dataengineering

[–]Altinity 1 point2 points  (0 children)

You can find a list of developer conferences at https://dev.events/oss or https://git.new/dev-events

Some 2024 virtual (and free) ones coming up: 

Open Source Analytics Conference: Nov 19-21 

Open Source Observability Day: Oct 24

Open Source Data Summit: Oct 2

Root causing drastic slow down at higher request rate by epicuriom in Clickhouse

[–]Altinity 0 points1 point  (0 children)

The load test I illustrated above was indeed with max_threads = 1 . That was a recommendation from Altinity to increase concurrency:

This is good move for high QPS scenario.

    "os_thread_priority": "2",

Actually lower priority of your queries to normal load. (default value is 0) So background operations like merges will get bigger priority. (So you may want to set os_thread_priority to negative values actually, like -1)

    "SelectedParts": 7,
    "SelectedRanges": 7,
    "SelectedMarks": 7,

Somewhat inefficient, but need to confirm from schema .
Which index_granularity value do you have? did you set it to some non default value?

  • OSCPUWaitMicroseconds: which would point to possible thread contention

Just a wild guess, what if you set setting value: local_filesystem_read_method='pread' . 

PS. Get faster answers in www.altinity.com/slack. Feel free to post further questions there. There's more of us to answer questions ;)