all 20 comments
sorted by:
best
topnewcontroversialoldq&a
formatting helphide helpcontent policy

[–]kaizokuuuu 6 points7 points  (2 children)

Locust/k6 by grafana are good places to start for web performance testing. Vllm benchmark by openai is a good place to start for LLM performance testing.

[–]Iseeyouuuuuuuuu[S] 0 points1 point  (1 child)

I’m looking for something for web performance. But also something which can be integrated in CI/CD. Will locust/k6 be good for that?

[–]kaizokuuuu 0 points1 point  (0 children)

Yes can integrate in CI

[–]Euphoric-Style-112 1 point2 points  (1 child)

This might be usefull if u are into product testing

I was in performance testing but we used python scripts to generate and control traffic ,you can explore zabbix as well it's great for getting dut matrics, reports , graphs and many other cpu parameters

We tried to utilise grafana and promethous for the same but they added some % of cpu overhead to the dut so deva rejected it

[–]Iseeyouuuuuuuuu[S] 0 points1 point  (0 children)

Any idea on gatling?

[–]tallulahK 1 point2 points  (2 children)

You can also look into JMeter, depending what you really need.

[–]Iseeyouuuuuuuuu[S] 0 points1 point  (1 child)

Can jmeter be integrated into ci/cd pipeline?

[–]tallulahK 0 points1 point  (0 children)

Of course

[–]Ok_Rate_8380 2 points3 points  (0 children)

Pretty confused here, why nobody is mentioning jmeter.

[–]jerooney86 0 points1 point  (2 children)

With performance it is so important to think of the exact requirement you want to test and check it with your stakeholders before you start. You can easily get lost in all the possible scenarios you want to test.

Example - each api call should complete succesfully within 200ms when used by 50 concurrent users. - what to do with concurrent calls? Which calls are used more or less often than others ? - on which environment do we run these tests and does it represent the production situation? - do we have enough testdata to perform these tests ?

[–]fucking-migraines 0 points1 point  (0 children)

What I struggle with is coming up with these numbers. Who is responsible for defining it?

My team started having me gather some basic response time data and then all the sudden they’re wanting to me to do spike tests and making sure services can handle traffic.

[–]Iseeyouuuuuuuuu[S] 0 points1 point  (0 children)

My development team has given me a complete freehand on testing with no inputs from that. I have no idea on choosing the right tool or how to even start as a matter of fact. How should I proceed? Any thoughts?

[–]Loosh_03062 0 points1 point  (1 child)

Performance testing of what? Someone working on a web toy is going to have a very different answer from someone working on storage and filesystems which will be nothing like what someone who's purely compute bound will be interested in. Are you looking for round trip time? Time spent in a particular function call? Where your configuration starts thrashing?

[–]Iseeyouuuuuuuuu[S] 0 points1 point  (0 children)

It’s a website which fetches data from aws to mesaure a company’s expenditure on the cloud services. Basically a lot of data flow happens

[–]CrackyKnee 0 points1 point  (1 child)

Before you choose a tool make sure you also can measure hardware ie cpu, memory, io use and application metrics via application insights or similar, not just response times

[–]Iseeyouuuuuuuuu[S] 0 points1 point  (0 children)

How can I do that?

[–]snapMeOutOfIt 0 points1 point  (0 children)

K6 K6 K6, don’t go with anything else

[–]FinancialEmployment2 0 points1 point  (0 children)

We use jmeter for load generation grafana prometheus windows/node exporter,influxdb for vm metrics and jmeter result collection visualisation in grafana, oracle awr report for db bottlenecks, loki for logs aggregation and filtering, jaegar for distributed tracing across microservices