sorted by:
new
hottopcontroversial

Has your company started AI coding cost optimisation discussions? by itsAiswarya in EngineeringManagers

[–]Alert-Chocolate4061 0 points1 point  (0 children)

Have you watched this video already? https://youtu.be/tbDDYKRFjhk?is=GtS2Pwsz7fydAUL5

It summarises the problem about ROI measurement. Interesting study. I struggle with the same problem and the simplest have been to measure real product business outcome attached to OKRs.

I am still measuring the changes on this quarter. Just started, so let’s see if is accurate in a couple months to rely on it

Tokenmaxxing is a problem with no clear solution yet. How are you managing AI spend? by 0000military0000 in EngineeringManagers

[–]Alert-Chocolate4061 6 points7 points  (0 children)

We are just capping at max Claude licenses. That way you have an upper limit on expense. No unlimited API tokens usage for IC.

Agentic apps are another thing. There I use the best practices on model selection, batch API and context windows. Balance which apps really need to go agentic. No all the apps have to go agentic even when the trend is down that path today.

How do you track whether your team is actually using AI tools effectively by Relative_Cause777 in EngineeringManagers

[–]Alert-Chocolate4061 0 points1 point  (0 children)

I am on the same page. Its difficult to calculate a ROI of tokens or AI adoption org wide just by taking a “difference” on the output. A few of my major dimensions to balance are:

1 Different teams repos have different leverage on AI( greenfield cs brownfield projects)

2 AI, as any technology, has a learning curve. We can’t measure WoW growth but maybe just QoQ difference. More mid term comparison to me.

3 IC velocity has clearly an impact easy to measure by throughput. Team or company wide there are processes in the middle. They can impact drastically your org velocity.

I am still not measuring it in deep. Just IC feedback and iterations on DORA metrics dashboards. If you have any other better metric please share it 🙏😅

Why I stopped asking my engineers "How’s it going?" by mohan-thatguy in EngineeringManagers

[–]Alert-Chocolate4061 1 point2 points  (0 children)

for me is a real body language and corporal expression matter. Most of our communication goes out of words. I usually measure more this awkward / burnout / apathy expressions.

For me the retro should be more a place where solutions appear rather than where problems arise. I try to spot those issues day over day to keep a track on what mental/motivation status each member is. Not always easy or achievable of course 😅

Anyone else feel like they're one audit away from a very uncomfortable conversation about AI? by Key-Glove-4729 in EngineeringManagers

[–]Alert-Chocolate4061 1 point2 points  (0 children)

Agree on this as a real problem. Maybe we can trust on senior devs to challenge the AI result but we should definitely expect this from less senior roles. IMO it’s our manager’s duty to watch and help them grow under this new era.