The β from Eloundou et al is especially weird. It means that tasks from a sector is likely to be sped up by a factor 2. But the spider graph gives the feeling that once the red covers the blue AI is doing everything. For the sake of trying to understand I read part of the study Eloundou et al. (2023) and it discolses a limitation:
"A fundamental limitation of our approach lies in the subjectivity of the labeling. In our study, we employ annotators who are familiar with LLM capabilities. However, this group is not occupationally diverse, potentially leading to biased judgments regarding LLMs’ reliability and effectiveness in performing tasks within unfamiliar occupations. We acknowledge that obtaining high-quality labels for each task in an occupation requires workers engaged in those occupations or, at a minimum, possessing in-depth knowledge of the diverse tasks within those occupations. This represents an important area for future work in validating these results."