each org will have its own KPI but from what I have seen from our customers many of them try to track how much employee time has been saved by handing work off to the “ai tooling”
Wouldn’t that mean that KPIs need to be applied to the output, just as they are to employees’ work? Otherwise, no comparison would be possible at all: To measure how much time an employee saves by using AI, one must measure the value of the AI’s output. If you don’t do that, the time savings could be attributed to any other factor - such as the employee working overtime because they don’t want to be replaced by AI, which in this scenario is simply not possible because, due to the lack of metrics, it is unknown whether AI can replace the employee at all.
Given the hype and the types of people that push this shit, I can’t imagine any fruitful KPIs being applied. A good KPI should be hard/impossible to game, regularly tracked, and should have understood limits or action triggers (i.e. what result from a KPI is acceptable vs needs improvement).
Had a yearly review where one of my metrics was decreasing NCRs. The numbers showed more than a 25% reduction in NCRs from the previous year when my goal was like 5%. Of course this was over covid and that weren’t accounting for volume of orders which plummeted that year. On paper I did fucking phenomenal.
each org will have its own KPI but from what I have seen from our customers many of them try to track how much employee time has been saved by handing work off to the “ai tooling”
Wouldn’t that mean that KPIs need to be applied to the output, just as they are to employees’ work? Otherwise, no comparison would be possible at all: To measure how much time an employee saves by using AI, one must measure the value of the AI’s output. If you don’t do that, the time savings could be attributed to any other factor - such as the employee working overtime because they don’t want to be replaced by AI, which in this scenario is simply not possible because, due to the lack of metrics, it is unknown whether AI can replace the employee at all.
Given the hype and the types of people that push this shit, I can’t imagine any fruitful KPIs being applied. A good KPI should be hard/impossible to game, regularly tracked, and should have understood limits or action triggers (i.e. what result from a KPI is acceptable vs needs improvement).
Had a yearly review where one of my metrics was decreasing NCRs. The numbers showed more than a 25% reduction in NCRs from the previous year when my goal was like 5%. Of course this was over covid and that weren’t accounting for volume of orders which plummeted that year. On paper I did fucking phenomenal.