As artificial intelligence becomes increasingly embedded in health systems, how can we know whether these tools are delivering meaningful health benefits? AI tools can be updated and redeployed faster than the evidence validating them, raising the question of whether current evaluation frameworks are built for the speed of adoption. This session explores what rigorous impact assessments for AI tools should address.