I've come across some fascinating research about GPT-4's capabilities in smart contract auditing. Salus Security researchers tested GPT-4 on 35 smart contracts with 732 vulnerabilities. The results? A mixture of good and bad experiences!
The good: GPT-4 showed 80%+ precision in detecting true positives across seven common vulnerability types. Pretty impressive, right? The bad: Its recall rate was as low as 11%, meaning it missed a lot of vulnerabilities. Overall accuracy topped out at just 33%.
What does this mean for us? While AI is making strides in smart contract auditing, it's not ready to replace human experts or specialized tools. The researchers recommend sticking with traditional auditing methods for now. It’s better to rely on professionals with specialization in smart contract audit. They will not only detect the flaws, but also assist in making the necessary correction.
Thoughts? Have any of you experimented with AI in your auditing processes? Let's discuss the future of AI in blockchain security!