This article attempts to summarize existing research on the accuracy of diagnosing apps (usually described as 'symptom checkers, SC). Given the novelty of shuch apps, the literature is neither large nor well-focused. And while it is at least all relatively recent, given the speed of app development, it is not clear it is recent enough.
To try and predict how useful AI may prove in healthcare, it is useful to first understand the types of problems were it may be helpful. There are a number of ways in which scientist and engineers can classify problems, but the four most important for this discussion
1) whether we have a good understanding of the problem (i.e., can we model it mathematically),
2) how many variables there are,
3) whether there is an underlying structure to the data, and
4) how much data we have on a given problem and it's quality.
At the time of writing, there are probably around 500,000 medical "apps" (i.e., software tools) on the 'market' (in quotes, since some may be free, albeit nothing is really free). Some are designed to be used by patients, others by clinicians. This article assesses the regulatory environment and evidence on their safety w.r.t. privacy and data integrity. While current regulations seem to be enough to ensure data integrity at the healthcare provider level, the weak link seems to be in third party apps that allow patients to interact with the providers data.