AI's ability to predict human behavior

A new study came out today (Aug 8, 2024) showing how accurate ChatGPT-4 is at predicting human behavior. This is interesting to me because this is looking at how accurate ChatGPT is when we are working on predicting changes. I also use ChatGPT and Claude to scenario plan different strategies and tactics, I have been happy with its ability to pivot and respond as I enter different conditions and reactions. Who knew (well the researchers looked into it) that the responses may have been accurate predictions.

Researchers from NYU and Stanford found that GPT-4 accurately predicted human responses in 85% of social experiments.

Study Highlights

  1. High Accuracy: GPT-4 matched or surpassed human forecasters with a correlation coefficient of r = 0.85.

  2. Consistent Across Demographics: Accurate predictions across genders, races, and political affiliations.

  3. Large-Scale Performance: Involving millions of participants, GPT-4's predictions were as accurate as expert forecasts.

  4. Independent Predictive Value: Combining human and AI predictions resulted in even higher accuracy, showing that LLMs provide unique insights that complement human judgment.

Here is the research: https://docsend.com/view/ity6yf2dansesucf 

Previous
Previous

Using traffic cams to take selfies

Next
Next

Algorithmic Justice League