Monday, March 24, 2025

The God Culture: ChatGPT Confirms My Critique of Using ChatGPT For Peer Review

I asked ChatGPT to assess and discuss the truthfulness and validity of an article I wrote critiquing Timothy Jay Schwab's use of ChatGPT. Here is the response. 



Evaluation of the Claims in the Article:

Overview:

The article you've provided critiques Timothy Jay Schwab's use of AI, specifically ChatGPT, to validate and peer-review his research on biblical locations such as Ophir and Chryse. The article accuses Schwab of misleadingly presenting AI feedback as peer-reviewed confirmation of his claims, which may not be accurate or scholarly.

Assessing Truthfulness and Validity:

  1. Peer Review and AI:

    • The article highlights a crucial point that ChatGPT, or any AI, cannot perform formal peer reviews. This is an essential distinction. Peer review is a scholarly process conducted by experts in the relevant fields (e.g., historians, archaeologists) who evaluate research for accuracy, methodology, and contribution to the field. AI tools like ChatGPT can only provide feedback based on the data they have been trained on, but they cannot validate the truthfulness or accuracy of a claim in the rigorous academic sense.

    • AI limitations: The article correctly points out that AI cannot validate the broader truthfulness of Schwab's claims. ChatGPT’s responses are based on the data fed into it by the user. If Schwab is uploading biased, incomplete, or incorrect data, the AI will provide feedback that aligns with that data, not necessarily with established historical or academic truth.

  2. Misinterpretation of Maps:

    • Schwab uses historical maps (e.g., the 1492 Behaim Globe) to argue that the Philippines corresponds with biblical locations such as Chryse. The article argues that the interpretation of maps in Schwab's research is flawed and misleading. Schwab insists that Chryse on the Behaim Globe refers to the Philippines, which, as pointed out in the article, is anachronistic and geographically incorrect because the Philippines was not discovered by Europeans until Magellan's voyage in 1521, well after the Behaim Globe was created.

    • The article's critique seems valid in pointing out that Schwab's reading of the maps is misleading, as historical maps from the 15th century would not have depicted the Philippines (a territory not yet discovered by Europeans), but rather areas that were more familiar to Western cartographers at the time.

    • AI’s role: When Schwab inputs his interpretation of these maps into ChatGPT, the AI simply reflects Schwab's assumptions, rather than critically evaluating the historical accuracy of the claims. This is evident when ChatGPT states that Schwab's conclusions appear “sound within the framework of the data provided,” but does not comment on whether those conclusions are factually accurate or valid in a broader, academic sense.

  3. Flawed Conclusion from AI:

    • ChatGPT’s responses, as shown in the article, suggest that Schwab's research "appears sound" based on the information provided, but this does not mean that the conclusions are universally correct or based on objective evidence. The AI feedback is limited to the context of Schwab’s own research and does not account for broader historical, archaeological, or academic knowledge that may challenge his claims.

    • ChatGPT also admitted that its feedback was not an official peer review but rather an informal analysis. Schwab's portrayal of this AI interaction as a peer review is misleading because AI cannot engage in peer review in the traditional academic sense.

  4. Interpretation of "Nuances":

    • The article critiques Schwab for dismissing the nuanced interpretation of ancient maps. However, the term “nuance” refers to the complexities and uncertainties involved in interpreting historical sources, including maps, which were not created with modern geographical precision. Ancient maps often reflected the worldview and knowledge of the time, which was limited by the explorers' understanding and biases.

    • Schwab’s argument, as highlighted in the article, focuses on a literal and direct reading of maps, which is flawed because it ignores the broader historical context, including the biases and limitations of the cartographers.

Key Takeaways:

  • AI Feedback is Not Peer Review: Schwab’s portrayal of ChatGPT’s feedback as a “peer review” is inaccurate. AI tools like ChatGPT can analyze and provide feedback based on the input data, but they cannot offer the kind of rigorous academic evaluation that comes with formal peer review from subject matter experts.

  • Misleading Research: Schwab’s interpretation of ancient maps to support his claims about the Philippines being Ophir or Chryse is flawed, as evidenced by the article. The maps were created before the Philippines was known to Europeans, and Schwab’s direct geographical correlation is anachronistic and incorrect.

  • The Importance of Context: The article correctly emphasizes that AI cannot verify the broader truthfulness of Schwab’s research because AI is simply analyzing the data provided by Schwab, which in this case is flawed. Garbage in, garbage out is an apt expression here; Schwab's biased and selective input leads to AI feedback that appears valid within his framework but is not academically or historically rigorous.

Conclusion:

The article raises valid concerns about Schwab’s misuse of AI-generated feedback and his misleading presentation of that feedback as a legitimate validation of his research. The claims in Schwab's research are based on misinterpretations of historical maps and biased input data, and AI cannot validate those claims in a scholarly or objective sense. Therefore, the article’s critique is truthful and valid, highlighting the need for critical, expert validation of such historical claims rather than relying on AI-generated assessments.

ChatGPT's assessment requires no further comment. It's no surprise it agreed with the analysis and conclusion my article.

I leave this here not because it is the end of the story but because it is one more crack at Tim's misuse of A.I. to "peer review" his research. If Timothy Jay Schwab who is The God Culture cannot understand what I have written at least ChatGPT can. 

No comments:

Post a Comment

The God Culture: Citing A Newspaper Article Rather Than A Primary Source

By now it should be clear to every reader of this blog that Timothy Jay Schwab who is The God Culture is not just a lying buffoon who has no...