In Part 1 of my foray into Research Like a Pro with AI Genealogy Workbook, I outlined the format of the workbook and shared an abbreviated version of the Table of Contents.
The Introduction provided an overview of the development of AI, tools that we currently have available and how to make best use of this workbook.
Chapter 1 has its focus on learning a bit about the four main AI tools in use today – ChatGPT, Claude, Gemini and Perplexity – and a format to follow to craft effective efficient prompts for genealogical research.
I’ve used all four platforms in the past – only the free versions – and learned something interesting with the genealogy group that I teach. There were six of us, all using my house internet. I gave the exact same prompt to everyone and we shared out results. Curiously, NO TWO of us had the exact same responses – they varied slightly. However, one person had a response that wasn’t anything like what the rest of us had even though she used the exact same prompt wording.
This time around, I didn’t try giving the same prompt to the same platform more than once, and I already had a couple of favorite platforms, but I did want to see the replies from each bot to the same prompt:
Role: Professional genealogist specializing in early New Brunswick, Canada research. Task: Search the web for information about primary records pertaining to Loyalists who settled in New Brunswick, Canada before 1790. Provide details about the repositories with primary record collections and books written about Loyalists in Parrtown before 1790. Create a list of the resources, repositories and websites found.
I will state, right from the start, that Gemini is my least favorite bot and it provided the worst results – only about 2 pages of information – when the other three bots provided 4-5 pages of details.
Of the remaining three – ChatGPT, Claude and Perplexity – ChatGPT was the second weakest, although I was surprised to see that only ChatGPT (5) included mentions of Black Loyalists or the New York Public Library Manuscripts Division or the New Brunswick Genealogical Society.
Yes, the focus is on New Brunswick records, but the prompt doesn’t specify only New Brunswick resources. Many Loyalists sailed to Canada from New York and there are primary records to be found there.
Aside from that, ChatpGPT 5’s font was much larger than that of Claude and perplexity plus the last page was just a summary of the items on the first 3 pages.
Let’s say I was not impressed with ChatGPT 5’s performance. On top of that, I wanted to print out hard copies of each of the responses so I could go through and compare repeated resources and those unique to one response. Apparently, to print is an upgrade on ChatGPT so I had to copy and paste into Word. Doable, but kind of a nuisance.
Claude and Perplexity both produced well-done responses and both had easy-to-use download/print buttons.
CLAUDE grouped resources by Major Repositories and Archives (University of New Brunswick, Provincial Archives of new Brunswick, Library and Archives Canada and FamilySearch collections), Primary Record Collections (Land, Military, Court and Vital Records), Specific Parrtown/Saint John Records (Key Collections and Important Documents), Published Works and Books (Only one book mentioned though, which is a big weakness here), and Special Research Notes. There were a few online links, but, for the most part, it will take a bit more digging to land on the websites. Its font size was on the big side so its 4 pages would equal about 3 1/2 compared to Perplexity’s font size.
PERPLEXITY, overall, had the most thorough response, with five pages of detailed information using the smallest font. It covered Major Repositories and Websites, Books and Major Collections on Loyalists in Parrtown Before 1790, Key Primary Record Sets and Finding Aids, Summary List of Top Resources, Historical Overview of Parrtown, Major books, Major Archival Manuscript Collections, Principal Repositories and Websites and closed with 18 source citation links.
As a retired teacher, in my mind, I graded the responses for each. Perplexity was clearly an A, Claude a B, mostly for the lack of book titles provided, ChatGPT got a C- and Gemini a D.
The remainder of Chapter 1 involved using a format for creating effective prompts, techniques for creating more advanced prompts [five steps which I will be following], ways that bots can transform information and ethical and legal considerations when using AI.
As I am completing Chapter 1, I want to say upfront because of my own personal bias, I adjusted the tools I used to get set up and ready to begin this workbook. Google Docs and Airtable are both highly recommended, but I am choosing not to use either for one simple reason. I don’t like my original work to be sitting in the cloud and much prefer to have it saved on my own computer and will be using Word and Excel instead. As stated, that’s just a personal opinion. The cloud is fine for backups, but not original work.
The Introduction and Chapter 1 practices were interesting. Since I’ve used AI tools already, I think the most useful tip I’ve learned is from the Crafting Effective Prompts section using the five detailed components for prompts.