In this experiment to determine the best AI for course outlines, we compare the capabilities of three AI tools: ChatGPT, Bard, and Bing, at generating course outlines.
We use a simple prompt to create outlines for an online course about on-page SEO. Then, we evaluate the outputs using a matrix that includes criteria such as course objectives, content, activities, assessments, engagement, ease of use, customization and adaptability, and course title.
In this post
- ChatGPT vs. Bard vs. Bing: Which AI is Best for Generating Course Outlines?
- TL;DR – Best AI for course outlines
- Summary: Which AI is Best for Course Outlines?
- The AI Experiment
- The Prompt
- Evaluation Matrix
- My Results and Grades
- ChatGPT evaluates the outputs
- Analysis
- Recommendations on AI for course outlines
- Conclusion
- Appendix: Output per AI
I’m excited to embark on this experiment that has been on my mind lately – a showdown involving AI! You see, I’m constantly seeking out ways to enhance the online learning experience. What better way to do that than by putting AI to the test?
Learn more about Exploring the Future: Instructional Design and AI.
This post is pretty long and detailed. Therefore, I’ll provide TL;DR and a more detailed summary in the beginning.
TL;DR – Best AI for Course Outlines?
This experiment compared ChatGPT, Bard, and Bing to generate course outlines. Bing performed best, followed by ChatGPT and Bard. Bing’s outlines were well-structured and included all essential elements, such as learning objectives, content, activities, assessments, and engagement strategies. ChatGPT’s outlines were well-written and engaging but lacked some detail and structure. Bard’s outlines were the least developed but still contained useful information.
Overall, Bing is the best free AI tool for course outlines in this test. It is easy to use and produces high-quality outlines. ChatGPT is also a good option, especially for engaging and well-written outlines. Bard is not as well-developed, but can still be useful for ideas and inspiration.
Summary: Which AI is Best for Generating Course Outlines?
ChatGPT vs. Bard vs. Bing:
Which AI is Best for Generating Course Outlines? This experiment marks the beginning of a series aimed at exploring AI’s capabilities in the instructional design field. Our first clash in this arena; ChatGPT vs. BARD vs. Bing – all competing for the title of being the Best AI for Course Outlines.
Analysis
Overall, Bing performed best in generating course outlines, followed by ChatGPT and Bard. Bing’s outlines were well-structured and included all of the essential elements, such as learning objectives, content, activities, assessments, and engagement strategies. ChatGPT’s outlines were also well-written and engaging, but they lacked some of the detail and structure of Bing’s outlines. Bard’s outlines were the least developed of the three, but they still contained some useful information.
Recommendations
If you are looking for an AI tool to help you generate course outlines, Bing is the best option. It is easy to use and produces high-quality, well-structured and comprehensive outlines. ChatGPT is also a good option, especially if you are looking for engaging and well-written outlines. Bard is not as well-developed as the other two tools, but it can still be useful for generating ideas and inspiration.
Conclusion
AI tools can be a valuable asset for instructional designers looking for ways to save time and improve efficiency. However, it is important to note that AI tools do not replace human judgment and expertise. Instructional designers should carefully review and edit the output of AI tools before using them in their courses.
Now you might wonder why we’re doing this. Well, it’s quite simple. The world of education is evolving rapidly. Ai has emerged as a game changer.
We need to determine which AI can truly deliver when it comes to crafting effective online courses. But wait there’s more! This is just scratching the surface.
The AI experiment
It is quite simple. I will ask ChatGPT 3.5, Google Bard and Bing to create the outlines of an online course and compare the outcomes. (all AI are used in their free version)
I will use a simple prompt to create the outlines for an online course about on-page SEO.
🤖
Prompt: Create the outlines of an online course about on-page SEO.
To evaluate the outputs, I figured out a matrix on how to grade the AI outputs and make them comparable.
The evaluation matrix
The evaluation matrix I’ve carefully crafted for this post is our trusty guide to dissecting and assessing with precision. This matrix ensures that we leave no stone unturned. It’s our tool for systematically breaking down the nuances of each output, allowing valuable insights and an informed perspective.
Needless to say, I used several AI prompts to come up with a viable evaluation matrix. However, I had to revise and refine the criteria quite a bit. I transformed some course standards from OSCQR and added specific AI criteria.
Read more about OSCR on their homepage
| Criteria | Description | Assessment Criteria |
|---|---|---|
| Course related | ||
| Objectives | The course has clear and measurable learning objectives. | * Are the learning objectives aligned with the course description? * Are the learning objectives specific, measurable, achievable, relevant, and time-bound? |
| Content | The course content is accurate, up-to-date, and relevant to the learning objectives. | * Is the content well-organized and easy to navigate? * Is the content presented in a variety of formats (e.g., text, video, audio, interactive activities)? * Does the content include opportunities for students to practice what they are learning? |
| Activities | The course activities are engaging and aligned with the learning objectives. | * Are the activities varied and engaging? * Do the activities allow students to demonstrate their learning in different ways? * Do the activities provide opportunities for students to collaborate with each other? |
| Assessments | The course assessments are fair and accurate, and they measure the students’ achievement of the learning objectives. | * Are the assessments aligned with the learning objectives? * Are the assessments fair and accurate? * Do the assessments provide students with feedback on their learning? |
| Engagement | The course uses a variety of engagement strategies to keep students motivated and involved. | * Does the course use gamification, personalization, storytelling, humor, social presence, emotional design, or other engagement strategies? * Are the engagement strategies effective in keeping students motivated and involved? |
| AI-specific | ||
| Ease of use | How easy is it for the instructional designer to understand and use the course overview? | * Is the overview well-organized and easy to navigate? * Are the instructions clear and concise? * Is the overview written in a plain language style? |
| Customization and adaptability | How easy is it for the instructional designer to customize and adapt the course overview to meet their specific needs? | * Does the overview provide templates or other resources that the instructional designer can use to customize the overview? * Is the overview flexible enough to be adapted to different teaching styles and learning environments? |
| Course title | Is the course title clear, concise, and informative? | * Does the course title accurately reflect the content of the course? * Is the course title catchy and attention-grabbing? * Is the course title unique and memorable? |
Rubric for assessing the AI output
I will use a simple and generic 1-5 grading rubric, to not overcomplicate things.
- Very poor
- Poor
- Good
- Excellent
- Outstanding
Since the generated course outlines were pretty long, I added them in the appendix at the very end of this post.
What is the best AI for Course Outlines?
Well, that was quite some work putting this together. However, I used all tools in designing the outlines of courses, but never in a systematic way. From my feeling, I felt that Bard does well in SEO-related topics and that it cuts down the output to the minimum. On the other hand, ChatGPT impressed me with neat details, like the engaging wording in the headlines and course titles. I did not use Bing before, but that will change!
My goal is to develop a reliable matrix and define the best use cases for each tool. This is more of a personal task, but I am happy to share it with everyone!
I’ll reveal the grades and insights in just a moment. Do these AIs generate the same output for you too? Share your experiences and thoughts in the comments below; I’d love to hear from you.
Assessing the best AI for Course Outlines
Certainly, let’s assess the three presented course outlines—ChatGPT, Google Bard, and Bing AI—based on the evaluation matrix criteria. We’ll assign grades from 1 to 5 for each category and provide feedback for each AI.
What were the outcomes of my experiment? Which AI did perform best?
| Criteria | Bard | ChatGPT 3.5 | Bing |
|---|---|---|---|
| Course | |||
| Objectives | 1 | 1 | 5 |
| Content | 4 | 4 | 4 |
| Activities | 2 | 3 | 4 |
| Assessments | 2 | 4 | 5 |
| Engagement | 2 | 3 | 5 |
| AI | |||
| Ease of use | 5 | 4 | 4 |
| Customization and adaptability | 3 | 4 | 3 |
| Course title | 1 | 5 | 4 |
| Total | 20 | 28 | 34 |
My evaluation of the course outlines
Let’s get into it! Following up on the grading table, here are my key takeaways.
- Objectives: Wow, both Bard and ChatGPT did not include learning objectives with this basic prompt! Bing had them covered and provided nice and measurable learning goals!
- Content: In terms of content, Bard was very generic. In addition, the topics were presented mostly as ‘what is’ questions. This is fine, but I prefer the action word approach of ChatGPT (‘Define on-page SEO’!), aligning with Bloom’s Taxonomy. That makes it easier to create assignments and align them perfectly with the content.
- Activities: Bard again came in last, ChatGPT performed okay, but Bing nailed it again with a detailed engagement strategy, almost over the top.
- Engagement: Bard was annoyingly generic, whereas ChatGPT and Bing applied very solid engagement strategies.
- Ease of use: All courses were nicely structured and logical. Given this was a fairly complex topic, I will not assess the complexity of the outline. But Bard is my favourite since it provides the most clarity and schematic approach to start designing my course.
- Customization & Adaptability: Both Bard and ChatGPT can be easily used and adapted, whereas the output of Bing has to be modified. Using ‘topic’ instead of ‘lesson’ is a no-go for me, requiring manual work to adjust. In addition, adding numbers to lessons, e.g. 7.1., can be nice for certain use cases, but not for others and might require additional work by the Instructional Designer.
- Course title: Bard failed since it didn’t provide one, Bing performed nicely and generated a great title, but ChatGPT excelled in providing an engaging title, describing the course perfectly.
Which AI do I choose to assist me in creating course outlines?
The answer is a mixture of all. My specific use case is to build upon my assistant’s work and design my course manually.
- Using Bloom’s Taxonomy made both ChatGPT and Bing come way ahead of Bard.
- Only Bing included learning objectives, which is a big plus.
- In terms of getting a quick overview of the course, I quite enjoy Bards down-to the earth, schematic approach. This allows me to get a quick glance and a good blueprint to build on.
- ChatGPT certainly has its point in creating snappy titles and headlines that engage. Certainly, you can find inspiration there to spice up your course.
- Bing had a quite nerdy approach and a touch of a topic list. This could be a nice cross-check for technical topics. Assuring that you never miss a detail can help!
- If I were to let the AI directly create the course without modification and turn it into a sellable product, ChatGPT certainly would be my favourite due to its convincing headlines.
And little do you know! I asked the AI to evaluate their course outlines too! Based on my evaluation matrix, here are the results!
Students evaluating their own input? You bet an AI can be very objective in its self-assessment. ChatGPT performed the task like a champ, whereas Bard and Bing failed this assignment due to the input character limit.
ChatGPT evaluates the three Course Outlines
Here is how ChatGPT assessed the course outlines of all competitors.
Prompt: how would you assess the 3 presented course outlines? Use the matrix and assign grades from 1 -5 for each category. Explain your decisions and create 3 paragraphs as feedback for the AI.
| Category | ChatGPT | Google Bard | Bing AI |
|---|---|---|---|
| Objectives | 4/5 | 3/5 | 5/5 |
| Content | 5/5 | 4/5 | 5/5 |
| Activities | 4/5 | 3/5 | 5/5 |
| Assessments | 4/5 | 3/5 | 5/5 |
| Engagement | 5/5 | 3/5 | 5/5 |
| Ease of Use | 5/5 | 4/5 | 4/5 |
| Customization & Adaptability | 4/5 | 3/5 | 4/5 |
| Course Title | 4/5 | 3/5 | 4/5 |
‘The Grades’ (by ChatGPT)
ChatGPT Course Outline Assessment
- Objectives (4/5): ChatGPT provides clear and measurable learning objectives that align well with the course description. However, some objectives could be more specific.
- Content (5/5): The content is well-organized, up-to-date, and relevant to the learning objectives. It includes various formats and opportunities for practice.
- Activities (4/5): The activities are engaging and generally align with the learning objectives, but there could be more variety in the types of activities.
- Assessments (4/5): The assessments align with the learning objectives and provide feedback, but there could be more diversity in assessment methods.
- Engagement (5/5): ChatGPT incorporates various engagement strategies effectively, making the course engaging and motivating.
- Ease of Use (5/5): The course overview is well-organized, easy to navigate, and written in a clear, plain language style.
- Customization and Adaptability (4/5): While it offers templates, there could be more flexibility in adapting the course overview.
- Course Title (4/5): The course title is clear, informative, and relatively catchy, but it could be more attention-grabbing.
Google Bard Course Outline Assessment:
- Objectives (3/5): Google Bard’s objectives are clear, but they could be more specific and directly tied to the course description.
- Content (4/5): The content is well-structured and relevant, but it lacks some depth in certain areas.
- Activities (3/5): The activities are somewhat engaging, but more variety and interactivity could improve the learning experience.
- Assessments (3/5): The assessments align with the objectives, but they could provide more comprehensive feedback.
- Engagement (3/5): Google Bard’s engagement strategies could be enhanced for better motivation and involvement.
- Ease of Use (4/5): The course overview is clear and navigable, but some sections could be more concise.
- Customization and Adaptability (3/5): While it offers customization, more flexibility to adapt to various teaching styles is needed.
- Course Title (3/5): The course title is informative but could be more catchy and attention-grabbing.
Bing AI Course Outline Assessment:
- Objectives (5/5): Bing AI provides clear, specific, and measurable learning objectives that align perfectly with the course description.
- Content (5/5): The content is well-structured, up-to-date, and highly relevant to the learning objectives, offering depth and variety.
- Activities (5/5): The activities are engaging, diverse, and closely aligned with the learning objectives, promoting collaboration.
- Assessments (5/5): Assessments align excellently with the learning objectives, providing detailed and accurate feedback.
- Engagement (5/5): Bing AI excels in engagement strategies, ensuring strong motivation and involvement throughout the course.
- Ease of Use (4/5): The course overview is clear and easy to navigate, but minor improvements in clarity could enhance usability.
- Customization and Adaptability (4/5): While it offers customization, further flexibility for different teaching styles is desirable.
- Course Title (4/5): The course title is informative and somewhat catchy but could be more attention-grabbing.
AI provides teacher feedback to their AI students!
And now comes my favourite part! I asked the AI to provide feedback on this virtual assignment to create the course outlines. How crazy is the outcome? Let me know in the comments!
ChatGPT teacher Feedback to AI:
- ChatGPT, you’ve crafted a well-structured course outline with clear learning objectives and engaging content. However, there’s room for improvement in diversifying activities and assessments to enhance the learning experience further. Your use of engagement strategies is commendable, making the course motivating and enjoyable. The ease of use and customization options are impressive, but a more attention-grabbing course title would be a valuable addition.
- Google Bard, your course outline provides a good foundation with clear objectives and structured content. However, it could benefit from more depth in certain areas and additional engagement strategies to keep learners motivated. Usability is generally good, but some sections could be more concise, and the course title could be more captivating to attract learners.
- Bing AI, you’ve created an exceptional course outline with clear, specific objectives, and rich content. Your engagement strategies are outstanding, ensuring strong learner involvement. Usability is mostly excellent, with minor improvements possible for even greater clarity. Customization options are solid, and your course title is informative but could be more attention-grabbing. Overall, well done!
Conclusion: The course outlines creation with AI
In this thrilling AI showdown, we’ve witnessed ChatGPT, BARD, and Bing go head-to-head in crafting online course outlines. But what were the outcomes of this experiment?
This is just the beginning of our exploration into the world of AI-powered instructional design, and plenty more experiments are on the horizon. Stay tuned as we continue our quest to unlock the full potential of AI in education!
If you read the very short and unprofessional prompt, you know what’s coming! I will repeat this experiment and test these AI with a more complex prompt. I am very curious! See you then.
In the meantime, I suggest reading
- The best AI for Generating a Rubric
- Creating Effective Learning Objectives with AI: A Step-by-Step Guide
Appendix: Output per AI
I did not modify the output of the AI tools. Find the three answers from Bard, ChatGPT and Bing below (wall of text alarm!).
Here is again the prompt I used for all three queries.
Prompt: Create the outlines of an online course about on-page SEO.
Chat GPT
Certainly, here’s an outline for an online course on on-page SEO:
Course Title: Mastering On-Page SEO: Boost Your Website’s Visibility
Module 1: Introduction to On-Page SEO
- Lesson 1.1: What is On-Page SEO?
- Define on-page SEO and its importance.
- Explain how on-page SEO fits into the broader SEO strategy.
- Lesson 1.2: SEO Fundamentals
- Cover the basics of search engines.
- Introduce key SEO concepts like keywords, SERPs, and algorithms.
- Explain the role of on-page SEO in search engine ranking.
Module 2: Keyword Research and Analysis
- Lesson 2.1: Keyword Research Techniques
- Explore different methods for finding relevant keywords.
- Discuss tools and resources for keyword research.
- Lesson 2.2: Competitive Analysis
- Teach how to analyze competitors’ keywords.
- Explain the importance of identifying keyword gaps.
Module 3: On-Page Content Optimization
- Lesson 3.1: Content Quality and Relevance
- Emphasize the significance of high-quality content.
- Discuss content relevance to target keywords.
- Lesson 3.2: Content Formatting and Structure
- Explain the importance of headings, subheadings, and bullet points.
- Teach best practices for content organization.
- Lesson 3.3: Keyword Placement
- Discuss where and how to incorporate keywords naturally.
- Provide examples of keyword optimization in content.
Module 4: On-Page SEO Elements
- Lesson 4.1: Meta Tags and Titles
- Explain the role of meta tags and titles.
- Offer guidelines for optimizing meta tags.
- Lesson 4.2: Image Optimization
- Cover image SEO techniques, including alt text and file names.
- Discuss the impact of images on page load speed.
- Lesson 4.3: URL Structure
- Teach the importance of SEO-friendly URLs.
- Provide tips for optimizing URL structure.
Module 5: Technical On-Page SEO
- Lesson 5.1: Page Speed Optimization
- Discuss the significance of page load speed.
- Explain techniques for improving website performance.
- Lesson 5.2: Mobile Optimization
- Highlight the importance of mobile-friendly design.
- Provide strategies for optimizing for mobile users.
Module 6: On-Page SEO Tools and Analytics
- Lesson 6.1: SEO Tools
- Introduce popular on-page SEO tools and their features.
- Explain how to use these tools effectively.
- Lesson 6.2: Google Analytics Integration
- Show how to set up Google Analytics for tracking on-page SEO performance.
- Teach how to interpret data and make improvements.
Module 7: SEO Best Practices and Future Trends
- Lesson 7.1: SEO Best Practices
- Summarize key on-page SEO best practices.
- Provide a checklist for on-page optimization.
- Lesson 7.2: Future Trends in On-Page SEO
- Discuss emerging trends in on-page SEO, such as voice search and AI.
- Encourage staying updated with SEO industry changes.
Module 8: Final Assessment and Certification
- Lesson 8.1: Final Quiz
- Offer a comprehensive quiz to test knowledge gained throughout the course.
- Lesson 8.2: Course Completion and Certification
- Explain the criteria for course completion.
- Provide downloadable certificates for participants who successfully complete the course.
Conclusion and Next Steps
- Recap the key takeaways from the course.
- Suggest further resources and learning opportunities for advanced on-page SEO.
This course outline should serve as a structured guide for creating an online course on on-page SEO, covering essential concepts, techniques, and tools for improving website visibility.
Google Bard
Outline for an online course about on-page SEO:
Module 1: Introduction to On-Page SEO
- What is on-page SEO?
- Why is on-page SEO important?
- How search engines work
- On-page SEO ranking factors
- How to optimize your website for search engines
Module 2: Keyword Research
- What is keyword research?
- Why is keyword research important?
- How to conduct keyword research
- Different types of keywords
- How to choose the right keywords for your website
Module 3: Content Optimization
- What is content optimization?
- Why is content optimization important?
- How to write SEO-friendly content
- How to use keywords in your content
- Other factors to consider when optimizing your content
Module 4: On-Page SEO Elements
- Title tags
- Meta descriptions
- Headings and subheadings
- Image optimization
- Internal linking
- Other on-page SEO elements
Module 5: Technical SEO
- What is technical SEO?
- Why is technical SEO important?
- Site architecture
- Crawlability and indexability
- Page speed
- Mobile-friendliness
- Other technical SEO factors
Module 6: Measuring and Tracking Results
- How to measure your website’s SEO performance
- How to track your progress over time
- SEO tools and resources
Module 7: Case Studies
- Case studies of successful on-page SEO campaigns
This is just a basic outline, of course. The specific topics covered in each module will vary depending on the length and scope of your course. You may also want to include additional modules on specific topics, such as e-commerce SEO, local SEO, or international SEO.
Here are some additional tips for creating a successful online course on on-page SEO:
- Make sure your course is up-to-date with the latest SEO trends and best practices.
- Use clear and concise language that is easy for students to understand.
- Provide plenty of examples and case studies to illustrate your points.
- Offer students the opportunity to practice what they are learning through exercises and assignments.
- Make sure your course is interactive and engaging.
- Provide students with feedback on their work.
- Offer support to students who have questions or need help.
By following these tips, you can create an online course on on-page SEO that is informative, engaging, and effective.
Bing AI
Here is a possible outline of an online course about on-page SEO:
- Course title: On-Page SEO: How to Optimize Your Web Pages for Search Engines and Users
- Course description: This course will teach you the fundamentals and best practices of on-page SEO, which is the process of optimizing your web page content for search engines and users. You will learn how to use various on-page SEO techniques and tools to improve your page’s relevance, usability, and performance. By the end of this course, you will be able to create web pages that rank higher in search results and provide a better user experience.
- Course outline:
- Module 1: Introduction to On-Page SEO
- Topic 1.1: What is On-Page SEO and Why is it Important?
- Topic 1.2: How Search Engines Crawl, Index, and Rank Web Pages
- Topic 1.3: How to Conduct Keyword Research and Analysis
- Module 2: Content Optimization
- Topic 2.1: How to Write SEO-Friendly Content that Matches Search Intent
- Topic 2.2: How to Optimize Title Tags, Meta Descriptions, and Headings
- Topic 2.3: How to Use Images, Videos, and Multimedia Content
- Module 3: Technical Optimization
- Topic 3.1: How to Optimize URLs, Site Structure, and Navigation
- Topic 3.2: How to Optimize Page Speed, Mobile-Friendliness, and Security
- Topic 3.3: How to Use Schema Markup, Structured Data, and Rich Snippets
- Module 4: Link Optimization
- Topic 4.1: How to Use Internal Links, Anchor Texts, and Breadcrumbs
- Topic 4.2: How to Use External Links, Backlinks, and Link Building Strategies
- Topic 4.3: How to Use Social Media, Social Sharing Buttons, and Social Signals
- Module 1: Introduction to On-Page SEO
- Learning objectives: By the end of this course, you will be able to:
- Explain what on-page SEO is and how it affects your web page rankings and visibility in search engines.
- Apply various on-page SEO techniques and tools to optimize your web page content for search engines and users.
- Evaluate your web page’s on-page SEO performance using analytics and auditing tools.
- Identify and fix common on-page SEO issues and errors.
- Learning activities: For each module, you will engage in the following learning activities:
- Watch a video lecture that introduces the main concepts and ideas of the module.
- Read a text that provides more details and examples of the module topics.
- Complete a quiz that tests your understanding and recall of the module content.
- Participate in a discussion forum that allows you to share your opinions and experiences with your peers and instructors.
- Work on a project that requires you to apply the module content to optimize a web page of your choice.
- Learning assessments: For each module, you will complete the following learning assessments:
- A multiple-choice quiz that measures your knowledge and comprehension of the module content.
- A peer-reviewed project that assesses your ability to apply the module content to optimize a web page of your choice.
- A self-reflection journal that evaluates your learning process and outcomes for the module.
- Engagement strategies: To enhance your engagement and motivation throughout the course, we will use the following engagement strategies:
- Gamification: You will earn points, badges, and rewards for completing the learning activities and assessments.
- Personalization: You will be able to choose your own web page topic and customize your learning path according to your preferences and goals.
- Storytelling: You will be able to follow a narrative that guides you through the course content and connects it with real-world scenarios and examples.
The final conclusion
I doubted that you made it to the end of this post, but here you are! I hope you enjoyed this experiment about finding the best AI for course outlines.
Leave your comment below! Do you agree with my point of view and evaluation? Post your suggestions and feedback on improving this format, or maybe a new experiment you are interested in!
