Lesson 5 – Understanding the Limitations of ChatGPT

Introduction

While ChatGPT is a powerful tool capable of helping you with a wide range of tasks, from drafting emails to brainstorming ideas, it’s important to recognize its limitations. Like any technology, ChatGPT has boundaries that users should be aware of to ensure they are using it effectively.

In this lesson, we’ll dive into what ChatGPT can and can’t do—whether it’s providing real-time information, performing tasks, or retaining memory between sessions. By understanding these limitations, you’ll be able to use ChatGPT more efficiently and avoid common pitfalls.

Let’s explore how to get the best out of ChatGPT by knowing where its strengths and limitations lie.

1. ChatGPT Doesn’t Access Real-Time Information (for now)

One of the key limitations of ChatGPT is that it cannot access real-time information, such as the latest news, live data, or updates. The information ChatGPT provides is based on the data it was trained on, and this dataset currently has a cutoff point (up to September 2021 for most versions, though some versions may have data until mid-2023).

However, it’s important to note that future versions of ChatGPT may have access to real-time information as the technology evolves.

Example : Asking for Current Events

Prompt: “What is the latest update on global stock markets?”

ChatGPT’s Response:

“I cannot provide real-time information. My training data only goes up to September 2021. Please check a reliable financial news source for the latest updates. Future versions may be able to access real-time data, depending on the platform and integrations available.”

2. It Lacks Specialized Knowledge Beyond Its Training Data

Although ChatGPT has been trained on a wide variety of subjects, it doesn’t have specialized expertise in highly technical, niche, or evolving fields. For example, advanced medical advice, in-depth legal counsel, or cutting-edge technological details might not be accurate or sufficient.

Example : Asking for Medical Advice

Prompt: “What should I do for severe chest pain?”

ChatGPT’s Response:

“I am not a medical professional, and for severe health concerns, it is important to seek immediate medical attention. Please consult a healthcare provider.”

ChatGPT can offer general information but should never replace professional, specialized advice in areas like medicine, law, or finance.

3. ChatGPT Can Sometimes Provide Incorrect or Outdated Information

Despite its vast dataset, ChatGPT can occasionally generate incorrect or outdated responses, especially when dealing with evolving topics or subjects that have changed since its training period.

Example : Asking About a Changing Industry

Prompt: “What are the latest features of iPhone 15?”

ChatGPT’s Response:

“I do not have information on the iPhone 15. My data only goes up to 2021. Please check Apple’s official website or a recent tech review for the latest details.”

In cases like these, it’s important to cross-check information with more up-to-date sources.

4. Limited Understanding of Context or Ambiguity

While ChatGPT is quite advanced, it can sometimes misinterpret vague or ambiguous queries. If your prompt lacks clarity or context, ChatGPT might not provide the response you’re expecting.

Example : Vague Prompts

Prompt: “Tell me about it.”

ChatGPT’s Response:

“Could you clarify what ‘it’ refers to? Providing more context will help me give you a more accurate response.”

To get better answers, it’s always helpful to be specific in your queries.

5. ChatGPT Does Not Perform Actions or Integrate with External Systems

Currently, ChatGPT cannot perform actions such as sending emails, setting reminders, or directly integrating with external systems and apps. While it can suggest actions and help you draft emails or messages, you will need to execute these tasks manually.

Example : Asking ChatGPT to Perform a Task

Prompt: “Send an email to my boss about the project update.”

ChatGPT’s Response:

“I cannot send emails or perform tasks on external systems. However, I can help you draft the email. Here’s an example:
‘Dear [Boss],
I wanted to update you on the project. We have completed the initial phase and are on track for the next milestone. Let me know if you need further details.
Best, [Your Name]’”

While ChatGPT can assist with drafting and planning, you will still need to manually perform the task.

Note: In the future, versions of ChatGPT integrated with external platforms or applications may offer the capability to perform tasks such as sending emails, managing calendars, or accessing external systems. Some tools already allow limited integration with apps like calendars, task managers, and emails.

6. No Personal Memory or Learning Capability (Limited Memory for Specific Interactions)

In general, ChatGPT does not have persistent memory across conversations unless explicitly instructed. This means it does not retain information from previous sessions or conversations unless you ask it to. If you don’t ask ChatGPT to remember something, it will treat each conversation as a new one, starting fresh.

However, in certain settings or configurations, you can instruct ChatGPT to remember specific details from previous conversations, which can then be recalled in future interactions. Keep in mind that this is an optional feature, and ChatGPT does not have the ability to “learn” or retain information permanently across all users.

Example : Follow-up Questions

Prompt: “What did I ask you last time?”

ChatGPT’s Response:

“I don’t have access to previous conversations unless you specifically asked me to remember something. Otherwise, I start fresh with each session.”

If you want ChatGPT to remember something, you can ask it explicitly during your conversation. For example:

“Remember that I prefer to work on project reports in the morning.”

In this case, ChatGPT will recall your preference in future conversations when you ask it about your project work.

7. Responses Can Be Too General—Prompt Clarity Matters

This point is not really a limitation of ChatGPT but rather a reflection of how important it is to ask clear, specific questions. If the prompt you give ChatGPT is too vague or lacks detail, it may provide a general response that doesn’t fully meet your expectations.

Example : General Response to a Vague Prompt

Prompt: “Give me tips for a healthy life.”

ChatGPT’s Response:

*“Here are some general tips for a healthy life:

1. Eat a balanced diet.
2. Exercise regularly.
3. Get enough sleep.
4. Stay hydrated.”*

While these tips are valid, they’re quite general because the prompt was broad. To get more detailed and tailored advice, it’s important to refine your prompt by providing more context or specifying your needs.

---

The Right Way to Ask for a More Detailed Response

By including more specific details in your prompt, you can get a response that’s tailored to your exact needs.

Improved Prompt:

“Can you give me specific diet tips for someone who is trying to build muscle and exercises 4 times a week?”

ChatGPT’s Response:

*“Here are some diet tips for someone looking to build muscle and working out 4 times a week:

1. Increase your protein intake to about 1.6-2.2 grams per kilogram of body weight. Focus on lean proteins like chicken, fish, tofu, and legumes.
2. Add complex carbohydrates (e.g., brown rice, quinoa, whole grains) to fuel your workouts and promote muscle recovery.
3. Include healthy fats from sources like avocados, nuts, and olive oil to support hormone production and energy balance.
4. Eat a small meal or snack rich in protein and carbs within 30-60 minutes after your workout for optimal recovery.”*

This more detailed prompt leads to a much more useful and specific response.

Conclusion: Understanding ChatGPT’s Limitations

While ChatGPT is a powerful and versatile tool, it’s important to understand its limitations. It cannot provide real-time information, specialized advice, or perform actions for you, and it may sometimes provide outdated or incorrect information. However, when used with a clear understanding of these limitations, ChatGPT can still be an incredibly useful assistant for learning, productivity, and creative tasks.

<< Lesson 4: Using ChatGPT for Learning and Skill Development