Communicative-Strategies-in-the-Age-of-Chatbot-Pragmatics (1).pptx

Using AI in the classroom

1. Communicative Strategies in the Age of Chatbot Pragmatics Alexey Tymbay Technická univerzita v Liberci MINDING THE GAPS 12 th  Brno International Conference of English, American, and Canadian Studies

2. Traditional vs. Chatbot Pragmatics Human-Human Communication Based on Gricean principles: * emphasizing context * shared knowledge * cooperative principles. Meaning is co-constructed between interlocutors. Human-Chatbot Communication Relies on human’s "prompting" strategy.

3. Unique Aspects of Human-Chatbot Interaction Limited Experience Constrained Capabilities Lack of Shared Goal

4. Can we use chatbots for communication development?

5. Case Study: Impact of Prompting Strategies 1 Participants 24 students engaged in chatbot communication (Chat GPT) to complete various tasks. 2 Methodology Divided into two groups: one trained in prompting techniques, the other untrained. 3 Evaluation Task completion rates Number of turns Chatbot misunderstandings User satisfaction

6. Research Methodology Training Phase 60-minute training session on effective prompting techniques for the focus group. Task Phase Both groups completed 20 communicative tasks of varying complexity levels (90 minutes). Feedback Phase Survey (Google Forms) and Group discussions to reflect on participants' perceptions and challenges.

7. Prompting Instruction Be Clear and Specific: Example: "Explain the key differences between renewable and non-renewable energy sources." Provide Context: Example: "I am preparing a presentation for high school students on climate change. Could you explain the role of carbon dioxide in global warming in simple terms?" Define the Output Format: Example: "Provide a bulleted list of the benefits of learning a second language." Set the Length of the Answer: Example: "Summarize the novel 'Pride and Prejudice' in three sentences." Use Step-by-Step Instructions: Example: "How do I set up a basic website using HTML and CSS? Provide a step-by-step guide. 6. Clarify the Audience: Example: "Explain the theory of relativity to a 12-year-old." 7. Include Constraints or Requirements: Example: "Give me a healthy dinner recipe under 500 calories." 8. Combine Multiple Questions Thoughtfully: Group related questions in one prompt. Example: "What is cognitive dissonance, how does it affect behavior, and what are some ways to overcome it?"

8. Sample Tasks 1 Gricean Pragmatics Based on conventions, norms, and top-down pragmatic influence. Assumes shared linguistic and cultural background. 2 Intercultural Pragmatics 3 Human-Machine Pragmatics Introduces new challenges. Chatbots lack innate cultural and social knowledge. Human guides the conversation and "socializes" the artificial agent. 1 Simple information retrieval tasks include customization elements (location links, level expectations, and so on). Check the weather forecast for tomorrow in Liberec (Czech Republic). Find the cheapest bus from Liberec to Prague tomorrow morning. 2 Complex information retrieval tasks satisfy a set of predefined criteria. Find nearby a programming course with good reviews, whose completion will facilitate my further employment in an IT company in the Czech Republic. 3 Translation tasks. Creativity tasks. Translate an abstract from a provisional Bachelor thesis (quote) from Czech into English. Create a list of elective subjects that TUL students are recommended to add to their study program if they want to improve their command of EFL Methodology. 4 Analysis and synthesis tasks involving a high degree of personal customization. Relationship and attitude tasks. Help me improve my relationship with my girlfriend/boyfriend. Generate an application letter considering my qualifications and the position advertised. 5 Tasks involving expression of empathy and emotional intelligence. Give me advice on a complex ethical situation, such as whether to report a colleague’s misconduct. A user expresses feelings of severe depression or is in a crisis and asks for counselling.

9. Assessment Form

10. Key Findings: Task Completion and Turns 94% Focus Group Completion Average task completion rate for the trained group. 92% Control Group Completion Average task completion rate for the untrained group. 4.2 Focus Group Turns Average turns for Level 5 tasks in the trained group. 5.0 Control Group Turns Average turns for Level 5 tasks in the untrained group. The impact of prompting training became more apparent as task complexity increased, particularly in Levels 4 and 5.

11. User Satisfaction and Chatbot Misunderstandings

12. Feedback: “reach understanding halfway” “lead to more efficient and satisfying outcomes” “anticipate misunderstandings” “provide context” “take the emotional aspect of interaction into account”

13. Conclusions and Future Directions 1 Prompting Training Impact Enhances performance in complex human-chatbot interactions. 2 Adaptive Strategies Untrained users develop effective prompting skills over time. 3 Human vs. Chatbot Interaction Human-human communication remains more flexible and adaptive. 4 Future Research Explore chatbots' potential in EFL communication teaching.

14. Chatbots in Education: Potential and Limitations Enhanced Engagement Chatbots can increase student engagement in learning activities. Classroom Interaction Promotes interactive learning experiences. Learning Support Assists in various forms of academic tasks. Need of Human Intervention Limited awareness.

15. References [email protected]