NAGAP 2014 Fighting Back Against Fraud in the Academic Space FINAL.pptx

fraud in education

1. Fighting Back Against Fraud in the Academic Space Presented by: Cammie Baker Clancy, SUNY Empire State College Michelle Hampton, ETS, TOEFL ® Program Timothy J. Kell, ECE ® Educational Credential Evaluators, Inc. Insert your logo here

2. Agenda Introductions Fraud in the Academic Space Testing Essays and Letters of Recommendation Credential Evaluations Group Discussion

3. testing

4. The TOEFL ® Test Approach to Security ETS takes test security extremely seriously and uses a 3-pronged approach to protect test integrity

5. Testing Fraud has Changed Over Time Then Now Low tech Individual misconduct Localized action High tech Global scale, across time zones Organized rings and individual misconduct Big business New challenges require new processes and tools

6. Security - Prevention Training and certification of test center supervisors Stringently enforced identification requirements Digital photograph on test day and on score reports Test-taker photograph appears on examinee’s computer at beginning of test and again after break to verify identity Integrated test questions deter test-taker memorization of text to fit into responses; less amenable to coaching State-of-the-art encryption software for delivery of the test to the center and return of test-taker responses to ETS

7. Security - Detection Handwriting sample and signature collected Unannounced test center audits Secret shoppers Extensive review and mining of data Post-test forensic analyses

8. Security - Detection When there are concerns about score validity Review of individual scores Review of test center scores Increased monitoring of test centers Voice analysis, handwriting analysis Other confidential measures When policy or procedural irregularities are discovered Scores are cancelled Test center is closed Scores from previous administrations are reviewed Institutions are informed

9. Security — Communication When scores are cancelled, ETS contacts all institutions designated by the student to receive scores Communication from institutions with concerns about possibly fraudulent scores helps our investigations Every concern is investigated by the Office of Testing Integrity (OTI) [email protected] or Security Hotline [phone] ETS will notify you with the results of any investigation

10. Biometric Voice Identification Software for TOEFL ® Testing New! Now being used on all test takers worldwide before scores are released Uses statistical pattern-matching techniques, advanced voice classification methods and inputs from multiple systems to compare speech samples from TOEFL test takers Offers ability to create voice prints for detailed analysis to validate TOEFL test takers Introduced in 2012 for test security investigations Voice identification system flags scores for review by human analysts

11. Biometric voice identification is used to detect impersonation in three ways: Repeat test takers Compare voiceprints with speech samples across multiple administrations for the same test taker Potential impersonators within a test center Compare voiceprints with speech samples for all candidates at a given test center Known impersonators within a group Compare voiceprints with speech samples of known imposters to all candidates within a suspect group

12. Additional Measures to Prevent and Detect Fraud New! Implementation of electronic wands at all test centers worldwide to detect electronic photographic, audio or recording devices New techniques to ensure the authenticity of test taker photographs

13. Continually Piloting Methods of Prevention and Detection Finger printing in India Facial recognition Working with the Chinese government administrator of the TOEFL ® test to implement facial recognition capabilities Will match the image of the test taker on the new National ID used at registration, with the image taken at the test center at check-in

14. The Fight Against Fraud is Never Over The TOEFL ® Program has revised its policies and procedures to assist institutions Eliminated student permission requirement to tell institutions why a score has been cancelled Simplified process for institutions to learn why a score has been cancelled Provided new data fields to score reports: ID type, last four digits of ID number and issuing country Free test vouchers available for universities where scores are cancelled for students already on campus

15. Essays and Letters of Recommendation Fraud, Plagiarism or Misinterpretation? Thanks, Sharon Grodzielanek

16. Know What Y ou’re Asking For The Importance of Essays in the Admissions Process Program variation Writing-intensive degree programs Business/Technology focused Terminal degree or prep for doctoral study Personal statement, analytical essays, writing sample What vehicle provides best assessment? How do you evaluate?

17. Know What You’re Asking For Specify criteria for the applicant Original work Specific to the essay prompts Grammar, structure, content coherence

18. Trouble Spots: Stating the Obvious Inconsistency Font changes, irregular paragraph structure, disconnect of content and consistency of flow Academic record (grades, test scores) inconsistent with quality of essays Concepts, terms, theories that have shown up in recently published materials (no citations) – use your faculty reviewers Tools for verification Tons of options (many free): Turnitin, Grammarly, Plagscan, SmallSeoTools, ProWritingAid, Viper, EVE2, Plagiarisma, and plain, old Google.

19. Is it Fraud, Plagiarism or Misinterpretation? Consider the following Non-traditional student who has been away from academia for many years International student who comes to academic writing with some cultural differences Applicant who may have a documented learning disability

20. Be Proactive Provide Resources Sample rubric Examples of acceptable submissions

21. Be Proactive Provide Resources Pre-application workshops for prospective students on academic writing, proper citation, etc… Citing Your Sources Workshop:   TOPICS COVERED: Why cite? What is a citation? Parts of a citation MLA vs. APA style Knowing your source Documentation tips Learn why citing your sources is so important and where to get citation formatting information for styles such as APA, MLA, etc. Ideal for anyone interested in learning how to avoid accidental plagiarism.

22. Recommendations Standard practice Two to three letters of recommendation Includes a checklist or rating of applicant’s academic qualities. Consistent with official transcripts and academic records? Narrative section – does it make sense? Applicant must complete FERPA statement

23. Recommendations Standard Practice Simple steps to insure authenticity Check for clarity of recommendation and consistency with evaluation and the way in which the recommender claims to know the applicant . Academic recommendation vs. professional Contact information (email addresses, phone numbers, institution or organization represented ). Do the dates line up? Steps for Submission Electronic – sometimes harder to detect Hard copy –some double checks

24. Responding to Applicants Proper notification provided in writing to the applicant Clearly state options or alternative requirements Resubmission of essays Prescribed recommendation of completion of a writing course before reapplying Rejection of application Make sure established policies are accessible and transparent Academic honesty Appeal process for denied applicants

25. A Credential Evaluator’s Perspective One Size Never Fits All! Large volume of students Many non-traditional students Worldwide client base

26. A Credential Evaluator’s Perspective We get the problem cases. aka “Job Security”

27. A Credential Evaluator’s Perspective What works for us….

28. The Fraud We See… Document Alteration

29. The Fraud We See… Document Fabrication

30. The Fraud We See… In-house Fraud

31. The Fraud We See… Misleading Translations Do you require professional translations, or allow students to prepare their own? Do you accept documents issued in English when those documents are not valid in country?

32. Fraud We See… Omission “I need a report without my university study!”

33. The Fraud We See… Diploma Mills

34. What We Are Doing About It… Carefully designed documentation requirements

35. What We Are Doing About It… High resolution image scanning and tracking of document forensics

36. What We Are Doing About It… Researching and Using All Available Resources

37. What We Are Doing About It… Increased Availability & Use of Online Verification

38. What We Are Doing About It… Strict Verification Procedures

39. What We Are Doing About It… Sharing Information Confirmed Fraud: Schools, Third Parties, Other Evaluation Companies, FBI, Homeland Security Prevention: Training & Public Service

40. Group Discussion What are you seeing in your applicants? What best practices have you put in place? How can we help each other? Your logo

41. Presenters Michelle Hampton ETS, TOEFL ® & GRE ® Programs [email protected] Timothy Kell ECE [email protected] Cammie Baker Clancy SUNY, Empire State College [email protected]

42. QUESTIONS