Pilot study

student research, how to do a research?

1. July 30, 2017July 30, 2017
RESEARCH – PILOT
STUDY

2. July 30, 2017July 30, 2017
Definition of research :Definition of research :
Systematic enquiry that Systematic enquiry that
uses orderly , disciplined uses orderly , disciplined
methods to answermethods to answer
questions or solve problemsquestions or solve problems
..

3. July 30, 2017July 30, 2017
Research Research
problem :problem :
A situation involving an A situation involving an
enigmatic , perplexing orenigmatic , perplexing or
conflictful condition that can conflictful condition that can
be investigated through be investigated through
disciplined inquiry .disciplined inquiry .

4. July 30, 2017July 30, 2017
Steps in the research process Steps in the research process
::
Phase I :Phase I : Conceptual phase Conceptual phase
Phase II :Phase II : The design and The design and
planning planning
phase phase ( Pilot ( Pilot
study ) .study ) .
Phase III :Phase III : The emperical phase . The emperical phase .
Phase IV :Phase IV : The analytical phase The analytical phase
..
Phase V :Phase V : The dissemination The dissemination
phase phase

5. July 30, 2017July 30, 2017
Three methods to minimizeThree methods to minimize
these problems :these problems :
* Pre testing* Pre testing
* Conducting a pilot study .* Conducting a pilot study .
* * Adding manipulationAdding manipulation
checkschecks ..

6. July 30, 2017July 30, 2017

Pre testing :Pre testing :
It is the process of It is the process of
measuring the effectiveness measuring the effectiveness
of the instrument developed of the instrument developed
for the major study or testing for the major study or testing
the hypotheses .the hypotheses .

7. July 30, 2017July 30, 2017
Pilot study :Pilot study :
- - It is the preliminary small - It is the preliminary small -
scale trial run of the research scale trial run of the research
study . study . (Treece & Treece)(Treece & Treece)
- It is a small - scale version or - It is a small - scale version or
trial run done in preparation for trial run done in preparation for
a major study. a major study. (Polit & Hunglar ) (Polit & Hunglar )

8. July 30, 2017July 30, 2017
Manipulation Checks :Manipulation Checks :

It is simply testing whether It is simply testing whether
or not your independent or not your independent
variables had the intended variables had the intended
effects on your participants .effects on your participants .

9. July 30, 2017July 30, 2017
Pretesting the instrument :Pretesting the instrument :
(Purpose)(Purpose)
 Trial test of the instrument Trial test of the instrument
developed for testing the developed for testing the
hypotheses .hypotheses .
 Time for checking the reliability Time for checking the reliability
& validity of the instrument.& validity of the instrument.
 Pre - test is a check on the Pre - test is a check on the
instrument to evaluate suchinstrument to evaluate such
factors as it’s length , it’sfactors as it’s length , it’s
wording .wording .

10. July 30, 2017July 30, 2017
Reveals problems relating to Reveals problems relating to
answering, completing and answering, completing and
returning the instrument .returning the instrument .
Helps in tabulating the data .Helps in tabulating the data .

Also points out weaknesses in Also points out weaknesses in
administration , organization administration , organization
and distribution of the and distribution of the
instrumentinstrument

11. July 30, 2017July 30, 2017
Methods of pre testing :Methods of pre testing :
* * InterviewingInterviewing
GGives opinions of people ives opinions of people
differing in education , differing in education ,
temperament and view points to temperament and view points to
see if they understand the see if they understand the
questions and are able to give questions and are able to give
complete and pertinent answers complete and pertinent answers
..

12. July 30, 2017July 30, 2017
During pre test researcher must During pre test researcher must
keep in mind purpose of the study , keep in mind purpose of the study ,
at the same time be aware of the at the same time be aware of the
aim and intent of each question :aim and intent of each question :
Investigator must be alert to every Investigator must be alert to every
question , comment & non verbal question , comment & non verbal
cue of the respondent & should cue of the respondent & should
carefully record them( alternative carefully record them( alternative
questions should replace (them) questions should replace (them)
those that are not clear) . those that are not clear) .

13. July 30, 2017July 30, 2017
 Ask the respondents if they are Ask the respondents if they are
stuck, if they are not able to stuck, if they are not able to
understand the questions . understand the questions .
They should note questions which They should note questions which
needed more needed more
information/clarification .information/clarification .
 If sufficient space was allowed for If sufficient space was allowed for
recording answers & if the recording answers & if the
instrument was too long (time to instrument was too long (time to
administer )administer )

14. July 30, 2017July 30, 2017
 Interviewer should record their Interviewer should record their
own observations, criticism, own observations, criticism,
difficulty in location of respondents, difficulty in location of respondents,
questions causing embarrassment questions causing embarrassment
and resistance ,problems of and resistance ,problems of
maintaining rapport and maintaining rapport and
respondents who are bored / respondents who are bored /
impatient .impatient .
 Is the question understood & Is the question understood &
answered in a matter wanted to .answered in a matter wanted to .

15. July 30, 2017July 30, 2017
 It also answers questions as :It also answers questions as :
• Is proper place available for theIs proper place available for the
interviewer ?interviewer ?
• How much time is needed to ask all theHow much time is needed to ask all the
questions ? questions ? ( get informed consent for ( get informed consent for
lengthy ones ) .lengthy ones ) .
• Is more than one interviewer needed ?Is more than one interviewer needed ?
• Are they properly trained ? Are they properly trained ?
• do the subjects understand the do the subjects understand the
wordings wordings
of the questions or if they misinterpret of the questions or if they misinterpret
questions ?questions ?

16. July 30, 2017July 30, 2017
• do the participants find any part of the do the participants find any part of the
questionnaire objectionable or offensive questionnaire objectionable or offensive
??
• is the sequencing of instruments within is the sequencing of instruments within
the data collection package is smooth the data collection package is smooth
and effective .and effective .
• does the instrument yeild data with does the instrument yeild data with
sufficient variability . sufficient variability . ( For most ( For most
research questions the instruments research questions the instruments
should ideally discriminate among should ideally discriminate among
participants with different levels of an participants with different levels of an
attribute ) – attribute ) – women experience greater women experience greater
depression than mendepression than men – an instrument to – an instrument to
measure different levels of depression .measure different levels of depression .

17. July 30, 2017July 30, 2017
During the pre test the instrument & During the pre test the instrument &
scales are likewise tested to scales are likewise tested to
determine their determine their Reliability & Reliability &
ValidityValidity
Reliability :Reliability : Refers to the degree of Refers to the degree of
consistency (or) accuracy with which consistency (or) accuracy with which
the instrument ( used under similar the instrument ( used under similar
conditions ) measures the attribute conditions ) measures the attribute
under investigation .under investigation .
Validity :Validity : Refers to the degree of Refers to the degree of
consistency (or) accuracy with which consistency (or) accuracy with which
the instrument measures what it is the instrument measures what it is
supposed to measuresupposed to measure . .

18. July 30, 2017July 30, 2017
Process of pre testing an instrument :Process of pre testing an instrument :
Validity ?Validity ? Valid Valid!!
Reliability ?Reliability ?
ReliableReliable!!


Instrument
Untested
Tried on
Subjects
Applied in
Actual
situation
Revised perhaps
More than one
Time
Instrument
Valid

19. July 30, 2017July 30, 2017
THE PILOT STUDY :THE PILOT STUDY :
A small preliminary A small preliminary
investigation of the same investigation of the same
general character as the general character as the
major study .major study .

20. July 30, 2017July 30, 2017
designed to acquaint the designed to acquaint the
researcher with the problems to be researcher with the problems to be
corrected in preparation for the corrected in preparation for the
larger research project .larger research project .
 it also provides the researcher it also provides the researcher
with an opportunity to try out the with an opportunity to try out the
procedures for collecting data .procedures for collecting data .
 during pilot study the instruments during pilot study the instruments
is going through a pretest although is going through a pretest although
the instrument content is expected the instrument content is expected
to be in final form by this stage .to be in final form by this stage .

21. July 30, 2017July 30, 2017
What should be ready by the time What should be ready by the time
you come to the pilot study you come to the pilot study
stage you should have: stage you should have:
 Conceptualized the problem Conceptualized the problem
 Thought through the implicationsThought through the implications
 Completed the literary search Completed the literary search
 Stated the hypotheses / Question Stated the hypotheses / Question
 Determined the sample Determined the sample
 Developed the instrument Developed the instrument

22. July 30, 2017July 30, 2017
 Determined the sampleDetermined the sample
 Developed the instrumentDeveloped the instrument
 Worked out the research designWorked out the research design
 Decided on the sampling Decided on the sampling
techniquetechnique
 Decide on the method of testing Decide on the method of testing
the the
hypotheseshypotheses
 Planned on testing & analyzing his Planned on testing & analyzing his
data data

23. July 30, 2017July 30, 2017
The purpose of pilot study isThe purpose of pilot study is
mainly two fold :mainly two fold :

To make improvements in the To make improvements in the
research project .research project .
 To detect problems that mustTo detect problems that must
be solved before the major be solved before the major
study is attempted .study is attempted .

24. July 30, 2017July 30, 2017
The purposes explained are …….The purposes explained are …….
 Determine if the proposed study is Determine if the proposed study is
feasible or not .feasible or not .
 Develop & refine the instrument .Develop & refine the instrument .
 Develop a protocol for the Develop a protocol for the
implementation of the treatment .implementation of the treatment .
 Identify problems with the design .Identify problems with the design .
 Determine if the sample is Determine if the sample is
representative of the population orrepresentative of the population or
whether sampling technique iswhether sampling technique is
effective .effective .

25. July 30, 2017July 30, 2017

Examine the reliability & validity of Examine the reliability & validity of
the research instrumentthe research instrument . .
 Reliability is concerned with Reliability is concerned with
consistency , accuracy , precision , consistency , accuracy , precision ,
stability , equivalence , homogenecity ;stability , equivalence , homogenecity ;
Validity is concerned with content , Validity is concerned with content ,
criterion & construct ; criterion & construct ;
 Refine the data collection & Refine the data collection &
analysis plananalysis plan

 Give the researcher experience Give the researcher experience
with subjects , setting , with subjects , setting ,
methodology & methods of methodology & methods of
measurement .measurement .

26. July 30, 2017July 30, 2017
Implement analysis techniques .Implement analysis techniques .
 Brings out the inadequacies in theBrings out the inadequacies in the
drafted questionnaire .drafted questionnaire .
 Tests interviewers stamina to work Tests interviewers stamina to work
under conditions of personal under conditions of personal
discomfort , stress & fatigue .discomfort , stress & fatigue .
 It helps in identifying the need for It helps in identifying the need for
different vehicles , kinds of different vehicles , kinds of
equipments which are needed equipments which are needed
during the project .during the project .

27. July 30, 2017July 30, 2017
It provides data for making It provides data for making
estimates of time & costs for estimates of time & costs for
completing various phases of the completing various phases of the
project . project . ((Whom to approachWhom to approach in the in the
town , village …)town , village …)
 What they should or should not What they should or should not
say .say .
 Disputes to be handled .Disputes to be handled .
 How interviewer should dress . How interviewer should dress .

28. July 30, 2017July 30, 2017
 What kind of behavior to avoid .What kind of behavior to avoid .
In short it is a preview of :In short it is a preview of :
 How will the interviewerHow will the interviewer
perform .perform .
 How the respondants will How the respondants will
behave .behave .
 Procedures in the work Procedures in the work
place place

29. July 30, 2017July 30, 2017
Advantages of pilot study :Advantages of pilot study :
 Saves tremendous amount ofSaves tremendous amount of
time & money .time & money .
 Helps clarify instructions .Helps clarify instructions .
 Determine appropriate levels of Determine appropriate levels of
independent variables .independent variables .
 Help make fewer mistakes in the Help make fewer mistakes in the
real study .real study .

30. July 30, 2017July 30, 2017
Some negative aspects of Some negative aspects of
pilot studypilot study : :
 Requires time to conduct .Requires time to conduct .
 Entails some expenditure of Entails some expenditure of
supplies .supplies .
 When animals are used When animals are used
answerable to the concerned answerable to the concerned
authorities .authorities .

31. July 30, 2017July 30, 2017
Pilot study size :Pilot study size :
 If sample size is 100 then 10 must If sample size is 100 then 10 must
be taken for pilot study (1/10be taken for pilot study (1/10
thth
) . ) .
 Time and cost may limit the pilot Time and cost may limit the pilot
study size .study size .
 Size is determined by the amount Size is determined by the amount
of time available .of time available .
 If the number of subjects or If the number of subjects or
objects is sufficient to test the objects is sufficient to test the
usefulness , then the size of the usefulness , then the size of the
pilot study is adequate .pilot study is adequate .

32. July 30, 2017July 30, 2017
Principles in the pilot study :Principles in the pilot study :
Principle of confidentiality Principle of confidentiality ::
Information discussed in the pilot Information discussed in the pilot
study or pretest must be kept study or pretest must be kept
confidential .confidential .


Principle of serendityPrinciple of serendity : : Pilot study Pilot study
results are always under the influence results are always under the influence
of serendity principle . of serendity principle .

33. July 30, 2017July 30, 2017
Not only does the pilot study Not only does the pilot study
revealsreveals
weaknesses & flawsweaknesses & flaws , ,
but it can also open up but it can also open up
unexpected and exciting new unexpected and exciting new
possibilities . possibilities .

34. July 30, 2017July 30, 2017
Why does pilot study fail to point upWhy does pilot study fail to point up
the flaws that are built into thethe flaws that are built into the
research design ?research design ?
1)1)It is an artificial situation It is an artificial situation
2)2)The sample size is not large The sample size is not large
enough .(Few people will not enough .(Few people will not
encounter variety of behavior that encounter variety of behavior that
are pertinent to the study )are pertinent to the study )
3)3) Larger numbers are needed to Larger numbers are needed to
make out flaws .make out flaws .

35. July 30, 2017July 30, 2017
Points to be kept in mind for Points to be kept in mind for
pilot studypilot study : :
It is important that all the steps in a It is important that all the steps in a
pilot study be carried through , pilot study be carried through ,
because it is only by completing the because it is only by completing the
full procedure that weaknesses can be full procedure that weaknesses can be
identified .identified .
 When examining the results of the When examining the results of the
pilot study researchers may discover pilot study researchers may discover
that major changes must be made .that major changes must be made .

36. July 30, 2017July 30, 2017
 They may notice that some subjects do They may notice that some subjects do
not meet the criteria foe the sample , not meet the criteria foe the sample ,
the subjects do not understand the the subjects do not understand the
items , a given question is not eliciting items , a given question is not eliciting
the desired information (or) is the desired information (or) is
irrelevant , important items have been irrelevant , important items have been
omitted , (or) there is a gap between omitted , (or) there is a gap between
some of the questions .some of the questions .
 Pilot study participants should not Pilot study participants should not
discuss the study with potential subjects discuss the study with potential subjects
because this may bias the results of the because this may bias the results of the
study .study .

37. July 30, 2017July 30, 2017
 Every detail of the major study should Every detail of the major study should
be undertaken in the pilot study from be undertaken in the pilot study from
administration of the instrument , administration of the instrument ,
tabulating the data , placing them in tabulating the data , placing them in
tables analyzing the data b, noting any tables analyzing the data b, noting any
trends in the findings .trends in the findings .
 The researcher could decide if the The researcher could decide if the
methodology meets the requirements for methodology meets the requirements for
testing the hypothesis .testing the hypothesis .
 Reformation of items may be Reformation of items may be
necessary, additional questions may be necessary, additional questions may be
requiredrequired

38. July 30, 2017July 30, 2017
 The purpose of developing the tables The purpose of developing the tables
prior to collecting the data for the major prior to collecting the data for the major
study is it gives the researcher an idea study is it gives the researcher an idea
of what the data will look like when of what the data will look like when
collected . collected .
 As part of the research strategy the As part of the research strategy the
investigator should have made a investigator should have made a
decision as to what type of statistics are decision as to what type of statistics are
to be used ; A research design without to be used ; A research design without
tables is not a true research design .tables is not a true research design .

39. July 30, 2017July 30, 2017
Manipulation checks :Manipulation checks :
Simply test whether (or) not Simply test whether (or) not
your independent variables had your independent variables had
the intended effects bon your the intended effects bon your
participants .participants .
A set of measures are ask the A set of measures are ask the
participants report their participants report their
perceptions of the entire perceptions of the entire
experiment .experiment .

40. July 30, 2017July 30, 2017
CONCLUSION CONCLUSION
In conclusion , it is important In conclusion , it is important
to carry out pretests , pilot to carry out pretests , pilot
studies and manipulation studies and manipulation
checks . They are important checks . They are important
steps in the entire research steps in the entire research
process for discovering process for discovering
problems and improving the problems and improving the
planned study .planned study .

41. July 30, 2017July 30, 2017
I HOPE I HAVE
GIVEN YOU A
GOOD
PICTURE
OF
PILOT
STUDY…..
…….

42. July 30, 2017July 30, 2017