Experimental Research
Design
Presented To
Dr. SumearaMahmood
Presented By
Muhammad Bilal Hafeez
M.Phil. Education
Semester 2
nd
Section-B
MY University Islamabad
Table Of Contents
•What is Experimental Research
•Characteristics ofExperimental Research
•Types of Experimental Research
•Comparison of Different Types of Experimental Researches
•Pros & Cons of Experimental Research Design
•Conclusion
What is Experimental Research?
Experimentalresearchdesignisascientificapproachtoresearch,where
oneormorevariablesaremanipulatedtodeterminetheeffectononeor
moreoutcomevariables.Thistypeofresearchisoftenusedtoestablish
cause-and-effectrelationships,anditreliesoncontrolledmethods,
randomassignment,andthemanipulationofvariablestotesta
hypothesis.Itisalsoknownas‘observationundercontrolledconditions’.
Example of Experimental Research
Exampleofexperimentalresearchineducationcouldinvolvestudyingthe
effectivenessofaspecificteachinginterventiononstudentacademic
performance.Forinstance,aresearchermightdesignanexperimentto
investigatetheimpactofincorporatingeducationaltechnology,suchasa
smartGadgets,onstudents'mathskills.Theresearchercouldrandomly
assigntwogroupsofstudentstoeithertheexperimentalgroup,wherethe
Calculatorisusedasasupplementarytoolduringmathclasses,orthe
controlgroup,wheretraditionalteachingmethodsareemployed.
Characteristics of Experimental Research
Experimentalresearchischaracterizedbyseveralkeyfeaturesthat
distinguishitfromotherresearchmethodologies.Herearesomeofthe
maincharacteristicsofexperimentalresearch:
ManipulationofVariables:Experimentalresearchinvolvesthedeliberate
manipulationofoneormorevariablesbytheresearcher.Thismanipulationis
intendedtoobservetheeffectononeormoreoutcomevariables.
ControlledEnvironment:Controlreferstouseofcontrolgroup&controllingthe
effectsofextraneousvariablesonthedependentvariableinwhichresearcheris
interested.
Characteristics of Experimental Research
RandomAssignment:Participantsinexperimentalresearchstudiesareoften
randomlyassignedtodifferentconditionsorgroups.Thisrandomassignmenthelps
toensurethateachparticipanthasanequalchanceofbeinginanyexperimental
conditionorcontrolgroup.
Causality:Experimentalresearchaimstoestablishcause-and-effectrelationships
betweenvariables.Bymanipulatingtheindependentvariableandobservingits
effectsonthedependentvariable,researcherscandrawconclusionsaboutthe
causalrelationshipbetweenthetwo.
MeasurementandObservation:Experimentalresearchinvolvesthe
systematiccollectionofquantitativeorqualitativedatathroughmeasurementsand
observations.Thisdatacollectionisessentialforevaluatingtheimpactofthe
manipulatedvariables.
Characteristics of Experimental Research
Replicability:Experimentalresearchisdesignedtobereplicable,allowingother
researcherstorepeatthestudyundersimilarconditionstodetermineiftheresults
areconsistentandreliable.
HypothesisTesting:Experimentalresearchisoftendrivenbyspecific
hypothesesthataretestedthroughthemanipulationofvariablesandthecollection
ofdata.
StatisticalAnalysis:Datacollectedinexperimentalresearchistypically
analyzedusingstatisticalmethodstodeterminethesignificanceoftheresultsand
thestrengthoftherelationshipsbetweenvariables.
Types of Experimental Research Design
Experimental Research
Pre-Experimental
Design
True Experimental
Design
Quasi-Experimental
Design
Quasi-experimental designs do not use random assignment. Quasi-
experimental research design involves the manipulation of
independent variable to observe to effect on dependent variable,
but it lacks randomization. It is often used when ethical or practical
considerations prevent random assignment.
This is the simplest forms of experimental research, which do
not include either a control group for comparison or
randomization. This lack of control makes it difficult to attribute
results solely to the manipulated variable(s).
True experimental research designs are those where
researchers have complete control over the extraneous
variables & can predict confidently that the observed effect on
the dependable variable is only due to the manipulation of the
independent variable. It includes complete Manipulation,
Randomizationand Control of variables.
Types of Pre-Experimental Research Design
Involves a single group exposed to an experimental
treatment and a single post-test. It lacks a control group or
pre-testing and is often used for pilot testing.
Exp
Grp
Treatment Post-Test
The same group is tested before and after the experimental
intervention. Without a comparison group, it's hard to determine if
changes are due to the intervention or other factors.
Exp
Grp
Treatment Post-Test
Involves two groups, one receives the treatment, and the other
does not, followed by a post-test. The lack of random assignment
and pre-testing can introduce potential confounds.
Exp Grp
Treatment Post-Test
Pre-Test
Cont. Grp Post-Test
A teacher implements a new reading comprehension strategy
in a classroom without any prior testing or comparison. The
teacher then assesses the students’ reading comprehension
skills to determine the effectiveness of the strategy.
Pre
-
Experimental Design
One-Shot Case
Study
One-Group Pretest-
Posttest Design
Static-Group
Comparison
Administrators at a school introduce a new anti-bullying
program and conduct pre and post surveys to assess
changes in students’ attitudes towards bullying.
Two different schools implement a new technology-based
learning platform, but only one school's students use it. Both
schools' students are assessed at the end of the semester to
compare their academic performance.
Types of True Experimental Research Design
True Experimental Research
Posttest-Only Control
Design
Pretest-Posttest only Design
Solomon Four-Group Design
Factorial Design
Randomized Block
Crossover
Types of True Experimental Research Design
Posttest-Only Control
Design
•Composed of two randomly assigned group, i.e. Experimental & control, but neither of
which is pretested before the implementation of treatment on the experimental group.
•This design can be helpful in situations where it is not possible to pretest the subjects.
Exp
Grp
Treatment Post-Test
Cont. Grp Post-Test
Random
Selection
Example : This design could be applied to assess the impact of a specific educational resource,
such as a learning app, on student performance. Students are randomly assigned to either use the
learning app or follow the traditional curriculum. After the intervention, both groups are assessed
using a posttest to measure the difference in learning outcomes between the two groups.
Types of True Experimental Research Design
Pretest-Posttest only Design
•In this research designs, subjects are randomly assigned to either the experimental or
the control group. Pretest on both the groups is carried out before the treatment.
Exp Grp Treatment Post-Test
Cont. Grp Post-Test
Random
Selection
Pre-Test
Pre-Test
For example, two similar groups of students are selected, with one group being taught
using the traditional method and the other group being taught using the new method. Each
group is given a pretest to assess their knowledge before the teaching intervention, and a
posttest after the intervention.
Types of True Experimental Research Design
Solomon Four-Group Design
•This design is an extension of the pretest-posttest control group design.
•There are two experimental groups (experimental group 1 & experimental group 2) & two
control groups (control group 1 & control group 2).
•Out of the four groups, only experimental group 1 & control group1 receives the pretest,
followed by the treatment to the experimental group 1 & experimental group 2
•The Solomon four-group design is believed to be most prestigious experimental research
design, because it minimizes the threat to internal & external validity.
Types of True Experimental Research Design
Solomon Four-Group Design Graphical Representation
Exp
Grp-1
Treatment Post-Test
Cont.
Grp-1
Post-Test
Random
Selection
Pre-Test
Pre-Test
Exp
Grp-2
Treatment Post-Test
Cont.
Grp-2
Post-Test
Types of True Experimental Research Design
Factorial Design
•Involves two or more independent variables and their joint effect on the dependent
variable is measured
•This design is useful when there are more than two independent variables, called factors
to be testedTypical factorial design incorporates 2X2 or 2X3 factorial, but it can be in
any combination.
For example, a study may investigate the impact of teaching method (lecture-based vs. Activity
Based) on student engagement and academic achievement.
Time to Engage
Students
Teaching Method
Lecture-
based(A)
Activity
Based(B)
1 hour (C) A.C B.C
2 hour(D) A.D B.D
Types of True Experimental Research Design
Randomized Block
•When there are a large number of experimental comparison groups, the randomized
block design is used to bring homogeneity among selected different groups
•Participants are 'blocked' into subgroups based on characteristics (e.g., age, gender)
before being randomly assigned to treatment conditions.
Types of True Experimental Research Design
Crossover
•A crossover experimental research design is a type of study in which participants receive
multiple treatments or interventions in a specific sequence, with each participant serving
as their own control.
•In crossover designs, treatments are crossed over after somewhile and then again being
tested.
For example, two similar groups of students are selected, with one group being taught
using the traditional method and the other group being taught using the new method. Each
group is given a pretest to assess their knowledge before the teaching intervention, and a
posttest after the intervention.
Exp
Grp-1
Treatment-1
Exp
Grp-2
Treatment-2 Treatment-1
Treatment-2
Types of Quasi-Experimental Research Design
It is also known as the ‘nonequivalent control group design’.
This design is identical to the pretest-posttest control group
design, except there is no random assignment of subjects in
experimental & control groups.
Exp
Grp
Treatment Post-Test
This design is useful when the researcher wants to measure
the effects of a treatment over a long period of time. Generally
it is a single-subject research, in which the researcher carries
out an experiment on an individual or on a small number of
individuals
O1 Treatment
Pre-Test
Cont. Grp Post-Test
Quasi
-
Experimental Design
Non Randomization
Groups Design
Time Series Design
Pre-Test
Exp Grp O2 O3 O1 O2 O3
Comparison of Different Types of Experimental research
Randomized Block
Criterion Pre-Experimental Design True Experimental Design Quasi-Experimental Design
Randomization No random assignment to groups Random assignment to groups No random assignment to groups
Groups Often lacks a control group
Includes both experimental and control
groups
Includes groups but without rando
m assignment
Internal Validity
Generally low due to lack of control over variable
s
High, as control over variables helps rul
e out alternative explanations
Moderate, but less than true experi
ments due to lack of randomization
Control of VariablesMinimal control; intervention may not be isolated
Maximum control with manipulation of i
ndependent variables
Some control, but not to the extent
of true experiments
Manipulation Intervention without the rigor of variable control
Deliberate manipulation of independent
variables
Manipulation of independent variab
les is attempted
Use of Control GroupNot typically used
Used to compare against the experimen
tal group
May or may not be used, and if use
d, not randomly assigned
Purpose Exploratory, often used to suggest hypotheses
Confirmatory, used to test causal hypot
heses
Investigative, often used to infer ca
usation when randomization is not
possible
Pros & Cons of Experimental Research Design
Advantages Disadvantages
Establishes Causality: Experimental research allows for th
e identification of direct cause-and-effect relationships betw
een variables, thus enabling the drawing of definitive conclu
sions.
Ethical Constraints: Some experimental manipulations may rais
e ethical concerns, particularly when human subjects are involved
. This can limit the scope of experiments and introduce biases.
Controlled Environment: The researcher can exert a high
degree of control over factors that could influence the result
s, thereby enhancing the reliability of the findings.
Ecological Validity Concerns: Findings from the controlled expe
rimental setting might not always be applicable to real-world situat
ions, limiting the generalizability of results.
Randomization: Through random assignment, the influenc
e of confounding variables can be minimized, resulting in cle
aner and more reliable data.
Resource-Intensive: True experimental research can be costly a
nd time-consuming, particularly in fields such as medicine or engi
neering where clinical trials and large-scale experimentation are c
ommon.
Replicability: Well-designed experiments can be replicated
with relative ease, allowing for validation of results and verifi
cation of the reported findings.
Limited Scope: In some cases, experimental research may focus
on narrow, specific variables, potentially providing an incomplete v
iew of a broader phenomenon.
Objective Measurement: Quantitative data collection and a
nalysis methods can be used, leading to objective and quan
tifiable results, thus reducing the impact of subjective bias.
Potential Bias: It's possible for the researcher's expectations or b
iases to influence the design and conduct of the study, affecting th
e results. Efforts to mitigate this are crucial.