Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

Study Skills and Research Methods > Reliability and Validity > Flashcards

Reliability and Validity Flashcards

1
Q

What is the scientific definition of Validity?

A

The soundness or appropriateness of a test or instrument in measuring what it is designed to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the scientific definition of Reliability?

A

The degree to which a test or measure produces the same scores if applied in the same circumstances

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the scientific definition of Objectivity

A

The degree to which different observers agree on measurements

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is internal validity?

A

Whether the experimenter is measuring the effect of the independent variable on the dependent variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is external validity?

A

Whether the results of a test can be generalised to the wider population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the types of validity?

A
  • Internal
  • External
  • Logical
  • Statistical
  • Construct
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the two kinds of Logical Validity?

A
  • Face

- Content

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is face validity?

A

It is clear that the test measures what it is supposed to

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is Content Validity?

A

Infers that the test measures all aspects contributing to the variable of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is a logically valid test?

A

One which appears to measure the right variable in its entirety

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the two types of statistical validity?

A
  • Concurrent Validity

- Predictive Validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is Concurrent Validity?

A

Infers that the test produces similar results to a previously validated test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is Predictive Validity?

A

Infers that the test provides a valid reflection of future performance using a similar test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is a statistically valid test?

A

One which produces results that agree with other similar tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what is Construct Validity?

A

The test is capable of measuring what should exist, whether it exists or not

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are general threats to Validity?

A

Maturation (change in DV over time irrespective of IV) and History (extraneous variables affecting DV)

17
Q

What are the threats to internal and external validity?

A
  • Pre-testing
  • Experimental Mortality
  • Statistical Regression
  • Instrumentation
  • Selection Bias
18
Q

What are the threats to external validity?

A
  • Inadequate description
  • Biased Sampling
  • Hawthorne Effect
  • Demand Characteristics
  • Operationalisation
19
Q

Why is pre-testing a threat to validity?

A

the interactive effects due to pre-testing such as learning and sensitisation may affect the results beyond that of the effect of the IV

20
Q

How does experimental mortality reduce external validity?

A

Less data means lower quality results which are less able to be generalised to the wider population

21
Q

How does experimental mortality reduce internal validity?

A

Subject dropout means less data, which means reduced statistical power and the quality of data is reduced

22
Q

How does statistical regression reduce internal validity?

A

An initial extreme score is likely to be followed by less extreme scores because extreme scores are likely to be outliers/based on chance (e.g. getting a bad test score, then getting a less bad test score next time because the first time was just a bad day)

23
Q

How does instrumentation threaten internal validity?

A

Difference in the way two comparable variables are measured due to uncalibrated equipment leads to invalid results

24
Q

How does biased sampling threaten external validity?

A

sample group doesnt represent larger population

25
Q

How do demand characteristics affect the validity of a test?

A

Participants will act differently if they are aware of the purpose of the test which will affect the results

26
Q

What can be done if a test is not valid but is reliable?

A

Use a correction for all results

27
Q

What are the types of Reliability?

A
  • Relative
  • Absolute
  • Rater Reliability
  • Intra-rater Reliability
  • Inter-rater Reliability
28
Q

What is Relative Reliability?

A
  • When individuals maintain their position or rank in group between tests
29
Q

What is absolute reliability?

A

when the scores for an individual are same every test

30
Q

What is Intra-rater reliability?

A

The consistency of a given observer or measurement tool on more than one occasion

31
Q

What is Inter-rater reliability?

A

The consistency of a given measurement from more than one observer or measurement tool

32
Q

What are the threats to reliability?

A
  • Fatigue
  • Habituation
  • Standardisation of Procedures
  • Precision of Measurements
33
Q

How is fatigue a threat to reliability?

A
  • If re-tests are too close together results can vary due to awake/tiredness of participants
34
Q

How is Habituation a threat to reliability?

A
  • Individuals can get better at the test every re-test
35
Q

What is a solution to fatigue to improve reliabillity?

A

Increase time between re-tests

36
Q

What is a solution to habituation to improve reliability?

A
  • Familiarise the participants fully before the first test

Study Skills and Research Methods (4 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions