5 Flashcards

1
Q

reliability/precision

A

the consistency of test scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

the consistency of test scores

A

reliability/precision

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

test–retest coefficients

A

estimate the reliability/precision of test scores when the same people take the same test form on two separate occasions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

estimate the reliability/precision of test scores when the same people take the same test form on two separate occasions

A

test–retest coefficients

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

alternate-form coefficients

A

estimate the reliability/precision of test scores when the same people take a different but equivalent form of a test on two independent testing sessions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

estimate the reliability/precision of test scores when the same people take a different but equivalent form of a test on two independent testing sessions.

A

alternate-form coefficients

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

internal consistency coefficients

A

which estimate the reliability/precision of test scores by looking at the relationships between different parts of the same test given on a single occasion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

which estimate the reliability/precision of test scores by looking at the relationships between different parts of the same test given on a single occasion

A

internal consistency coefficients

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

scorer reliability

A

agreement when raters use their subjective judgment to assign scores to test taker responses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

agreement when raters use their subjective judgment to assign scores to test taker responses

A

scorer reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

measurement error

A

Variations in the measurements of the room—perhaps a fraction of an inch from time to time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Variations in the measurements of the room—perhaps a fraction of an inch from time to time

A

measurement error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

reliable test

A

one we can trust to measure each person in approximately the same way every time it is used

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

one we can trust to measure each person in approximately the same way every time it is used

A

reliable test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

just because it’s reliable doesn’t mean its _____

A

valid

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

true score (T)

A

a measure of the amount of the attribute that the test is designed to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

a measure of the amount of the attribute that the test is designed to measure

A

true score (T)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

random error (E)

A

the difference between a person’s actual score on a test and that person’s true score (T)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

the difference between a person’s actual score on a test and that person’s true score (T)

A

random error (E)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

error in measurement formula

A

X = T + E

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

systematic error

A

When a single source of error always increases or decreases the true score by the same amount

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

When a single source of error always increases or decreases the true score by the same amount

A

systematic error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

two problems that can add systematic error as well as random error to test scores

A

practice effects and order effects

24
Q

reliability coefficient

A

correlation between the two sets of test scores

25
Q

correlation between the two sets of test scores

A

reliability coefficient

26
Q

test–retest method

A

a test developer gives the same test to the same group of test takers on two different occasions

27
Q

a test developer gives the same test to the same group of test takers on two different occasions

A

test–retest method

28
Q

Practice effects

A

limitation in test-retest

when test takers benefit from taking the test the first time (practice), which enables them to solve problems more quickly and correctly the second time

29
Q

when test takers benefit from taking the test the first time (practice), which enables them to solve problems more quickly and correctly the second time

A

Practice effects

30
Q

alternate forms/parallel forms

A

create two different forms of the test

31
Q

create two different forms of the test

A

alternate forms/parallel forms

32
Q

order effects

A

changes in test scores resulting from the order in which the tests were taken

33
Q

changes in test scores resulting from the order in which the tests were taken

A

order effects

34
Q

Internal consistency

A

a measure of how related the items (or groups of items) on the test are to one another.

35
Q

a measure of how related the items (or groups of items) on the test are to one another.

A

Internal consistency

36
Q

split-half method

A

divide the test into halves and then compare the set of individual test scores on the first half with the set of individual test scores on the second half

37
Q

divide the test into halves and then compare the set of individual test scores on the first half with the set of individual test scores on the second half

A

split-half method

38
Q

homogeneous test

A

measuring only one trait or characteristic

39
Q

measuring only one trait or characteristic

A

homogeneous test

40
Q

heterogeneous test

A

measuring more than one trait or characteristic

41
Q

measuring more than one trait or characteristic

A

heterogeneous test

42
Q

Estimating reliability using methods of internal consistency is appropriate only for a _________

A

homogeneous test

43
Q

scorer reliability/interscorer agreement

A

the amount of consistency among scorers’ judgments

44
Q

the amount of consistency among scorers’ judgments

A

scorer reliability/interscorer agreement

45
Q

intrascorer reliability

A

whether each clinician was consistent in the way he or she assigned scores from test to test.

46
Q

whether each clinician was consistent in the way he or she assigned scores from test to test.

A

intrascorer reliability

47
Q

interrater agreement

A

an index of how consistently the scorers rate or make decisions.

48
Q

an index of how consistently the scorers rate or make decisions.

A

interrater agreement

49
Q

intrarater agreement

A

How well a scorer makes consistent judgments across all tests.

50
Q

How well a scorer makes consistent judgments across all tests.

A

intrarater agreement

51
Q

confidence interval

A

a range of scores that we feel confident will include the test taker’s true score

52
Q

a range of scores that we feel confident will include the test taker’s true score

A

confidence interval

53
Q

factors That Influence Reliability

A

1) poorly designed test
2) administrators don’t follow insturctions
3) test not scored accurately
4) test takers: fatigue, illness, exposure to test questions before hand

54
Q

what are the six factors related to sources of error

A

test length

homogeneity: similar questions on the test

test-retest interval: longer the interval, lower the reliability

test administration

scoring

cooperation of test takers

55
Q

generalizability theory

A

concerns how well and under what conditions we can generalize an estimation of reliabilty/precision of test scores from one test administration to another

56
Q

concerns how well and under what conditions we can generalize an estimation of reliabilty/precision of test scores from one test administration to another

A

generalizability theory