Flashcards in Lesson 4 Deck (19)
What is the third tactic in an observational study?
Reliability and social validity of the observation.
What is the most basic question about an observation study?
If you could repeat it.
How does one measure accuracy indirectly?
By two independent observers using the same behavioral deffinition.
What is the agreement of a behavioral Deffinition called?
The agreement between two independent observers
What are the two requirements for measuring reliability ?
1) The same behavioral deffinition
2) Both observers must observe the same response.
What two forms do reliability come in?
Trail Reliability and Frequency reliability
Compares each observation of the two observers
How does the term Trail Reliability come about?
Because we get every chance to observe the behavior
How do you compute trial reliability?
Agreements/Agreements+Disagreements x 100 (The sum of agreements plus disagreements equal totally number of trials.
Can you use trial reliability with outcome or event recording?
No, these methods lead to a total count, but they don't produce a trail-by-trail record. Can be used in complex outcome with a checklist.
Can you use trail reliability with time sample or interval recording?
Yes, by with a signal that both observers can here.
Why doesn't trial reliability work with outcome and event recording?
Because we have no way in telling if the subject did or didn't do the task/behavior. It could have been someone else.
The total count between two observers
What percentage do most researcher aim for reliability?
What percentage do most researchers aim to get when coming up with a new behavioral deffinition?
What do you do if you do not obtain your goal (percentage) for Reliability?
You must revise your observational system until you do.
The correlation between ratings by outside judges and observations by trained observers.`