Association for Behavior Analysis International

The Association for Behavior Analysis International® (ABAI) is a nonprofit membership organization with the mission to contribute to the well-being of society by developing, enhancing, and supporting the growth and vitality of the science of behavior analysis through research, education, and practice.

Search

39th Annual Convention; Minneapolis, MN; 2013

Event Details


Previous Page

 

Symposium #163
CE Offered: BACB
Evaluating and Comparing the Accuracy and Efficiency of Different Measurement Systems
Sunday, May 26, 2013
10:30 AM–11:50 AM
200 C-E (Convention Center)
Area: PRA/AUT; Domain: Applied Research
Chair: Kevin C. Luczynski (University of Nebraska Medical Center, Munroe-Meyer Institute)
Discussant: Dorothea C. Lerman (University of Houston-Clear Lake)
CE Instructor: Kevin C. Luczynski, Ph.D.
Abstract:

A hallmark of behavior-analytic research and practice is the use of direct observation in measuring the behavior of interest, which leads to high level of accurate data collection. The papers in this symposium, collectively, represent a move toward evaluating more efficient measurement systems while maintaining high levels of accuracy. Sellers and Bourret examined the accuracy and efficiency of discontinuous and continuous measurement systems for discrete trial training during early intervention programming. Lesser et al. assessed the accuracy and reliability of a nighttime camera with motion-detection technology for conducting videosomnography in an analog sleep setting. Machado et al. conducted a discovery-oriented comparison on the accuracy and efficiency of using different fast-forward speeds in scoring problem behavior during parent-child interactions. We are fortunate to have Dr. Dorothea Lerman, the editor of the Journal of Applied Behavior Analysis, serve as the discussant for this set of papers, given her exceptional scholarship in the area of evaluating measurement systems.

Keyword(s): autism, discrete-trial training, measurement systems, sleep
 

Comparing the Accuracy and Efficiency of Using Fast-Forwarding Methods for Scoring Problem Behavior

MYCHAL MACHADO (University of Nebraska Medical Center), Kevin C. Luczynski (University of Nebraska Medical Center, Munroe-Meyer Institute), Stephanie Hood (University of Nebraska Medical Center)
Abstract:

The current set of studies sought to identify a fast-forward speed for scoring in-home problem behavior with sufficient accuracy and efficiency in comparison to scoring at normal speed. In Study 1, two groups of participants scored instances of programmed problem behavior from video records using several fast-forwarding speeds (3.5x, 4.0x, 4.5x, 5.0x) in ascending (n = 6) or descending (n = 6) order. Omission and commission errors and the total duration of scoring time were used to evaluate accuracy and efficiency, respectively. In Study 2, repeated measures were obtained for three groups of participants who scored instances of problem behavior from video records using either 3.5x (n = 5), 4.0x (n = 5) or 5.0x (n = 5) fast-forwarding speeds. Results from both studies suggested that scoring problem behavior 3.5x faster than normal speed consistently produced the fewest errors overall and produced similar efficiency scores across participants. These data suggest that fast forwarding could have marked implications for scoring measures of interest from large video records (e.g., 4 hr) if a speed is chosen at which observers maintain an acceptable level of accuracy and efficiency.

 

Evaluating the Accuracy, Interobserver Agreement, and Efficiency of a Motion-Detection Camera in the Measurement of Sleep Disturbances in Analog Arrangement

AARON D. LESSER (University of Nebraska Medical Center, Munroe-Meyer Institute), Kevin C. Luczynski (University of Nebraska Medical Center, Munroe-Meyer Institute), Stephanie Hood (University of Nebraska Medical Center)
Abstract:

Parent diaries and actigraphy are commonly used to measure sleep disturbances with young children at night, although both have been shown to introduce some measurement error (Sadeh, 2011). Recent advances in infrared-nighttime cameras with motion-detection technology may provide a practical means for obtaining direct measures of in-bed movements with little to no error. We evaluated the accuracy and reliability of a cameras motion-detection capabilities across two studies. In Study 1, we systematically moved standard-shaped objects at different distances in an attempt to quantify the proportion of the video feed required for motion to be detected. Next, we evaluated the effects of systematically introducing artificial light and additional objects on the accuracy of the camera. Depending on the size of the object, movements that changed 2% to 7% of the video feed were detected. In Study 2, we assessed the generality of the finding across human motor-movements varying in size (e.g., from mouth movements to a whole-body turn). Based on the results from Study 1, we were able to predict the type of movements that would be detected; in addition, by decreasing the size of the video feed, we able to reliability detect movements as small as the turning of a single hand. The results of these preliminary evaluations suggest that the motion-detection technology is a viable measurement system for detecting in-bed movements. In addition, although the results are germane to the specific camera model we assessed, the procedures provide a methodology for evaluating other camera models.

 

Effects of Data Sampling on Graphical Depictions of Learning

MARY KATHERINE SELLERS (Western New England University), Jason C. Bourret (New England Center for Children)
Abstract:

Previous literature has examined data sampling in the context of free operant responding. However, relatively few studies compared the effects of data sampling to continuous recording in discrete trial teaching. Thus, continuous and discontinuous data collection methods were compared in the context of discrete trial programming. Archival data sets were analyzed using trial sampling techniques (first five trials, first three trials, and first trial only) and session sampling techniques (every other session, every third session, and every fifth session). Results showed trial sampling to systematically underestimate the number of sessions and days to mastery and overestimate the number of sessions and days to the first independent response. Session sampling systematically overestimated sessions and days to mastery and sessions and days to the first independent response. A time-savings analysis was included to empirically test how much time would be saved by using the sampling methods. Results suggested that data sampling would produce relatively minimal time savings.

 

BACK TO THE TOP

 

Back to Top
ValidatorError
  
Modifed by Eddie Soh
DONATE
{"isActive":true,"interval":86400000,"timeout":20000,"url":"https://saba.abainternational.org/giving-day/","saba_donor_banner_html":"Help create a brighter future for behavior analysis by donating on Giving Day!","donate_now_text":"Donate Now"}