Assessing Evidentiary Value in Fire Debris Analysis

39 mins 55 secs, 152.63 MB, iPod Video 480x270, 29.97 fps, 44100 Hz, 522.05 kbits/sec

Share this media item:

Embed this media item:

<iframe width="_width_" height="_height_" src="https://sms.cam.ac.uk/media/2357514/embed" frameborder="0" scrolling="no" allowfullscreen></iframe>

Choose size:

About this item

Available Formats

About this item

Description:	Sigman, M (University of Central Florida) Thursday 10th November 2016 - 15:30 to 16:15


Created:	2016-11-11 16:28
Collection:	Probability and Statistics in Forensic Science
Publisher:	Isaac Newton Institute
Copyright:	Sigman, M
Language:	eng (English)


Abstract:	Co-author: Mary R. Williams (National Center for Forensic Science, University of Central Florida) This presentation will examine the calculation of a likelihood ratio to assess the evidentiary value of fire debris analysis results. Models based on support vector machine (SVM), linear and quadratic discriminant analysis (LDA and QDA) and k-nearest neighbors (kNN) methods were examined for binary classification of fire debris samples as positive or negative for ignitable liquid residue (ILR). Computational mixing of data from ignitable liquid and substrate pyrolysis databases was used to generate training and cross validation samples. A second validation was performed on fire debris data from large-scale research burns, for which the ground truth (positive or negative for ILR) was assigned by an analyst with access to the gas chromatography-mass spectrometry data for the ignitable liquid used in the burn. The probabilities of class membership were calculated using an uninformative prior and a likelihood ratio was calculated from the resulting class membership probabilities . The SVM method demonstrated a high discrimination, low error rate and good calibration for the cross-validation data; however, the performance decreased significantly for the fire debris validation data, as indicated by a significant decrease in the area under the receiver operating characteristic (ROC) curve. The QDA and kNN methods showed performance trends similar to those of SVM. The LDA method gave poorer discrimination, higher error rates and slightly poorer calibration for the cross validation data; however the performance did not deteriorate for the fire debris validation data.

Abstract:

Co-author: Mary R. Williams (National Center for Forensic Science, University of Central Florida)

This presentation will examine the calculation of a likelihood ratio to assess the evidentiary value of fire debris analysis results. Models based on support vector machine (SVM), linear and quadratic discriminant analysis (LDA and QDA) and k-nearest neighbors (kNN) methods were examined for binary classification of fire debris samples as positive or negative for ignitable liquid residue (ILR). Computational mixing of data from ignitable liquid and substrate pyrolysis databases was used to generate training and cross validation samples. A second validation was performed on fire debris data from large-scale research burns, for which the ground truth (positive or negative for ILR) was assigned by an analyst with access to the gas chromatography-mass spectrometry data for the ignitable liquid used in the burn. The probabilities of class membership were calculated using an uninformative prior and a likelihood ratio was calculated from the resulting class membership probabilities . The SVM method demonstrated a high discrimination, low error rate and good calibration for the cross-validation data; however, the performance decreased significantly for the fire debris validation data, as indicated by a significant decrease in the area under the receiver operating characteristic (ROC) curve. The QDA and kNN methods showed performance trends similar to those of SVM. The LDA method gave poorer discrimination, higher error rates and slightly poorer calibration for the cross validation data; however the performance did not deteriorate for the fire debris validation data.

Available Formats

Format	Quality	Bitrate	Size
MPEG-4 Video	640x360	1.94 Mbits/sec	581.18 MB	View	Download
WebM	640x360	590.83 kbits/sec	172.74 MB	View	Download
iPod Video *	480x270	522.05 kbits/sec	152.63 MB	View	Download
MP3	44100 Hz	249.77 kbits/sec	73.08 MB	Listen	Download
Auto	(Allows browser to choose a format it supports)