Large-scale multiple testing: finding needles in a haystack

1 hour 7 mins 39 secs, 400.17 MB, Flash Video 480x360, 25.0 fps, 44100 Hz, 807.63 kbits/sec

Share this media item:

Embed this media item:

<iframe width="_width_" height="_height_" src="https://sms.cam.ac.uk/media/1130/embed" frameborder="0" scrolling="no" allowfullscreen></iframe>

Choose size:

About this item

Available Formats

About this item

Description:	Cai, T (Pennsylvania ) Monday 23 June 2008, 15:30-16:30 Future Directions in High-Dimensional Data Analysis

Created:

2008-07-02 08:17

Collection:

Statistical Theory and Methods for Complex, High-Dimensional Data

Publisher:

Isaac Newton Institute

Cai, T

Language:

eng (English)

Credits:

Producer:	Steve Greenham
Author:	Cai, T


Abstract:	Due to advances in technology, it has become increasingly common in scientific investigations to collect vast amount of data with complex structures. Examples include microarray studies, fMRI analysis, and astronomical surveys. The analysis of these data sets poses many statistical challenges not present in smaller scale studies. In these studies, it is often required to test thousands and even millions of hypotheses simultaneously. Conventional multiple testing procedures are based on thresholding the ordered p-values. In this talk, we consider large-scale multiple testing from a compound decision theoretical point of view by treating it as a constrained optimization problem. The solution to this optimization problem yields an oracle procedure. A data-driven procedure is then constructed to mimic the performance of the oracle and is shown to be asymptotically optimal. In particular, the results show that, although p-value is appropriate for testing a single hypothesis, it fails to serve as the fundamental building block in large-scale multiple testing. Time permitting, I will also discuss simultaneous testing of grouped hypotheses. This is joint work with Wenguang Sun (University of Pennsylvania). Related Links * http://www-stat.wharton.upenn.edu/~tcai/ - Download papers here.

Abstract:

Due to advances in technology, it has become increasingly common in scientific investigations to collect vast amount of data with complex structures. Examples include microarray studies, fMRI analysis, and astronomical surveys. The analysis of these data sets poses many statistical challenges not present in smaller scale studies. In these studies, it is often required to test thousands and even millions of hypotheses simultaneously. Conventional multiple testing procedures are based on thresholding the ordered p-values. In this talk, we consider large-scale multiple testing from a compound decision theoretical point of view by treating it as a constrained optimization problem. The solution to this optimization problem yields an oracle procedure. A data-driven procedure is then constructed to mimic the performance of the oracle and is shown to be asymptotically optimal. In particular, the results show that, although p-value is appropriate for testing a single hypothesis, it fails to serve as the fundamental building block in large-scale multiple testing. Time permitting, I will also discuss simultaneous testing of grouped hypotheses.

This is joint work with Wenguang Sun (University of Pennsylvania).

Related Links

* http://www-stat.wharton.upenn.edu/~tcai/ - Download papers here.

Available Formats

Format	Quality	Bitrate	Size
MPEG-4 Video	480x360	1.84 Mbits/sec	934.62 MB	View	Download
WebM	480x360	630.81 kbits/sec	309.55 MB	View	Download
Flash Video *	480x360	807.63 kbits/sec	400.17 MB	View	Download
iPod Video	480x360	505.31 kbits/sec	250.37 MB	View	Download
QuickTime	384x288	848.81 kbits/sec	420.57 MB	View	Download
MP3	44100 Hz	125.02 kbits/sec	61.73 MB	Listen	Download
Auto	(Allows browser to choose a format it supports)