Neural Controlled Differential Equations

22 mins 48 secs,  64.01 MB,  iPod Video  480x270,  25.0 fps,  44100 Hz,  383.33 kbits/sec
Share this media item:
Embed this media item:


About this item
Description: Kidger, P
Tuesday, March 16, 2021 - 13:35 to 14:00
 
Created: 2021-03-17 13:01
Collection: Unlocking Data Streams
Publisher: Isaac Newton Institute
Copyright: Kidger, P
Language: eng (English)
 
Abstract: Differential equations and neural networks are two of the most widespread modelling paradigms. I will talk about how to combine the best of both worlds through neural differential equations. Beginning with a brief overview of the broader field of neural differential equations (neural ODEs being the most famous example), I will then discuss recent work on neural controlled differential equations (neural CDEs) specifically. Intuitively these are "continuous time RNNs". These offer memory efficiency, the ability to handle irregular data, strong priors on model space, high capacity function approximation, and draw on a deep well of theory on both sides. They are state-of-the-art models for irregular time series, and if time allows I will briefly outline extensions for how they may be used to train neural SDEs.
Available Formats
Format Quality Bitrate Size
MPEG-4 Video 640x360    234.19 kbits/sec 39.11 MB View Download
WebM 640x360    194.16 kbits/sec 32.45 MB View Download
iPod Video * 480x270    383.33 kbits/sec 64.01 MB View Download
MP3 44100 Hz 249.88 kbits/sec 41.76 MB Listen Download
Auto (Allows browser to choose a format it supports)