Affiliation:
1. Florida International University, Miami, FL
2. University of Miami, Coral Gables, FL
3. Florida International University
Abstract
The field of machine learning is witnessing its golden era as deep learning slowly becomes the leader in this domain. Deep learning uses multiple layers to represent the abstractions of data to build computational models. Some key enabler deep learning algorithms such as generative adversarial networks, convolutional neural networks, and model transfers have completely changed our perception of information processing. However, there exists an aperture of understanding behind this tremendously fast-paced domain, because it was never previously represented from a multiscope perspective. The lack of core understanding renders these powerful methods as black-box machines that inhibit development at a fundamental level. Moreover, deep learning has repeatedly been perceived as a silver bullet to all stumbling blocks in machine learning, which is far from the truth. This article presents a comprehensive review of historical and recent state-of-the-art approaches in visual, audio, and text processing; social network analysis; and natural language processing, followed by the in-depth analysis on pivoting and groundbreaking advances in deep learning applications. It was also undertaken to review the issues faced in deep learning such as unsupervised learning, black-box models, and online learning and to illustrate how these challenges can be transformed into prolific future research avenues.
Publisher
Association for Computing Machinery (ACM)
Subject
General Computer Science,Theoretical Computer Science
Reference179 articles.
1. Convolutional Neural Networks for Speech Recognition
2. A DNN regression approach to speech enhancement by artificial bandwidth extension
3. Rami Al-Rfou Guillaume Alain Amjad Almahairi Christof Angermueller Dzmitry Bahdanau Nicolas Ballas Frédéric Bastien Justin Bayer Anatoly Belikov Alexander Belopolsky Yoshua Bengio Arnaud Bergeron James Bergstra Valentin Bisson Josh Bleecher Snyder Nicolas Bouchard Nicolas Boulanger-Lewandowski Xavier Bouthillier Alexandre de Brébisson Olivier Breuleux Pierre-Luc Carrier Kyunghyun Cho Jan Chorowski Paul Christiano Tim Cooijmans Marc-Alexandre Côté Myriam Côté Aaron Courville Yann N. Dauphin Olivier Delalleau Julien Demouth Guillaume Desjardins Sander Dieleman Laurent Dinh Mélanie Ducoffe Vincent Dumoulin Samira Ebrahimi Kahou Dumitru Erhan Ziye Fan Orhan Firat Mathieu Germain Xavier Glorot Ian Goodfellow Matt Graham Caglar Gulcehre Philippe Hamel Iban Harlouchet Jean-Philippe Heng Balázs Hidasi Sina Honari Arjun Jain Sébastien Jean Kai Jia Mikhail Korobov Vivek Kulkarni Alex Lamb Pascal Lamblin Eric Larsen César Laurent Sean Lee Simon Lefrancois Simon Lemieux Nicholas Léonard Zhouhan Lin Jesse A. Livezey Cory Lorenz Jeremiah Lowin Qianli Ma Pierre-Antoine Manzagol Olivier Mastropietro Robert T. McGibbon Roland Memisevic Bart van Merriënboer Vincent Michalski Mehdi Mirza Alberto Orlandi Christopher Pal Razvan Pascanu Mohammad Pezeshki Colin Raffel Daniel Renshaw Matthew Rocklin Adriana Romero Markus Roth Peter Sadowski John Salvatier François Savard Jan Schlüter John Schulman Gabriel Schwartz Iulian Vlad Serban Dmitriy Serdyuk Samira Shabanian Étienne Simon Sigurd Spieckermann S. Ramana Subramanyam Jakub Sygnowski Jérémie Tanguay Gijs van Tulder Joseph Turian Sebastian Urban Pascal Vincent Francesco Visin Harm de Vries David Warde-Farley Dustin J. Webb Matthew Willson Kelvin Xu Lijun Xue Li Yao Saizheng Zhang and Ying Zhang. 2016. Theano: A Python framework for fast computation of mathematical expressions. CoRR abs/1605.02688 (2016). Retrieved from http://arxiv.org/abs/1605.02688. Rami Al-Rfou Guillaume Alain Amjad Almahairi Christof Angermueller Dzmitry Bahdanau Nicolas Ballas Frédéric Bastien Justin Bayer Anatoly Belikov Alexander Belopolsky Yoshua Bengio Arnaud Bergeron James Bergstra Valentin Bisson Josh Bleecher Snyder Nicolas Bouchard Nicolas Boulanger-Lewandowski Xavier Bouthillier Alexandre de Brébisson Olivier Breuleux Pierre-Luc Carrier Kyunghyun Cho Jan Chorowski Paul Christiano Tim Cooijmans Marc-Alexandre Côté Myriam Côté Aaron Courville Yann N. Dauphin Olivier Delalleau Julien Demouth Guillaume Desjardins Sander Dieleman Laurent Dinh Mélanie Ducoffe Vincent Dumoulin Samira Ebrahimi Kahou Dumitru Erhan Ziye Fan Orhan Firat Mathieu Germain Xavier Glorot Ian Goodfellow Matt Graham Caglar Gulcehre Philippe Hamel Iban Harlouchet Jean-Philippe Heng Balázs Hidasi Sina Honari Arjun Jain Sébastien Jean Kai Jia Mikhail Korobov Vivek Kulkarni Alex Lamb Pascal Lamblin Eric Larsen César Laurent Sean Lee Simon Lefrancois Simon Lemieux Nicholas Léonard Zhouhan Lin Jesse A. Livezey Cory Lorenz Jeremiah Lowin Qianli Ma Pierre-Antoine Manzagol Olivier Mastropietro Robert T. McGibbon Roland Memisevic Bart van Merriënboer Vincent Michalski Mehdi Mirza Alberto Orlandi Christopher Pal Razvan Pascanu Mohammad Pezeshki Colin Raffel Daniel Renshaw Matthew Rocklin Adriana Romero Markus Roth Peter Sadowski John Salvatier François Savard Jan Schlüter John Schulman Gabriel Schwartz Iulian Vlad Serban Dmitriy Serdyuk Samira Shabanian Étienne Simon Sigurd Spieckermann S. Ramana Subramanyam Jakub Sygnowski Jérémie Tanguay Gijs van Tulder Joseph Turian Sebastian Urban Pascal Vincent Francesco Visin Harm de Vries David Warde-Farley Dustin J. Webb Matthew Willson Kelvin Xu Lijun Xue Li Yao Saizheng Zhang and Ying Zhang. 2016. Theano: A Python framework for fast computation of mathematical expressions. CoRR abs/1605.02688 (2016). Retrieved from http://arxiv.org/abs/1605.02688.
Cited by
1085 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献