Google Research Blog
The latest news from Research at Google
Research at Google and ICLR 2017
Monday, April 24, 2017
Posted by Ian Goodfellow, Staff Research Scientist, Google Brain Team
This week, Toulon, France hosts the
5th International Conference on Learning Representations
(ICLR 2017), a conference focused on how one can learn meaningful and useful representations of data for
Machine Learning
. ICLR includes conference and workshop tracks, with invited talks along with oral and poster presentations of some of the latest research on deep learning, metric learning, kernel learning, compositional models, non-linear structured prediction, and issues regarding non-convex optimization.
At the forefront of innovation in cutting-edge technology in
Neural Networks
and
Deep Learning
, Google focuses on both theory and application, developing learning approaches to understand and generalize. As Platinum Sponsor of ICLR 2017, Google will have a strong presence with over 50 researchers attending (many from the
Google Brain team
and
Google Research Europe
), contributing to and learning from the broader academic research community by presenting papers and posters, in addition to participating on organizing committees and in workshops.
If you are attending ICLR 2017, we hope you'll stop by our booth and chat with our researchers about the projects and opportunities at Google that go into solving interesting problems for billions of people. You can also learn more about our research being presented at ICLR 2017 in the list below (Googlers highlighted in
blue
).
Area Chairs include:
George Dahl
,
Slav Petrov
,
Vikas Sindhwani
Program Chairs include:
Hugo Larochelle
,
Tara Sainath
Contributed Talks
Understanding Deep Learning Requires Rethinking Generalization
(Best Paper Award)
Chiyuan Zhang*,
Samy Bengio
,
Moritz Hardt
, Benjamin Recht*, Oriol Vinyals
Semi-Supervised Knowledge Transfer for Deep Learning from Private Training Data
(Best Paper Award)
Nicolas Papernot*,
Martín Abadi
,
Úlfar Erlingsson
,
Ian Goodfellow
,
Kunal
Talwar
Q-Prop: Sample-Efficient Policy Gradient with An Off-Policy Critic
Shixiang (Shane) Gu*, Timothy Lillicrap, Zoubin Ghahramani, Richard E.
Turner,
Sergey Levine
Neural Architecture Search with Reinforcement Learning
Barret Zoph
,
Quoc Le
Posters
Adversarial Machine Learning at Scale
Alexey Kurakin
,
Ian J. Goodfellow
†
,
Samy Bengio
Capacity and Trainability in Recurrent Neural Networks
Jasmine Collins
,
Jascha Sohl-Dickstein
,
David Sussillo
Improving Policy Gradient by Exploring Under-Appreciated Rewards
Ofir Nachum
,
Mohammad Norouzi
,
Dale Schuurmans
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Noam Shazeer
,
Azalia Mirhoseini
, Krzysztof Maziarz,
Andy Davis
,
Quoc Le
,
Geoffrey Hinton
,
Jeff Dean
Unrolled Generative Adversarial Networks
Luke Metz
, Ben Poole*, David Pfau,
Jascha Sohl-Dickstein
Categorical Reparameterization with Gumbel-Softmax
Eric Jang
, Shixiang (Shane) Gu*, Ben Poole*
Decomposing Motion and Content for Natural Video Sequence Prediction
Ruben Villegas, Jimei Yang, Seunghoon Hong, Xunyu Lin,
Honglak Lee
Density Estimation Using Real NVP
Laurent Dinh*,
Jascha Sohl-Dickstein
,
Samy Bengio
Latent Sequence Decompositions
William Chan*, Yu Zhang*,
Quoc Le
, Navdeep Jaitly*
Learning a Natural Language Interface with Neural Programmer
Arvind Neelakantan*,
Quoc V. Le
,
Martín Abadi
, Andrew McCallum*, Dario
Amodei*
Deep Information Propagation
Samuel Schoenholz
,
Justin Gilmer
, Surya Ganguli,
Jascha Sohl-Dickstein
Identity Matters in Deep Learning
Moritz Hardt
, Tengyu Ma
A Learned Representation For Artistic Style
Vincent Dumoulin*,
Jonathon Shlens
,
Manjunath Kudlur
Adversarial Training Methods for Semi-Supervised Text Classification
Takeru Miyato
,
Andrew M. Dai
,
Ian Goodfellow
†
HyperNetworks
David Ha
,
Andrew Dai
,
Quoc V. Le
Learning to Remember Rare Events
Lukasz Kaiser
,
Ofir Nachum,
Aurko Roy*
,
Samy Bengio
Deep Learning with Dynamic Computation Graphs
Moshe Looks
,
Marcello Herreshof
,
DeLesley Hutchins
,
Peter Norvig
HolStep: A Machine Learning Dataset for Higher-order Logic Theorem Proving
Cezary Kaliszyk,
François Chollet
,
Christian Szegedy
Workshop Track Abstracts
Particle Value Functions
Chris J. Maddison,
Dieterich Lawson
,
George Tucker
, Nicolas Heess, Arnaud Doucet, Andriy Mnih, Yee Whye Teh
Neural Combinatorial Optimization with Reinforcement Learning
Irwan Bello
,
Hieu Pham
,
Quoc V. Le
,
Mohammad Norouzi
,
Samy Bengio
Short and Deep: Sketching and Neural Networks
Amit Daniely
,
Nevena Lazic
,
Yoram Singer
,
Kunal Talwar
Explaining the Learning Dynamics of Direct Feedback Alignment
Justin Gilmer
,
Colin Raffel
,
Samuel S. Schoenholz
,
Maithra Raghu
,
Jascha Sohl-Dickstein
Training a Subsampling Mechanism in Expectation
Colin Raffel
,
Dieterich Lawson
Tuning Recurrent Neural Networks with Reinforcement Learning
Natasha Jaques
*
, Shixiang (Shane) Gu*, Richard E. Turner,
Douglas Eck
REBAR: Low-Variance, Unbiased Gradient Estimates for Discrete Latent Variable Models
George Tucker
, Andriy Mnih, Chris J. Maddison,
Jascha Sohl-Dickstein
Adversarial Examples in the Physical World
Alexey Kurakin
,
Ian Goodfellow
†
,
Samy Bengio
Regularizing Neural Networks by Penalizing Confident Output Distributions
Gabriel Pereyra
,
George Tucker
,
Jan Chorowski
,
Lukasz Kaiser
,
Geoffrey Hinton
Unsupervised Perceptual Rewards for Imitation Learning
Pierre Sermanet
,
Kelvin Xu
,
Sergey Levine
Changing Model Behavior at Test-time Using Reinforcement Learning
Augustus Odena
,
Dieterich Lawson
,
Christopher Olah
* Work performed while at Google
† Work performed while at OpenAI
Research at Google and ICLR 2016
Sunday, May 01, 2016
Posted by Dumitru Erhan, Gentleman Scientist
This week, San Juan, Puerto Rico hosts the
4th International Conference on Learning Representations
(ICLR 2016), a conference focused on how one can learn meaningful and useful representations of data for
Machine Learning
. ICLR includes conference and workshop tracks, with invited talks along with oral and poster presentations of some of the latest research on deep learning, metric learning, kernel learning, compositional models, non-linear structured prediction, and issues regarding non-convex optimization.
At the forefront of innovation in cutting-edge technology in
Neural Networks
and
Deep Learning
, Google focuses on both theory and application, developing learning approaches to understand and generalize. As Platinum Sponsor of ICLR 2016, Google will have a strong presence with over 40 researchers attending (many from the
Google Brain team
and
Google DeepMind
), contributing to and learning from the broader academic research community by presenting papers and posters, in addition to participating on organizing committees and in workshops.
If you are attending ICLR 2016, we hope you’ll stop by our booth and chat with our researchers about the projects and opportunities at Google that go into solving interesting problems for billions of people. You can also learn more about our research being presented at ICLR 2016 in the list below (Googlers highlighted in
blue
).
Organizing Committee
Program Chairs
Samy Bengio
, Brian Kingsbury
Area Chairs include:
John Platt
,
Tara Sanaith
Oral Sessions
Neural Programmer-Interpreters
(Best Paper Award Recipient)
Scott Reed,
Nando de Freitas
Net2Net: Accelerating Learning via Knowledge Transfer
Tianqi Chen,
Ian Goodfellow
,
Jon Shlens
Conference Track Posters
Prioritized Experience Replay
Tom Schau
,
John Quan
,
Ioannis Antonoglou
,
David Silver
Reasoning about Entailment with Neural Attention
Tim Rocktäschel,
Edward Grefenstette
,
Karl Moritz Hermann
,
Tomáš Kočiský
,
Phil Blunsom
Neural Programmer: Inducing Latent Programs With Gradient Descent
Arvind Neelakantan,
Quoc Le
,
Ilya Sutskever
MuProp: Unbiased Backpropagation For Stochastic Neural Networks
Shixiang Gu,
Sergey Levine
,
Ilya Sutskever
,
Andriy Mnih
Multi-Task Sequence to Sequence Learning
Minh-Thang Luong,
Quoc Le
,
Ilya Sutskever
,
Oriol Vinyals
,
Lukasz Kaiser
A Test of Relative Similarity for Model Selection in Generative Models
Eugene Belilovsky, Wacha Bounliphone, Matthew Blaschko,
Ioannis Antonoglou
, Arthur Gretton
Continuous control with deep reinforcement learning
Timothy Lillicrap
,
Jonathan Hunt
,
Alexander Pritzel
,
Nicolas Heess
,
Tom Erez
,
Yuval Tassa
,
David Silver
,
Daan Wierstra
Policy Distillation
Andrei Rusu
,
Sergio Gomez
,
Caglar Gulcehre,
Guillaume Desjardins
,
James Kirkpatrick
,
Razvan Pascanu
,
Volodymyr Mnih
,
Koray Kavukcuoglu
,
Raia Hadsell
Neural Random-Access Machines
Karol Kurach
,
Marcin Andrychowicz
,
Ilya Sutskever
Variable Rate Image Compression with Recurrent Neural Networks
George Toderici
,
Sean O'Malley
,
Damien Vincent
,
Sung Jin Hwang
,
Michele Covell
,
Shumeet Baluja
,
Rahul Sukthankar
,
David Minnen
Order Matters: Sequence to Sequence for Sets
Oriol Vinyals
,
Samy Bengio
,
Manjunath Kudlur
Grid Long Short-Term Memory
Nal Kalchbrenner
,
Alex Graves
,
Ivo Danihelka
Neural GPUs Learn Algorithms
Lukasz Kaiser
,
Ilya Sutskever
ACDC: A Structured Efficient Linear Layer
Marcin Moczulski,
Misha Denil
, Jeremy Appleyard,
Nando de Freitas
Workshop Track Posters
Revisiting Distributed Synchronous SGD
Jianmin Chen
,
Rajat Monga
,
Samy Bengio
,
Rafal Jozefowicz
Black Box Variational Inference for State Space Models
Evan Archer, Il Memming Park,
Lars Buesing
, John Cunningham, Liam Paninski
A Minimalistic Approach to Sum-Product Network Learning for Real Applications
Viktoriya Krakovna,
Moshe Looks
Efficient Inference in Occlusion-Aware Generative Models of Images
Jonathan Huang
,
Kevin Murphy
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Christian Szegedy
,
Sergey Ioffe
,
Vincent Vanhoucke
Deep Autoresolution Networks
Gabriel Pereyra
,
Christian Szegedy
Learning visual groups from co-occurrences in space and time
Phillip Isola, Daniel Zoran,
Dilip Krishnan
, Edward H. Adelson
Adding Gradient Noise Improves Learning For Very Deep Networks
Arvind Neelakantan, Luke Vilnis,
Quoc V. Le
,
Ilya Sutskever
,
Lukasz Kaiser
,
Karol Kurach
, James Martens
Adversarial Autoencoders
Alireza Makhzani,
Jonathon Shlens
,
Navdeep Jaitly
,
Ian Goodfellow
Generating Sentences from a Continuous Space
Samuel R. Bowman, Luke Vilnis,
Oriol Vinyals
,
Andrew M. Dai
,
Rafal Jozefowicz
,
Samy Bengio
Labels
accessibility
ACL
ACM
Acoustic Modeling
Adaptive Data Analysis
ads
adsense
adwords
Africa
AI
Algorithms
Android
Android Wear
API
App Engine
App Inventor
April Fools
Art
Audio
Australia
Automatic Speech Recognition
Awards
Cantonese
Chemistry
China
Chrome
Cloud Computing
Collaboration
Computational Imaging
Computational Photography
Computer Science
Computer Vision
conference
conferences
Conservation
correlate
Course Builder
crowd-sourcing
CVPR
Data Center
Data Discovery
data science
datasets
Deep Learning
DeepDream
DeepMind
distributed systems
Diversity
Earth Engine
economics
Education
Electronic Commerce and Algorithms
electronics
EMEA
EMNLP
Encryption
entities
Entity Salience
Environment
Europe
Exacycle
Expander
Faculty Institute
Faculty Summit
Flu Trends
Fusion Tables
gamification
Gmail
Google Books
Google Brain
Google Cloud Platform
Google Docs
Google Drive
Google Genomics
Google Maps
Google Photos
Google Play Apps
Google Science Fair
Google Sheets
Google Translate
Google Trips
Google Voice Search
Google+
Government
grants
Graph
Graph Mining
Hardware
HCI
Health
High Dynamic Range Imaging
ICLR
ICML
ICSE
Image Annotation
Image Classification
Image Processing
Inbox
Information Retrieval
internationalization
Internet of Things
Interspeech
IPython
Journalism
jsm
jsm2011
K-12
KDD
Klingon
Korean
Labs
Linear Optimization
localization
Low-Light Photography
Machine Hearing
Machine Intelligence
Machine Learning
Machine Perception
Machine Translation
Magenta
MapReduce
market algorithms
Market Research
Mixed Reality
ML
MOOC
Moore's Law
Multimodal Learning
NAACL
Natural Language Processing
Natural Language Understanding
Network Management
Networks
Neural Networks
Nexus
Ngram
NIPS
NLP
On-device Learning
open source
operating systems
Optical Character Recognition
optimization
osdi
osdi10
patents
ph.d. fellowship
PhD Fellowship
PhotoScan
PiLab
Pixel
Policy
Professional Development
Proposals
Public Data Explorer
publication
Publications
Quantum Computing
renewable energy
Research
Research Awards
resource optimization
Robotics
schema.org
Search
search ads
Security and Privacy
Semi-supervised Learning
SIGCOMM
SIGMOD
Site Reliability Engineering
Social Networks
Software
Speech
Speech Recognition
statistics
Structured Data
Style Transfer
Supervised Learning
Systems
TensorFlow
TPU
Translate
trends
TTS
TV
UI
University Relations
UNIX
User Experience
video
Video Analysis
Virtual Reality
Vision Research
Visiting Faculty
Visualization
VLDB
Voice Search
Wiki
wikipedia
WWW
YouTube
Archive
2017
May
Apr
Mar
Feb
Jan
2016
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2015
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2014
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2013
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2012
Dec
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2011
Dec
Nov
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2010
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2009
Dec
Nov
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2008
Dec
Nov
Oct
Sep
Jul
May
Apr
Mar
Feb
2007
Oct
Sep
Aug
Jul
Jun
Feb
2006
Dec
Nov
Sep
Aug
Jul
Jun
Apr
Mar
Feb
Feed
Google
on
Follow @googleresearch
Give us feedback in our
Product Forums
.