Geoffrey Hinton: influences, peers and legacy

Every connection with its receipt

Geoffrey Hinton's intellectual lineage runs from Victorian science through cybernetics, Cambridge psychology, and the long neural-network winter he refused to leave. This mix traces the connectionist underground that sustained him — Rosenblatt's perceptron, Hebb's synapse, Boltzmann machines borrowed from statistical physics — alongside the Toronto lab that trained a generation. It ends with the students who turned his backpropagation into the technology now reshaping the world.

The Kynda mix for Geoffrey Hinton

• Key Influence · The Organization of Behavior: A Neuropsychological Theory by Donald O. Hebb (1949). Hebb's rule — neurons that fire together wire together — is the founding axiom of connectionism and the learning principle Hinton's entire career elaborates. Hebb worked at McGill, establishing the Canadian neuropsychology tradition Hinton later joined at Toronto. Hinton has repeatedly framed neural networks as the project of discovering how synaptic strengths change, the exact question Hebb posed, and his Boltzmann machine learning rule is explicitly Hebbian in form.
• Influencia Obscura · A Logical Calculus of the Ideas Immanent in Nervous Activity by Warren S. McCulloch and Walter Pitts (1943). The paper that first modelled a neuron as a threshold logic unit, written by a neurophysiologist and a homeless teenage logician who had taught himself Leibniz. It sits beneath every artificial neural network as the formal ancestor, yet is rarely read outside specialist circles. Its cybernetics-era ambition — that thought could be computed by networks of simple units — is the premise Hinton spent five decades vindicating against symbolic AI.
• Local Roots · Computing Machinery and Intelligence by Alan Turing (1950). Hinton grew up in postwar Britain and read experimental psychology at Cambridge before taking his AI doctorate at Edinburgh, inside the British computing culture Turing founded. Turing's own late interest in unorganised machines that learn by reinforcement prefigures connectionism, and Hinton's insistence that machines might genuinely think rather than merely simulate thinking is continuous with the argument Turing laid out in this paper's famous objections section.
• Beyond the Medium · On the Origin of Species by Charles Darwin (1859). Hinton's great-great-grandfather was George Boole, and his family tree includes the surveyor George Everest and the Darwin-adjacent Victorian scientific gentry; he has spoken about growing up under enormous expectation in that lineage. Beyond biography, the Darwinian argument that complex design emerges from blind iterative adjustment is structurally the argument Hinton makes for learning: no designer, just gradient descent over vast numbers of trials.
• Peer · Gradient-Based Learning Applied to Document Recognition by Yann LeCun (1998). LeCun did a postdoc with Hinton in Toronto in 1987-88 and shared the 2018 Turing Award with him and Bengio for deep learning. This paper introduced LeNet-5, the convolutional network that read bank cheques years before the field caught up. The two have diverged publicly since 2023 over existential AI risk, LeCun dismissing the danger Hinton left Google to warn about — a genuine intellectual rupture between old allies.
• From the Canon · ImageNet Classification with Deep Convolutional Neural Networks (AlexNet) by Geoffrey Hinton (2012). With students Alex Krizhevsky and Ilya Sutskever, Hinton entered a GPU-trained convolutional network in the ImageNet competition and cut the error rate so dramatically that the entire computer vision field converted within a year. The three sold their company DNNresearch to Google months later. If one document marks the moment deep learning stopped being a heresy and became the industry, this is it.
• Key Collaborator · Attention Is All You Need by Ilya Sutskever (2014). Sutskever was Hinton's doctoral student in Toronto, co-author of AlexNet, co-founder of DNNresearch, and later chief scientist of OpenAI. Hinton has called him unusually gifted at intuiting what would scale. Sutskever's sequence-to-sequence learning work with Oriol Vinyals and Quoc Le established the encoder-decoder framework behind machine translation and, downstream, the large language models whose capabilities later alarmed his supervisor.
• Legacy · Human-Level Control through Deep Reinforcement Learning by Demis Hassabis (2015). DeepMind's Atari and AlphaGo systems fused deep networks with reinforcement learning, and the company recruited heavily from Hinton's Toronto orbit; Hinton himself served as an advisor after Google's acquisition. Hassabis, trained as a cognitive neuroscientist, shares Hinton's conviction that studying the brain is the route to machine intelligence, and shared a Nobel year with him in 2024 for protein structure prediction.

What influenced Geoffrey Hinton

• Christopher Longuet-Higgins. Longuet-Higgins supervised Hinton's doctoral research. (also via Mental Processes: Studies in Cognitive Science) “he was awarded a PhD in artificial intelligence in 1978 for research supervised by Christopher Longuet-Higgins” (Wikipedia)
• An Investigation of the Laws of Thought by George Boole (1854). An Investigation of the Laws of Thought (George Boole) — culture for Geoffrey Hinton “Hinton is the great-great-grandson of the mathematician and educator Mary Everest Boole and her husband, the logician George Boole.” (en.wikipedia.org)
• A Logical Calculus of the Ideas Immanent in Nervous Activity by Warren S. McCulloch and Walter Pitts (1943). A Logical Calculus of the Ideas Immanent in Nervous Activity (Warren S. McCulloch and Walter Pitts) — ghost for Geoffrey Hinton (wikidata.org)
• The Society of Mind by Marvin Minsky (1986). The Society of Mind (Marvin Minsky) — culture for Geoffrey Hinton (openlibrary.org)
• On the Origin of Species by Charles Darwin (1859). On the Origin of Species (Charles Darwin) — culture for Geoffrey Hinton (openlibrary.org)
• Fei-Fei Li. ImageNet Classification with Deep Convolutional Neural Networks (AlexNet) (Alex Krizhevsky, Ilya Sutskever and Geoffrey Hinton) — legacy for Fei-Fei Li (via ImageNet Classification with Deep Convolutional Neural Networks (AlexNet)) “When the New York Times reporter Cade Metz asked Hinton to explain in simpler terms how the Boltzmann machine could "pretrain" backpropagation networks, Hinton quipped that Richard Feynman reportedly said: "Listen, buddy, if I could expl…” (en.wikipedia.org)
• Statistical Mechanics by Ludwig Boltzmann (1896). Statistical Mechanics (Ludwig Boltzmann) — ghost for Geoffrey Hinton
• Parallel Distributed Processing: Explorations in the Microstructure of Cognition by David E. Rumelhart (1986). Parallel Distributed Processing: Explorations in the Microstructure of Cognition (David E. Rumelhart) — titan for Geoffrey Hinton
• Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms by Frank Rosenblatt (1962). Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms (Frank Rosenblatt) — titan for Geoffrey Hinton
• The Organization of Behavior: A Neuropsychological Theory by Donald O. Hebb (1949). The Organization of Behavior: A Neuropsychological Theory (Donald O. Hebb) — titan for Geoffrey Hinton

Peers and kindred spirits

• Yoshua Bengio. Hinton co-authored a letter with Bengio. (also via A Neural Probabilistic Language Model) “Sincerely, Yoshua Bengio Professor of Computer Science at Université de Montréal & Turing Award winner Geoffrey Hinton Emeritus Professor of Computer Science at University of Toronto & Turing Award winner” (Biocomm AI)
• Yann LeCun. Hinton’s publication list records an article coauthored with LeCun and Bengio. (also via Gradient-Based Learning Applied to Document Recognition) “2021 Bengio, Y., Lecun, Y., & Hinton, G. Deep learning for AI Communications of the ACM, 64(7), 58-65.” (Geoffrey E. Hinton’s Publications)
• Ronald J. Williams. Hinton co-authored the 1986 paper with Williams. “Learning Representations by Back-Propagating Errors David E. Rumelhart , Geoffrey E. Hinton , Ronald J. Williams Notable Works 1986 pp. 533-536” (ML Anthology)
• Ruslan Salakhutdinov. Hinton’s publication list documents their jointly authored Science paper. “2006 Hinton, G. E. and Salakhutdinov, R. R Reducing the dimensionality of data with neural networks. Science, Vol. 313. no. 5786, pp. 504 - 507, 28 July 2006.” (Geoffrey E. Hinton’s Publications)
• Laurens van der Maaten. Hinton developed t-SNE with van der Maaten. “Visualizing Data using t-SNE Laurens van der Maaten, Geoffrey Hinton ; 9(86):2579−2605, 2008. Abstract We present a new technique called "t-SNE"” (Journal of Machine Learning Research)
• David Ackley. Hinton and Ackley co-invented Boltzmann machines. “Ackley, D. H., Hinton, G. E., and Sejnowski, T. J. (1985) A learning algorithm for Boltzmann machines. Cognitive Science , 9, 147--169.” (Geoffrey E. Hinton’s Publications)
• Terry Sejnowski. Hinton and Sejnowski co-invented Boltzmann machines. “Ackley, D. H., Hinton, G. E., and Sejnowski, T. J. (1985) A learning algorithm for Boltzmann machines. Cognitive Science , 9, 147--169.” (Geoffrey E. Hinton’s Publications)
• David Rumelhart. Hinton co-authored the 1986 paper with Rumelhart. “Learning Representations by Back-Propagating Errors David E. Rumelhart , Geoffrey E. Hinton , Ronald J. Williams Notable Works 1986 pp. 533-536” (ML Anthology)
• Stuart Russell. Hinton co-authored a letter with Russell. “Lawrence Lessig Professor of Law at Harvard Law School & founder of Creative Commons Stuart Russell Professor of Computer Science at UC Berkeley & Director of the Center for Human-Compatible AI” (Biocomm AI)
• Demis Hassabis. Metz places Hassabis and Hinton among the central figures in his account of modern AI. (also via Human-Level Control through Deep Reinforcement Learning) “All the big players are already there from the scientists, Demis, Geoff, and Geoff’s two students, to the companies.” (Marketing AI Institute)
• Sam Roweis. Hinton’s publication list records a paper coauthored with Roweis. “2007 Taylor, G. W., Hinton, G. E. and Roweis, S. Modeling human motion using binary latent variables.” (Geoffrey E. Hinton’s Publications)
• DNNresearch Inc.. Hinton co-founded DNNresearch. “He co-founded DNNresearch Inc. in 2012 with his two graduate students, Alex Krizhevsky and Ilya Sutskever” (Wikipedia)
• Lawrence Lessig. Hinton co-authored a letter with Lessig. “In August 2024, Hinton co-authored a letter with Yoshua Bengio , Stuart Russell , and Lawrence Lessig in support of SB 1047” (Wikipedia)
• Gradient-Based Learning Applied to Document Recognition by Yann LeCun (1998). Gradient-Based Learning Applied to Document Recognition (Yann LeCun) — peer for Geoffrey Hinton “Hinton received the 2018 Turing Award, together with Yoshua Bengio and Yann LeCun, for their work on deep learning.” (en.wikipedia.org)
• A Neural Probabilistic Language Model by Yoshua Bengio (2003). A Neural Probabilistic Language Model (Yoshua Bengio) — peer for Geoffrey Hinton “Hinton received the 2018 Turing Award, together with Yoshua Bengio and Yann LeCun, for their work on deep learning.” (en.wikipedia.org)
• Canadian Institute for Advanced Research. Hinton became a CIFAR fellow. “Geoffrey Hinton was appointed at the Canadian Institute for Advanced Research (CIFAR) in 1987 as a Fellow in CIFAR's first research program” (Wikipedia)
• Vector Institute. Hinton co-founded the Vector Institute. “In 2017, he co-founded and became the chief scientific advisor of the Vector Institute in Toronto.” (Wikipedia)
• University of Toronto. Hinton held a professorship at the University of Toronto. “He is University Professor Emeritus at the University of Toronto .” (Wikipedia)
• Parallel Distributed Processing. Hinton belonged to the named research group. “In the 1980s, Hinton was part of the "Parallel Distributed Processing" group at Carnegie Mellon University” (Wikipedia)
• Computing Machinery and Intelligence by Alan Turing (1950). Computing Machinery and Intelligence (Alan Turing) — geography for Geoffrey Hinton (wikidata.org)
• Attention Is All You Need by Ilya Sutskever (2014). Attention Is All You Need (Ilya Sutskever) — collaborator for Geoffrey Hinton “The image-recognition neural network AlexNet, designed in collaboration with his students Alex Krizhevsky and Ilya Sutskever, won the ImageNet challenge in 2012 and was a breakthrough in computer vision.” (en.wikipedia.org)
• Mental Processes: Studies in Cognitive Science by Christopher Longuet-Higgins (1987). Mental Processes: Studies in Cognitive Science (Christopher Longuet-Higgins) — geography for Geoffrey Hinton “From 1972 to 1975, he continued his study at the University of Edinburgh, where he was awarded a PhD in artificial intelligence in 1978 for research supervised by Christopher Longuet-Higgins, who favored the symbolic AI approach over the…” (en.wikipedia.org)
• Boltzmann Machines: Constraint Satisfaction Networks that Learn by Terrence J. Sejnowski (1983). Boltzmann Machines: Constraint Satisfaction Networks that Learn (Terrence J. Sejnowski) — peer for Geoffrey Hinton (wikidata.org)
• Learning Multiple Layers of Features from Tiny Images (CIFAR-10) by Alex Krizhevsky (2009). Learning Multiple Layers of Features from Tiny Images (CIFAR-10) (Alex Krizhevsky) — collaborator for Geoffrey Hinton “The image-recognition neural network AlexNet, designed in collaboration with his students Alex Krizhevsky and Ilya Sutskever, won the ImageNet challenge in 2012 and was a breakthrough in computer vision.” (en.wikipedia.org)
• John Hopfield. A Learning Algorithm for Boltzmann Machines (Geoffrey Hinton and Terrence Sejnowski) — peer for John Hopfield (via A Learning Algorithm for Boltzmann Machines) “He was also awarded, along with John Hopfield, the 2024 Nobel Prize in Physics for "foundational discoveries and inventions that enable machine learning with artificial neural networks".” (en.wikipedia.org)
• Machine Intelligence (series) by Donald Michie (1967). Machine Intelligence (series) (Donald Michie) — geography for Geoffrey Hinton
• Dropout: A Simple Way to Prevent Neural Networks from Overfitting by Nitish Srivastava (2014). Dropout: A Simple Way to Prevent Neural Networks from Overfitting (Nitish Srivastava) — collaborator for Geoffrey Hinton

Who Geoffrey Hinton influenced

• Alex Krizhevsky. Krizhevsky is explicitly identified as one of Hinton's graduate students. (also via Learning Multiple Layers of Features from Tiny Images (CIFAR-10)) “It was developed in 2012 by then University of Toronto graduate students Alex Krizhevsky and Ilya Sutskever and their faculty advisor Geoffrey Hinton.” (Computer History Museum)
• Ilya Sutskever. Sutskever is identified among Hinton's former students or postdoctoral researchers. (also via Attention Is All You Need) “Ruslan Salakhutdinov , [ 5 ] Ilya Sutskever , [ 6 ] Yann LeCun , [ 52 ] Alex Graves” (Wikipedia)
• Zoubin Ghahramani. Ghahramani is identified among Hinton's former students or postdoctoral researchers. “From 1995 to 1998, I was a Postdoctoral Fellow at the University of Toronto, working with Geoff Hinton.” (University of Cambridge Machine Learning Group)
• Radford M. Neal. Neal is identified among Hinton's former students or postdoctoral researchers. “Brendan Frey , [ 2 ] Radford M. Neal , [ 3 ] Yee Whye Teh , [ 4 ] Ruslan Salakhutdinov” (Wikipedia)
• Richard Zemel. Zemel is identified among Hinton's former students or postdoctoral researchers. “Notable former PhD students and postdoctoral researchers from his group include Peter Dayan , [ 51 ] Sam Roweis, [ 51 ] Max Welling , [ 51 ] Richard Zemel” (Wikipedia)
• Alex Graves (1965). Graves is identified among Hinton's former students or postdoctoral researchers. “Yann LeCun , [ 52 ] Alex Graves , [ 51 ] Zoubin Ghahramani , [ 51 ] and Peter Fitzhugh Brown” (Wikipedia)
• Yee Whye Teh. Teh is identified among Hinton's former students or postdoctoral researchers. “Radford M. Neal , [ 3 ] Yee Whye Teh , [ 4 ] Ruslan Salakhutdinov , [ 5 ] Ilya Sutskever” (Wikipedia)
• Brendan Frey. Frey is identified among Hinton's former students or postdoctoral researchers. “Richard Zemel , [ 38 ] [ 1 ] Brendan Frey , [ 2 ] Radford M. Neal , [ 3 ] Yee Whye Teh” (Wikipedia)
• Deep Learning by Ian Goodfellow (2016). Deep Learning (Ian Goodfellow) — legacy for Geoffrey Hinton (openlibrary.org)
• Human-Level Control through Deep Reinforcement Learning by Demis Hassabis (2015). Human-Level Control through Deep Reinforcement Learning (Demis Hassabis) — legacy for Geoffrey Hinton “In 2021, he received the Dickson Prize in Science from the Carnegie Mellon University and in 2022 the Princess of Asturias Award in the Scientific Research category, along with Yann LeCun, Yoshua Bengio, and Demis Hassabis.” (en.wikipedia.org)