Brains, Minds and Machines

Course Information

Watch BMM WebinarCourse Date: August 5 – August 26, 2021

Deadline: TBD

2019 Schedule (XLS)

Directors: Boris Katz, MIT; Gabriel Kreiman, Harvard Medical School; and Tomaso Poggio, MIT

Course Description

The basis of intelligence – how the brain produces intelligent behavior and how we may be able to replicate intelligence in machines – is arguably the greatest problem in science and technology. To solve it, we will need to understand how human intelligence emerges from computations in neural circuits, with rigor sufficient to reproduce similar intelligent behavior in machines. Success in this endeavor ultimately will enable us to understand ourselves better, to produce smarter machines, and perhaps even to make ourselves smarter. Today’s AI technologies, such as Watson and Siri, are impressive, but their domain specificity and reliance on vast numbers of labeled examples are obvious limitations; few view this as brain-like or human intelligence. The synergistic combination of cognitive science, neurobiology, engineering, mathematics, and computer science holds the promise to build much more robust and sophisticated algorithms implemented in intelligent machines. The goal of this course is to help produce a community of leaders that is equally knowledgeable in neuroscience, cognitive science, and computer science and will lead the development of true biologically inspired AI.

The class discussions will cover a range of topics, including:

  • Neuroscience: neurons and models
  • Computational vision
  • Biological vision
  • Machine learning
  • Bayesian inference
  • Planning and motor control
  • Memory
  • Social cognition
  • Inverse problems & well-posedness
  • Audition and speech processing
  • Natural language processing

These discussions will be complemented in the first week by MathCamps and NeuroCamps, to refresh the necessary background. Throughout the course, students will participate in workshops and tutorials to gain hands-on experience with these topics.

All students must attend the entire three weeks of the course, participate in all course lectures, participate in a research project, and present their research project at the conclusion of the course.

Core presentations will be given jointly by neuroscientists, cognitive scientists, and computer scientists. Lectures will be followed by afternoons of computational labs, with additional evening research seminars. To reinforce the theme of collaboration between (computer science + math) and (neuroscience + cognitive science), exercises and projects often will be performed in teams that combine students with both backgrounds.

The course will culminate with student presentations of their projects. These projects provide the opportunity for students to work closely with the resident faculty, to develop ideas that grow out of the lectures and seminars, and to connect these ideas with problems from the students’ own research at their home institutions.

This course aims to cross-educate computer engineers and neuroscientists; it is appropriate for graduate students, postdocs, and faculty in computer science or neuroscience. Students are expected to have a strong background in one discipline (such as neurobiology, physics, engineering, and mathematics). Our goal is to develop the science and the technology of intelligence and to help train a new generation of scientists that will leverage the progress in neuroscience, cognitive science, and computer science.

Financial Information: All costs (tuition/room and board) are generously provided by an NSF Science and Technology Center award to the Center for Brains, Minds, and Machines.

2019 Course Faculty

Antonio Torralba
Boris Katz
Christof Koch
Gabriel Kreiman
Haim Sompolinsky
James DiCarlo
Jeremy Wolfe
Josh McDermott
Josh Tenenbaum
Laura Schulz
Liz Spelke
Lorenzo Rosasco
Marge Livingstone
Matthew Wilson
Nancy Kanwisher
Nicholas Roy
Pawan Sinha
Robert Desimone
Sam Gershman
Stephanie Tellex
Thomas Serre
Tomaso Poggio
Winrich Freiwald