skip to main content

AI Bootcamp VII - Foundational Models

Tuesday, November 12, 2024
9:00am to 2:30pm
Add to Cal

Announcing the Seventh EAS AI Bootcamp - Foundational Models:

The seventh AI bootcamp, scheduled for Nov. 11 to Nov. 15 2024 at 100 Powell Booth. This one week course will help graduate students and researchers gain an understanding of foundational models, including: large language models (LLMs), generative models, retrieval augmented generation (RAGs), and reasoning using machine learning.

What to Expect:

  • Daily Structure: Each day will feature one to two lectures, complemented by two or more practical, hands-on sessions. We will also have short talks either by participants or other people describing their experience with foundational models
  • Topics Covered: large language models (LLMs), generative models, retrieval augmented generation (RAGs), and reasoning using machine learning. 

Objective: The goal is to equip participants with the knowledge to start applying these concepts in their research or to continue exploring them through regular classes or self-study.

Prerequisites:

To get the most out of this bootcamp, familiarity with the following topics is required:

  • Machine Learning Basics: Linear regression and classification, neural networks, ability to build and use models, and familiarity with frameworks like PyTorch or TensorFlow.
  • Linear Algebra: Vectors, matrices, vector spaces, matrix operations, eigenvalues and eigenvectors, norms and distance metrics, linear transformations, and basis. (Covered in courses like Ma1b, ACM104)
  • Multivariable Calculus: Partial derivatives, integration, limits, and continuity. (Covered in courses like Ma1ac)
  • Probability Theory: Random variables, statistical measures, probability distributions, and Bayesian inference. (Covered in courses such as Ma3, ACM116, ACM157, ACM158)
  • Python Programming: including NumPy, Pandas, and one of the main ML frameworks such as PyTorch.

How to Join the Bootcamp:

  • Availability: Limited to 20 participants.
  • Registration: Sign up using this link and complete the pre-screening Python Programming Quiz by 11:59 PM Pacific Time on November 7th. Please note that your enrollment will not be finalized until you have taken the quiz and received a confirmation email from the bootcamp organizers.
  • Optional (but highly recommended): Email us about yourself and your research, and let us know how you think this bootcamp can support your work.

Contact:

● Bootcamp director: Reza Sadri

● Administrative assistant: Caroline Murphy

● TAs: Sahithi Ankireddy, Surya Narayanan Hari, Panteleimon Vafeidis, Manal Sultan, Gary Yang, Thierno Diallo, Alejandro Stefan Zavala, Jay Siri

Deadline for Registration: November 7, 2024

Computing Resources: Hands-on sessions will primarily utilize Google Colab. Participants who need to use larger Colab instances for the hands on sessions will be reimbursed for  up to 20 dollars.

For more information, please contact Reza Sadri, Director by email at rsadri@caltech.edu or visit https://aibootcamp.caltech.edu.