CS 6501 3D Computer Vision (Fall 2024)

University of Virginia

Schedule

This schedule is tentative and may be adjusted as the semester progresses.

Lecture	Date	Topic	Lecture Format	Background or Paper Reading
WEEK 1
1	Wed 08/28/2024	Introduction	Lecture (PPT, pdf)
WEEK 2
2	Mon 09/02/2024	A Brief History of Computer Vision	Lecture (PPT, pdf)	Background reading Chapter 1, Szeliski's book.
3	Wed 09/04/2024	3D Representations	Lecture (PPT, pdf)	Background reading Multiview CNN DeepSDF
WEEK 3
4	Mon 09/09/2024	Image Formation	Lecture (PPT, pdf)	Background reading Chapter 2, Szeliski's book.
5	Wed 09/11/2024	Multiview Geometry	Lecture (PPT, pdf)	Background reading Structure-from-Motion Revisited Chapter 11, Szeliski's book.
WEEK 4
6	Mon 09/16/2024	NeRF: Neural Radiance Fields	Lecture (PPT, pdf)	Background reading NeRF: Representing Scenes as Neural Radiance ... Volume Rendering Digest (for NeRF)
7	Wed 09/18/2024	Differentiable Primitive Rendering	Lecture (pdf)	Background reading 3D Gaussian Splatting for Real-Time ... Rendering Accelerating 3D Deep Learning with PyTorch3D
WEEK 5
8	Mon 09/23/2024	Correspondence, Correspondence, Correspondence!	Discussion (Introduction, superglue, loftr)	Paper reading SuperGlue LoFTR: Detector-Free ... Matching with Transformers
9	Wed 09/25/2024	Dense Pixel Tracking	Discussion (Introduction, OmniMotion, BootsTAP)	Paper reading Tracking Everything Everywhere All at Once BootsTAP: Bootstrapped Training for Tracking-Any-Point
WEEK 6
10	Mon 09/30/2024	Project Proposal Presentation	Presentation
10	Wed 10/02/2024	Project Proposal Presentation	Presentation
WEEK 7
11	Mon 10/07/2024	Single-view 2.5D Prediction	Discussion (Introduction, DSINE, Depth Anything)	Paper reading Rethinking Inductive Biases for Surface Normal Estimation Depth Anything Unleashing ... Unlabeled Data
12	Wed 10/09/2024	Learning-based 3D Reconstruction	Discussion (Introduction, What Do ... Learn?, DUSt3R)	Paper reading What Do Single-view 3D Reconstruction Networks Learn? DUSt3R: Geometric 3D Vision Made Easy
WEEK 8
14	Mon 10/14/2024	No lecture due to Fall Reading Days		Project Proposal Abstract due
13	Wed 10/16/2024	Datasets for 3D	Discussion (Introduction, CO3D, Objaverse)	Paper reading Common Objects in 3D Objaverse: A Universe of Annotated 3D Objects
WEEK 9
15	Mon 10/21/2024	3D Prediction without 3D Supervision	Discussion (Introduction, CMR, AutoRF)	Paper reading Learning Category-Specific ... from Image Collections AutoRF: Learning 3D ... from Single View Observations
16	Wed 10/23/2024	3D Recognition in Point Clouds	Discussion (Introduction, Point Transformer, VoteNet)	Paper reading Point Transformer Deep Hough Voting for 3D Object Detection in Point Clouds
WEEK 10
17	Mon 10/28/2024	3D Recognition from 2D Images	Discussion (Introduction, Mesh RCNN, Omni3D)	Paper reading Mesh R-CNN Omni3D: A Large Benchmark ... for 3D Object Detection
18	Wed 10/30/2024	3D Representation Learning	Discussion (Introduction, OpenShape, Croco)	Paper reading OpenShape: Scaling Up ... Open-World Understanding CroCo: Self-Supervised Pre-training for 3D Vision Tasks ...
WEEK 11
19	Mon 11/04/2024	Generative 3D Models	Discussion (Introduction, GET3D, MeshGPT)	Paper reading GET3D: A Generative Model of ... 3D ... from Images MeshGPT: Generating Triangle Meshes with ... Transformers
20	Wed 11/06/2024	Distilling 3D from 2D Models	Discussion (Introduction, DreamFusion, CAT3D)	Paper reading DreamFusion: Text-to-3D using 2D Diffusion CAT3D: Create Anything in 3D with ... Diffusion Models
WEEK 12
21	Mon 11/11/2024	Modeling 3D in Time	Discussion (Introduction, Shape of Motion, Reality_check)	Paper reading Shape of Motion: 4D Reconstruction from a Single Video Monocular Dynamic View Synthesis: A Reality Check
22	Wed 11/13/2024	3D Meets Robotics	Discussion (Introduction, F3RM, GS-SLAM)	Paper reading Distilled Feature Fields Enable ... Manipulation Gaussian Splatting SLAM
WEEK 13
23	Mon 11/18/2024	3D Meets Large Language Models	Discussion (Introduction, 3D-LLM, LEO)	Paper reading 3D-LLM: Injecting the 3D World into LLMs An Embodied Generalist Agent in 3D World
25	Wed 11/20/2024	Conclusion	Lecture (PPT, pdf)
WEEK 14
26	Mon 11/25/2024	No lecture due to Thanksgiving Recess
26	Wed 11/27/2024	No lecture due to Thanksgiving Recess
WEEK 15
27	Mon 12/02/2024	Final Project Presentations	Presentation (Introduction, p1, p2, p3, p4)
28	Wed 12/04/2024	Final Project Presentations	Presentation Presentation (p1, p2, p3, p4, p5)
FINAL WEEK
	Mon 12/16/2024			Project Final Report Due