Last week, Professor Han made an exciting announcement during 6.5940 (TinyML) lecture: the class was holding a competition, with AI development boards (worth $500+) as the top prizes! The competition involved watching hundreds of AI-generated videos and rating how realistic each looked. His lab was trying to create a benchmark for evaluating AI-generated videos, and outsourcing to MIT students was the best way to get the high-quality human-labeled data that OpenAI can only dream of.
The first-place prize was an NVIDIA Jetson Orin Nano, which Professor Han had demo-ed at the start of the semester running a ChatGPT-like application on a retro CRT-looking01 The same type of display you’d normally see on old-timey electronics like analog oscilloscopes display. It was so cute, and I really wanted to build one for myself, so I knew I had to compete.
The dataset consisted of a few thousand videos generated by a handful of AI video models from prompts like “The …