New AI agent learns to use CAD to create 3D objects from sketches
AI Summary: MIT engineers have developed an AI model designed to operate Computer-Aided Design (CAD) software in a manner similar to human users, addressing the software's steep learning curve. The team created a dataset called VideoCAD, comprising over 41,000 videos that demonstrate the step-by-step construction of 3D models from 2D sketches, capturing the specific user-interface interactions involved. This AI system aims to function as a "CAD co-pilot," assisting users by suggesting next steps and automating tedious tasks, thereby enhancing productivity and accessibility for those without extensive CAD training. The research will be presented at the upcoming Conference on Neural Information Processing Systems (NeurIPS).