New tool lets users repair AI-generated 3D models, then fabricate them just the way they want
AI Summary: InstructMesh combines Microsoft's TRELLIS system for generating 3D models from text and image prompts with the large language model GPT-4 to enable interactive 3D modeling. The system allows users to create and modify 3D models using natural language descriptions, and was shown to be effective even for novice users who were able to identify and fix design flaws around 90% of the time. InstructMesh scaffolds the modeling process, supporting intuitive design and modification, and has potential applications in areas such as augmented reality and physics simulations. The system's developers envision future integrations with physics simulations and refined 3D modeling capabilities.