IEEE

LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agent

Abstract: 3D visual grounding is a critical skill for household robots, enabling them to navigate, manipulate objects, and answer questions based on their environment. While existing approaches often ...
IEEE

MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations

Abstract: Despite significant progress in Vision-Language Pre-training (VLP), current approaches predominantly emphasize feature extraction and cross-modal comprehension, with limited attention to ...
Forbes

BioRender Gives AI A Visual Language For Science

BioRender provides a rich set of tools for creating highly accurate images from biology. The tools provide a visual language to support AI in the biological domain. Notation and diagrams are essential ...
Microsoft

LLM2CLIP: Powerful Language Model Unlocks Richer Visual Representation

CLIP is one of the most important multimodal foundational models today. What powers CLIP’s capabilities? The rich supervision signals provided by natural language, the carrier of human knowledge, ...