At its developer conference on Thursday, Box showed off a new feature that will build Nvidia’s Nemotron embedding system into the core of its product. Called Box Content Retrieval, the new feature allows agents to answer queries far more effectively by relying on the embedded metadata created by Nemotron. Box says the upshot for users is faster, more accurate and less expensive queries.
Nvidia’s VP of generative AI software, Kari Briski, told TechCrunch that she expects queries to be answered four times faster, with 20% fewer errors and 90% fewer tokens used. The system will be available to all of Box’s Enterprise Advance customers, rolling out early next year. Major labs have often overlooked such models, which use LLMs to pre-process data so it can be better used by agents.
The sector has been a focus for Nvidia’s open-source model project, with its recent Nemotron release in July topping the RTEB benchmark, which measures retrieval quality. The system will be most useful when paired with active agents, Box says, giving the example of lawyers, who will ostensibly be able to find relevant clauses and precedents more easily under the new system. Because Nemotron’s embeddings go beyond simple keywords to map underlying concteps, a search tool can surface related legal concepts even when different language is used.
While the Nemotron models are freely available, the system also relies heavily on Box’s pre-existing metadata and permission controls, making it challenging to recreate from scratch.
Extract — continue reading at the source.
