Nemotron 3 Integrations

The Nemotron-3 Super is an innovative member of NVIDIA's Nemotron 3 series of open models, specifically crafted to facilitate sophisticated agentic AI systems that can effectively reason, plan, and carry out multi-step workflows in intricate environments. This model features a unique hybrid Mamba-Transformer Mixture-of-Experts architecture that merges the streamlined efficiency of Mamba layers with the contextual depth provided by transformer attention mechanisms, which allows it to adeptly manage extended sequences and intricate reasoning tasks with impressive accuracy and throughput. By activating only a portion of its parameters for each token, this architecture significantly enhances computational efficiency while preserving robust reasoning capabilities, making it ideal for scalable inference under heavy workloads. The Nemotron-3 Super comprises approximately 120 billion parameters, with around 12 billion being active during inference, which substantially boosts its ability to handle multi-step reasoning and collaborative interactions among agents within extensive contexts. Such advancements make it a powerful tool for tackling diverse challenges in AI applications.

The Nemotron 3 Nano stands out as the tiniest model within NVIDIA's Nemotron 3 lineup, specifically designed for agentic AI tasks that require robust reasoning and conversational skills while maintaining cost-effective inference. This hybrid Mamba-Transformer Mixture-of-Experts model boasts 3.2 billion active parameters, 3.6 billion when including embeddings, and a total of 31.6 billion parameters. NVIDIA asserts that this model offers greater accuracy compared to its predecessor, the Nemotron 2 Nano, all while utilizing less than half of the parameters during each forward pass, thus enhancing efficiency without compromising on performance. It is also claimed to surpass the accuracy of both GPT-OSS-20B and Qwen3-30B-A3B-Thinking-2507 across various widely-used benchmarks. With an 8K input and 16K output setting utilizing a single H200, the model achieves an inference throughput that is 3.3 times greater than that of Qwen3-30B-A3B and 2.2 times that of GPT-OSS-20B. Additionally, the Nemotron 3 Nano is capable of handling context lengths of up to 1 million tokens, further establishing its superiority over GPT-OSS-20B and Qwen3-30B-A3B-Instruct-2507. This remarkable combination of features positions it as a leading choice for advanced AI applications that demand both precision and efficiency.

Nemotron 3 Nano is a small yet powerful large language model from NVIDIA's Nemotron 3 series, specifically crafted for effective agentic reasoning, interactive dialogue, and programming assignments. Its innovative Mixture-of-Experts Mamba-Transformer framework selectively activates a limited set of parameters for each token, ensuring rapid inference times without sacrificing accuracy or reasoning capabilities. With roughly 31.6 billion parameters in total, including about 3.2 billion active ones (or 3.6 billion when factoring in embeddings), it surpasses the performance of the previous Nemotron 2 Nano model while requiring less computational effort for each forward pass. The model is equipped to manage long-context processing of up to one million tokens, which allows it to efficiently process extensive documents, complex workflows, and detailed reasoning sequences in a single cycle. Moreover, it is engineered for high-throughput, real-time performance, making it particularly adept at handling multi-turn dialogues, invoking tools, and executing agent-based workflows that involve intricate planning and reasoning tasks. This versatility positions Nemotron 3 Nano as a leading choice for applications requiring advanced cognitive capabilities.