Rio de Janeiro's Nex-N2 large language model (LLM) is a hybrid created by merging two existing models, Nex-N2_pro and Qwen, with respective weights of 0.6 and 0.4. This blend aims to produce a locally optimized AI model, reflecting efforts to develop homegrown AI technology in the region, according to a GitHub issue discussion.
The Nex-N2 model combines 60% of Nex-N2_pro and 40% of Qwen, indicating a strategic integration of capabilities from both models. The GitHub repository for Nex-N2 details this approach, highlighting the collaborative and open-source nature of the project. This method allows leveraging strengths from both models to tailor an LLM suited for specific local applications in Rio de Janeiro.
This development is significant as it showcases a trend of regional AI initiatives adapting existing technologies to meet local needs. By merging established models, the Nex-N2 project bypasses the need to build an LLM from scratch, potentially accelerating deployment and adoption. Such efforts contribute to diversifying the AI landscape beyond dominant global players and fostering innovation within local ecosystems.
The Nex-N2 model's configuration was publicly documented in a GitHub issue titled 'Rio-3.5-Open-397B ≈ 0.6 x Nex-N2_pro + 0.4 x Qwen,' providing transparency on the model's composition and development process.