Foxconn Announces Large Language Model (LLM) Refined from Metas Llama 3.1

Foxconn, the company best known for manufacturing iPhones and other Apple hardware products, has just surprised everyone by announcing its first large language model (LLM), called FoxBrain, which is intended to be used to improve manufacturing and supply chain management.

The Taiwanese manufacturer said that FoxBrain was trained with just 120 Nvidia H100 GPUs. This LLM is essentially built on Meta's Llama 3.1 architecture, with 70 billion parameters through a distillation process. The concept of LLM distillation involves taking a "parent" model and training a "child" model based on its feedback. Foxconn also admitted that its LLM is not as good as the refined model of China's DeepSeek, but the overall performance is very close to world-class standards.

Speaking about this achievement, Dr. Yung-Hui Li, Director of the Artificial Intelligence Research Center at Hon Hai Research Institute (Foxconn), said:

In recent months, the increasing inference capabilities and efficient use of GPUs have gradually become the main trends in the field of AI. Our FoxBrain model has adopted a very effective training strategy, focusing on optimizing the training process rather than blindly accumulating computing power.

Through carefully designed training methods and resource optimization, we have succeeded in building a local AI model with strong reasoning capabilities."

Foxconn Announces Large Language Model (LLM) Refined from Meta's Llama 3.1

Foxconn not only assembles Apple products, but also manufactures Nvidia’s AI servers. With 120 H100 GPUs, FoxBrain is scaled up with Nvidia’s Quantum-2 InfiniBand network, and the training process took only about 4 weeks (with a total computational cost of 2,688 GPU days). Foxconn generated 98 billion high-quality pre-training data tokens in traditional Chinese with a context window length of up to 128,000 tokens.

The partnership between Foxconn and Nvidia isn't new, and the two companies are also working on other projects, including building the world's largest Blackwell GPU manufacturing facility.

Nvidia also provided Foxconn with the Taipei-1 supercomputer to complete the model pre-training process. Foxconn said FoxBrain will become a “key engine” to upgrade the company’s three main platforms: Smart Manufacturing, Smart Electric Vehicles, and Smart Cities.

Leave a Comment

Solving Microsoft Teams Shortcut Error Not Opening

Solving Microsoft Teams Shortcut Error Not Opening

Tired of Microsoft Teams shortcut error preventing you from opening the app? Follow our expert, step-by-step guide with the latest fixes for instant resolution. Works on Windows, Mac & web – no tech skills needed!

Solving Microsoft Teams Task Management Sync Error

Solving Microsoft Teams Task Management Sync Error

Tired of Microsoft Teams Task Management Sync Error halting your workflow? Follow our proven, step-by-step fixes to resolve sync issues fast and restore seamless task collaboration. No tech expertise needed!

Troubleshooting Microsoft Teams Wiki Error Formatting

Troubleshooting Microsoft Teams Wiki Error Formatting

Struggling with Microsoft Teams Wiki Error Formatting? This step-by-step guide reveals proven fixes for common wiki tab issues, ensuring smooth editing and collaboration in Teams. Get back to productive wikis fast!

How to Fix Microsoft Teams Installation Error for Linux

How to Fix Microsoft Teams Installation Error for Linux

Struggling with Microsoft Teams installation error on Linux? Discover step-by-step fixes for Ubuntu, Fedora & more. Resolve dependency issues, crashes, and errors quickly with our ultimate guide. Get Teams running smoothly today!

Solving Microsoft Teams Error Page Not Loading

Solving Microsoft Teams Error Page Not Loading

Struggling with Microsoft Teams "Error Page" not loading? Get step-by-step fixes for desktop, web, and mobile. Solve Microsoft Teams Error Page issues quickly and resume seamless teamwork today.

Solving Microsoft Teams Error Screenshot Issues

Solving Microsoft Teams Error Screenshot Issues

Tired of Microsoft Teams "Error Screenshot" blocking your workflow? Get proven, step-by-step solutions to resolve screenshot errors in Teams instantly and boost productivity. No tech skills needed!

How to Fix Microsoft Teams Error U User

How to Fix Microsoft Teams Error U User

Tired of Microsoft Teams "Error U" User blocking your chats? Get proven, step-by-step fixes to clear cache, reset, and restore seamless collaboration instantly.

Where are Microsoft Teams Registry Keys Located on Windows 11?

Where are Microsoft Teams Registry Keys Located on Windows 11?

Unlock the precise locations of Microsoft Teams registry keys on Windows 11. Step-by-step guide to find, access, and safely tweak them for optimal performance and troubleshooting. Essential for IT pros and Teams enthusiasts.

How to Fix Microsoft Teams Training Error Video Lag

How to Fix Microsoft Teams Training Error Video Lag

Tired of Microsoft Teams "Training Error" Video Lag ruining your meetings? Follow our step-by-step guide with the latest fixes for smooth video calls—no more frustration!

How to Fix Microsoft Teams Error occurred During Sign-In

How to Fix Microsoft Teams Error occurred During Sign-In

Frustrated by Microsoft Teams "Error occurred" during sign-in? Discover proven, step-by-step fixes to get back online fast. Clear cache, reset app, and more for seamless login. Works on Windows, Mac & web.

Troubleshooting Microsoft Teams Call Error Disconnecting

Troubleshooting Microsoft Teams Call Error Disconnecting

Struggling with Microsoft Teams "Call Error" Disconnecting? Discover proven, step-by-step fixes for call drops, network issues, and more. Get back to seamless meetings fast with our expert troubleshooting guide.

How to Fix Microsoft Teams Error 2603: Login Loop Fix

How to Fix Microsoft Teams Error 2603: Login Loop Fix

Stuck in Microsoft Teams Error 2603 login loop? Get proven step-by-step fixes to resolve the issue fast and restore seamless teamwork. Clear cache, reset, reinstall – all covered!

How to Fix Microsoft Teams Voice Call Error

How to Fix Microsoft Teams Voice Call Error

Tired of Microsoft Teams voice call errors? Follow our step-by-step guide to troubleshoot no audio, echo, or call drops. Proven fixes for crystal-clear calls every time.

How to Fix Microsoft Teams Workflows Error Power Automate

How to Fix Microsoft Teams Workflows Error Power Automate

Struggling with Microsoft Teams "Workflows Error" in Power Automate? Discover proven, step-by-step fixes to resolve connection issues, permissions, and more. Get your workflows running smoothly today!

How to Fix Microsoft Teams Reddit Popular Error Fixes

How to Fix Microsoft Teams Reddit Popular Error Fixes

Tired of Microsoft Teams crashes, black screens, and sign-in loops? Unlock Reddit's most popular, proven fixes to resolve common Microsoft Teams errors quickly and get back to productive meetings. Step-by-step guides inside!