Huawei PanGu

From Wikipedia the free encyclopedia

This article is about the language model. For the Chinese mythology, see Pangu.

Huawei PanGu
Developer(s)Huawei
Initial release3.0, July 7, 2023; 9 months ago (2023-07-07)
Stable release
3.0 / July 7, 2023; 9 months ago (2023-07-07)
Available inChinese, English, Russian
TypeLarge language model
LicenseProprietary

Huawei PanGu, PanGu, PanGu-Σ or PanGu-π is a multimodal large language model developed by Huawei. It was announced on July 7, 2023, positioned as a contender to other multimodal large language models.[1]

History[edit]

Development[edit]

In April 2023, Huawei released a paper, comes in the form of Pangu-Σ, a gargantuan language model developed by Huawei researchers, according the company, that the model is capable of producing 1.085 trillion parameters.[2]

The name of the large learning language model, "PanGu" is originated from the Chinese mythology and folklore of Pangu which Huawei named it after.[3]

The large learning language model of Pangu-Σ, features an architecture of 1.085 trillion parameters. Developed within its MindSpore 5 framework, Pangu-Σ reportedly underwent rigorous training for over 100 days on a built cluster system that is setup with 512 Ascend 910 AI accelerator chips,[4] reportedly consuming a staggering 329 billion tokens.[5]

Huawei announced and launched PanGu as PanGu 3.0, a large language model (LLM), during the Huawei Developer Conference (Cloud) 2023 event keynote on July 7, 2023. It's aimed for enterprises taking advantage of the AI industry compared to conventional large language models in the west, that is used for general usage with chatbots of using poems and generative AI technologies in creating visual products, generating fake images, videos etc. Huawei chief stated that "it doesn’t write poems, instead, it focuses on executing tasks." The new model focuses on value scenarios and is committed to being robust for enterprise sectors. Also, concluded that "there were many branches of AI technology before, because there was no general AI architecture to solve the problem, but at this stage, AI technology has developed from multiple branches to the era of large models."[6][7]

Launch[edit]

After PanGu 3.0 large language model (LLM) was launched, HDC 2023, July 7, 2023, with AI models launched for various areas in government, finance, manufacturing, mining, and meteorology taking advantage of Huawei Cloud solutions. The following month, Huawei hosted the Huawei Developer Conference and announced and launched, the new Celia Virtual Assistant powered by Huawei's Pangu Large Model. It brings new advanced AI and algorithm features for smart AI replies.[8] The latest version of the voice assistant via HarmonyOS 4.0 powered consumer devices in China are now capable of generating long text replies based on the voice command from the user.[9]

Updates[edit]

On August 5, 2023, Huawei partnered with ECMWF on the AI model to launch the global weather forecasting that takes advantage of Huawei Cloud solutions, with Pangu-Weather Model with MindSpore on top, that is available to access on the website of the European Centre for Medium-Range Weather Forecasts (ECMWF) that aims to provide accurate weather data.[10][11]

On December 19, 2023, Huawei Cloud announced it's financial services on its Pangu powered AI Finance platform in the global market. The tech giant introduced the product at its 2023 Huawei Cloud Fintech Summit as an aim to reshape the digital finance industries with efficient characteristics, to boost Fintech firms in the global market. It incorporates a variety of advanced features and technologies using AI, huge data analytics, and blockchain.[12]

On January 18, 2024, Huawei revealed the replaced base operating system, HarmonyOS NEXT of HarmonyOS alongside OpenHarmony and Oniro OS that includes the Pangu AI model, MindSpore AI Framework for Internet of things of smart devices, smart wearables, personal computing devices, mobile devices and auto industries with self driving technologies for various hardware types that take advantage of HiSilicon NPU-enabled chips.[13]

Technical specifications[edit]

Pangu Large Model 3.0 built for industry is structured with a 5+N+X three-tier structure. The first layer – L0 is Pangu's five basic large models to provide a variety of skills to meet industry scenarios, such as Natural language large models, Visual large models, Multimodal large models, Prediction large models and Scientific computing large models. The second layer – L1 is N large industry models. With this, it provides industry-wide large models that are trained using industry public data, including government affairs, finance, manufacturing, mining, weather, and more. It also uses industry customers’ own data on Pingu's L0 and L1, it trains its own proprietary large models for customers. And the last third layer, the L2 layer, gives customers more detailed scenario models. It's more focused on a specific application scenario or specific business and delivers customers with out-of-the-box model services.[14]

See also[edit]

References[edit]

  1. ^ "Reshaping Industries with AI: Huawei Cloud launches Pangu Models 3.0 and Ascend AI Cloud services". CITI Newsroom. CITI Newsroom. Retrieved February 13, 2024.
  2. ^ Upadhyay, Shyam Nandan. "Huawei Researchers Develop LLM With 1.085 Trillion Parameters". AnalyticsIndiaMag. AnalyticsIndiaMag. Retrieved February 13, 2024.
  3. ^ Mycroft, Connor. "Hong Kong should only use emergency warning system for 'tsunami or earthquakes', not rainstorms and typhoons: environment chief". SCMP. SCMP. Retrieved February 13, 2024.
  4. ^ "Huawei Researchers Unveil Pangu-Σ: Trillion-Parameter Language Model with Sparse Architecture". Multiplatform.ai. Multiplatform.ai. Retrieved February 13, 2024.
  5. ^ Tickoo, Aneesh. "Huawei Researchers Develop Pangu-Σ: A Large Language Model With Sparse Architecture And 1.085 Trillion Parameters". marktechpost.com. marktechpost.com. Retrieved February 13, 2024.
  6. ^ Jarrett, Miranda. "Huawei to revolutionise applications of AI with new Pangu model". Dao Insights. Dao Insights. Retrieved February 13, 2024.
  7. ^ "Revolutionizing Global AI Landscape: Huawei's PanGu Megamodel Set to Transform Industries Worldwide". LinkedIn. Grosso Link Sàrl. Retrieved February 13, 2024.
  8. ^ "Huawei Pangu AI models for Government, finance, manufacturing, mining, meteorology". HC Newsroom. HC Newsroom. Retrieved February 13, 2024.
  9. ^ Sarkar, Amy. "Huawei launches Voice Assistant with large Pangu AI model". HC Newsroom. HC Newsroom. Retrieved February 13, 2024.
  10. ^ Li, Deng. "Huawei Pangu-Weather Model debuts European ECMWF website". HC Newsroom. HC Newsroom. Retrieved February 13, 2024.
  11. ^ Mishra, Yash. "Huawei Cloud will build large-scale high-precision regional weather forecast Pangu model". HC Newsroom. HC Newsroom. Retrieved February 13, 2024.
  12. ^ Birch, Scott. "Huawei Cloud and Pangu AI model reshaping finance industry". FinTech Magazine. FinTech Magazine. Retrieved February 13, 2024.
  13. ^ CHUNG, JACKSON. "Huawei HarmonyOS NEXT 'Galaxy Edition' Previewed in New Video, Leaves Android Behind". TECHEBLOG. TECHEBLOG. Retrieved February 13, 2024.
  14. ^ "Huawei launches latest AI model, Pangu 3.0". Business Today (Malaysia). Business Today (Malaysia). Retrieved February 13, 2024.


Retrieved from "https://en.wikipedia.org/w/index.php?title=Huawei_PanGu&oldid=1212010879"