Successfully developing the LLM model, Zalo joins the Au Lac AI Alliance

Wishing to accompany Vietnam in the goal of developing and mastering technology, Zalo joined the Au Lac AI Alliance with 20 organizations including state agencies, businesses and universities.

No longer a solo game, Vietnam has officially established an AI Alliance, joining hands to develop strategic technology for national digital sovereignty. The Au Lac AI Alliance has the participation of leading technology units and technology startups such as: MobiFone, VNPT, FPT, CMC , Zalo... along with many universities and academies.

Mr. Nguyen Minh Tu - Zalo Technology Director - and representatives of units at the launching ceremony of Au Lac AI Alliance.

The Au Lac AI Alliance will focus on three main areas: Research and Development, Building AI standards and policies, and Training. In the field of Research and Development, members will jointly develop large language models LLM with the ability to process Vietnamese accurately, naturally, and in accordance with Vietnamese culture and identity, contributing to improving people's knowledge and promoting the national economy .

Mr. Nguyen Minh Tu - Zalo Technology Director - spoke at the launching event of Au Lac AI Alliance.

Speaking at the alliance launch ceremony, Mr. Nguyen Minh Tu - Zalo Technology Director - affirmed his desire to contribute not only to the development of LLM but also to Vietnam's technological sovereignty .

“By joining the Au Lac AI Alliance, we hope to contribute to the development of large language models LLM in Vietnam. As a unit that has succeeded in building the LLM model, Zalo hopes to create quality AI products, serving Vietnamese people practically, as well as contributing to the country's scientific and technological development process.

Joining the alliance also affirms Zalo's determination to be self-sufficient in technology and master AI. We believe that Vietnamese people can master the LLM model in Vietnamese. At the same time, Zalo wishes to join hands to create an open and transparent AI community to stimulate creativity and apply AI widely." n

In Vietnam today, Zalo is one of the few units that have successfully developed large language models (LLM). Instead of choosing the fine-tuned model technique like many other businesses, Zalo develops LLM using the method of self-training the model from scratch (from-scratch model). This choice has many difficulties, requiring the creation from scratch - model architecture, parameter initialization, data processing and model training from the processed data set. The above decision is not to compete with foreign giants, but to realize the aspiration of Vietnamese people to master a purely Vietnamese LLM model, understand Vietnamese and serve Vietnamese people.

By the end of 2024, Zalo's LLM model will surpass big names such as GPT-4 (OpenAI), Gemma2-9B (Google) or Phi-3-small (Microsoft).

Despite many challenges in the process of developing LLM technology, thanks to a flexible strategy, Zalo has successfully shortened the development time of the LLM model from 18 months to 6 months. At the end of 2023, the first model KiLM 7B parameters was launched at the Zalo AI Summit event.

On the VMLU (Vietnamese Multitask Language Understanding Benchmark Suite for Large Language Models) evaluation platform, the KiLM 7B model achieved 1.5 times the capacity of OpenAI's ChatGPT-3.5 on the public VMLU test set. By the end of 2024, Zalo's 13B parameter model surpassed big names such as GPT-4 (OpenAI), Gemma2-9B (Google) or Phi-3-small (Microsoft), second only to Meta's LlaMA-70B model in terms of VMLU's Vietnamese processing capacity.

In the future, Zalo will continue to research and improve the LLM model, as well as promote the practical application of LLM in the lives of millions of Vietnamese users. Zalo's successful development of Vietnamese LLM is not only a breakthrough for a business, but also opens up a potential future for Vietnamese artificial intelligence. Joining the Au Lac AI Alliance clearly demonstrates Zalo's determination to develop AI in a safe, responsible direction, serving the interests of the community and national sovereignty.

The establishment of the Alliance not only opens a new chapter for the journey of AI development in Vietnam, but also promises a bright future, where technology practically serves the community, is linked to national interests and contributes to affirming Vietnam's independence and sovereignty on the global technology map.

Source: https://znews.vn/phat-trien-thanh-cong-mo-hinh-llm-zalo-tham-gia-lien-minh-ai-au-lac-post1563545.html