天下3藏宝阁英雄榜

NetEase启动超大型模型推理引擎EET:超高速响应3秒以创建歌词

Recently, Fuxi, an AI research and application organization of Netease, launched a new generation of transformer inference engine, easy and efficient transformer (EET engine for short). The engine has the characteristics of scalability, high performance and easy to use. It can effectively improve the reasoning efficiency of transformed based super large model in the field of natural language processing and multimodality, make AI algorithm produce greater social value, and help China lead the world in the research and development of super large model ecology

At present, EET engine has been applied in Netease cloud music, Lofter, and other games, such as “against the cold water”, “Tianyu”, etc., which play an effective role in situational dialogue, semantic discrimination, story generation, AI lyrics, AI composition and other scenes

In recent years, there has been an upsurge in the research and development of transformed based super models at home and abroad. Google, openai, Huawei, Microsoft, NVIDIA and other AI giants have joined in and launched an “arms race” in many fields. However, the huge amount of parameters of super large model brings huge computing pressure. In the period of rapid development, super large model ecology is in urgent need of easy-to-use, efficient and extensible reasoning engine to boost the implementation of the project

The application of technology is the key research direction of Fuxi. It is reported that the EET engine launched this time is equivalent to building a bridge between the super large model and the application scenarios, applying the algorithm results of the super large model to the actual business, effectively reducing the response time, enhancing the user experience, improving the throughput, and alleviating the pressure of online deployment

In the application, EET engine mainly solves two problems: first, for the delay problem of AI online services, EET engine can respond to users in a shorter time and improve the user experience

For example, in the AI song writing product developed by Fuxi of Netease, users can quickly create a song with the help of AI technology by setting information parameters such as keywords, rhymes, word case and paragraph attributes. Because it involves the calculation of massive parameters, the creation of a song takes about 20 seconds. After the application of EET engine, the creation time of the same song is shortened to 3 ~ 4 seconds, and the user experience is greatly improved

Second, EET engine can reduce the hardware cost and improve the throughput of online model. In short, if 10 servers need to be deployed to complete a computing task, only 2 servers need to complete the same task after applying EET engine

注:小型号EET(单位=768,序列长度=769)

注:EET为中间型号(单位=1024,序列长度=1024)

网易伏羲成立于2017年,是国内专业从事游戏和泛娱乐产业人工智能研究和应用的顶尖机构。网易伏羲的研究方向包括强化学习、图像动画、自然语言、虚拟人、用户画像、大数据平台、云计算平台、云游戏等领域。在为网易众多产品提供高质量和前沿AI技术的同时,网易伏羲正在进一步把AI技术和产品开放给更多合作伙伴,全面释放创作者的生产力,革新用户体验。


天下3》2019年终资料片“鼎立山河”震撼上线!九黎新都——全新“九鼎城”正式落成,宝鼎之中,暗藏乾坤!天下群雄再度聚首,祭天大典疑云重重,大战一触即发!经典NPC模型迭代提升,颜值全面升级!人气副本、新手引导与游戏商城系统全面迭代,助力你的大荒新征程。

Leave A Reply

Your email address will not be published.