天下3藏宝阁英雄榜

NetEase启动超大型模型推理引擎EET:超高速响应3秒以创建歌词

凶兽现,山海劫!《天下》手游全新资料片“斗战山海”正式开启!——网易《天下》手游官方网站 凶兽现,山海劫!山海经玄幻国风旗舰手游《天下》全新资料片“斗战山海”正式开启! 《天下》手游全新资料片“斗战山海”惊喜上线!凶兽穷奇苏醒,传奇剧情开启,善恶难定,直面“真我”!全新颠覆式山海异兽团本,双线抉择,团队协作斗战凶兽穷奇!回合制异兽对战,策略多变,轻松逆风翻盘!全新等级、装备登场,助力登上强者之巅!更有全新穷奇外观,带你感受国韵山海!推出同屏大服务器功能,实现游戏内跨服社交、组队、交易功能,技术更流畅,性能更稳定!多重活动惊喜上线,专属福利等你来拿!

近日,网易旗下AI研究与应用机构网易伏羲推出新一代Transformer推理引擎Easy and Efficient Transformer(简称:EET引擎)。该引擎具有可扩展、性能高、易使用等特点,能够在自然语言处理和多模态领域,有效提升Transformed-based超大模型的推理效率,让AI算法产生更大的社会价值,助力中国在超大模型生态研发领域领先全球。

At present, EET engine has been applied in Netease cloud music, Lofter, and other games, such as “against the cold water”, “Tianyu”, etc., which play an effective role in situational dialogue, semantic discrimination, story generation, AI lyrics, AI composition and other scenes

In recent years, there has been an upsurge in the research and development of transformed based super models at home and abroad. Google, openai, Huawei, Microsoft, NVIDIA and other AI giants have joined in and launched an “arms race” in many fields. However, the huge amount of parameters of super large model brings huge computing pressure. In the period of rapid development, super large model ecology is in urgent need of easy-to-use, efficient and extensible reasoning engine to boost the implementation of the project

The application of technology is the key research direction of Fuxi. It is reported that the EET engine launched this time is equivalent to building a bridge between the super large model and the application scenarios, applying the algorithm results of the super large model to the actual business, effectively reducing the response time, enhancing the user experience, improving the throughput, and alleviating the pressure of online deployment

In the application, EET engine mainly solves two problems: first, for the delay problem of AI online services, EET engine can respond to users in a shorter time and improve the user experience

For example, in the AI song writing product developed by Fuxi of Netease, users can quickly create a song with the help of AI technology by setting information parameters such as keywords, rhymes, word case and paragraph attributes. Because it involves the calculation of massive parameters, the creation of a song takes about 20 seconds. After the application of EET engine, the creation time of the same song is shortened to 3 ~ 4 seconds, and the user experience is greatly improved

Second, EET engine can reduce the hardware cost and improve the throughput of online model. In short, if 10 servers need to be deployed to complete a computing task, only 2 servers need to complete the same task after applying EET engine

Compared with the similar reasoning engine, EET engine has excellent acceleration effect. In a group of experiments comparing with lightseq, the acceleration effect of EET engine is 0.819 to 1.64 times higher than that of lightseq in small scale; In the case of medium model, the acceleration effect of EET engine is 1.46 to 2.9 times higher than that of lightseq

注:小型号EET(单位=768,序列长度=769)

注:EET为中间型号(单位=1024,序列长度=1024)

目前,超大型模型的规模已发展到千亿级,正在向万亿级发展。网易福喜还将进一步优化EET引擎,未来将支持1000亿甚至上万亿的大型机型,为2017年成立的尖端技术的开发和应用提供动力,网易福喜是中国游戏和泛娱乐产业中专门从事人工智能研究和应用的顶尖机构。网易福喜的研究方向包括强化学习、图像动画、自然语言、虚拟人、用户肖像、大数据平台、云计算平台、云游戏等领域。网易福喜在为网易众多产品提供高质量、前沿人工智能技术的同时,进一步向更多合作伙伴开放人工智能技术和产品,充分释放创作者的生产力,创新用户体验

Leave A Reply

Your email address will not be published.