The world's largest game development engine Unity has launched two generative AI products. Will game creation be completely subverted?

On June 27, Unity, the world's largest game development engine, real-time 3D interactive content creation and operation platform, announced the launch of two AI products: Unity Muse and Unity Sentis. Unity Muse is a broad platform for AI-driven assistance in the creative process; while Unity Sentis allows you to embed neural networks in game builds for previously unimaginable real-time experiences.

Image source: Generated by Unbounded AI

These two products are the latest advances Unity is currently making in the field of generative AI. Marc Whitten, president of the Unity Create department, published a special article last month to explain the profound impact that generative AI will have on Unity. They believe that the power of generative AI will make Unity creators much more productive, while ushering in a flood of new creators who will face lower barriers to building RT3D games and experiences. The current Cambrian explosion of generative AI will be an opportunity for Unity to grow further.

Unity Muse

Unity Muse is an AI platform that accelerates the creation of real-time 3D applications and experiences such as video games and digital twins. The ultimate goal of Muse is to enable you to create almost anything in the Unity editor using natural input such as text and sketches.

Unity also announced that it has started closed beta testing of Muse Chat, a Unity Muse platform product. Muse Chat is an important feature of the Muse platform. With Muse Chat, you can leverage AI-powered search across Unity documentation, training resources, and support content to get well-structured, accurate, and up-to-date information from Unity. Muse Chat helps you find relevant information, including working code samples, to speed development and troubleshoot issues.

More features are coming, including the ability to create textures and sprites and even fully animate characters, all using natural inputs.

Unity Sentis

Unity Sentis is also in private beta. Unity sees Sentis as a real game changer.

The biggest highlight: combining neural network technology with Unity.

On a technical level, it connects neural networks with the Unity runtime, unlocking enormous possibilities for Unity. In simple terms, Unity Sentis embeds AI models within the Unity runtime of a game or application to enhance gameplay and other features directly on the end-user platform.

Sentis allows AI models to run on any device running Unity.

As the world's largest game engine, more than half of the games on all platforms (PC, host and mobile devices) use Unity for creation, including mainstream games with hundreds of millions of users such as Glory of Kings and Yuan Shen. It is conceivable that the king will have more elements of AI-generated content in the future.

Unity said that Sentis is the first cross-platform solution that embeds AI models into real-time 3D engines. You only need to build it once and embed your model to make it run on multiple platforms, from mobile devices to PCs, From the web to gaming consoles like the Nintendo Switch and Sony PS. And because it runs on the user's local device, there are no complexities and delays associated with cloud hosting.

Investors are optimistic, AI Hub drives Unity stock price skyrocketing

In addition to the two AI products, Unity also announced the launch of AI Hub, an AI software market for developers, to provide a more convenient AI software trading platform for AI software developers and game developers. Users can find curated solutions for AI-driven development and gameplay.

Unity will allow AI software developers to directly supply game developers with development software through AI Hub, which are third-party software packages that meet Unity's highest standards of quality and compatibility. At the same time, Unity will charge intermediate fees.

You can find professional-quality AI solutions from providers such as Atlas, Convai, Inworld AI, Layer AI, Leonardo Ai, LMNT, Modl.ai, Polyhive, Replica Studios, and Zibra AI. These new solutions help support and accelerate your creative process with support for AI-powered smart NPCs, AI-generated VFX, textures, 2D and 3D models, generated speech, AI in-game testing, and more.

Investors are also very realistic. With two AI products and AI Hub, Unity embarked on the AI hot spot. The stock price closed up 15% yesterday.