News / DEVELOPMENT

Microsoft's Pix 2 GIF and Tencent's Follow Your Click

Newest Introductions in the field of Generative AI

By Admin on March 17, 2024

Microsoft's Pix 2 GIF and Tencent's Follow Your Click image

Have you ever come across a tool or gadget that made you question its purpose? Well, Microsoft's latest invention, an AI called Pix 2 GIF, might just fall into that category. Claiming to transform still images into animated GIFs, this new AI tool utilizes what Microsoft calls a diffusion model. It aims to add a dash of motion to otherwise motionless photos, but does it live up to its claims? Let's find out.


Microsoft's Pix 2 GIF - A Revolutionary Step?

According to the creators at Microsoft's research team, Pix 2 GIF can animate images by following a text prompt provided by the user. For example, if you needed a picture of a train moving on the tracks, you could provide the text prompt, and the tool would generate a GIF of the train chugging along. However, it's important to note that we're talking about a two-second GIF here, so don't expect your train to travel very far. The concept behind Pix 2 GIF is to combine images, videos, and 3D models into something new and exciting. However, the reality might fall short of expectations. While this tool may seem like a revolutionary step, it's not. In fact, many of the latest AI models, including this one from Microsoft, are more experimental projects than ready-to-use products. They are often integrated into other platforms, such as co-pilot, rather than being standalone applications.


Testing Out Pix 2 GIF

If you're curious about trying out this groundbreaking tool, don't worry, there is a way. While Pix 2 GIF may not be a readily available product, you can download the code and set it up to run on your own laptop. For now, the best way to test it out is to use the provided test environment. You can give it an image and a text prompt, and in about a minute, you'll have a two-second GIF. However, if your computer is equipped with a powerful graphics processing unit (GPU), you might see a significant decrease in processing time.


Potential Applications of Pix 2 GIF

Besides creating jittery images, Pix 2 GIF has potential applications beyond simple animations. The creators envision the tool being used to edit GIFs in the future and even tweak digital art with a few clicks. The idea of bringing static scenes to life certainly sounds cool, but let's not forget that we already have video technology for that. While Pix 2 GIF may offer some novelty, it's unlikely to completely change the way we interact with images. The Microsoft research team trained Pix 2 GIF using a dataset of 100,000 GIFs, complete with captions. However, the source of these GIFs remains a mystery, adding an air of secrecy to the project. Unfortunately, the results might not always hit the mark, as with any experimental project. In the end, Pix 2 GIF stands as a testament to Microsoft's adventurous spirit in the AI landscape. It's an intriguing tool but may leave you wondering if it's more of a quirky toy than a truly useful instrument.


Tencent's Follow Your Click - A New Twist in AI Animation

Now, let's shift our focus to Tencent's recent innovation in the AI arena. Collaborating with prestigious institutions like the Hong Kong University of Science and Technology and Singua University, Tencent has developed a tool called Follow Your Click. This new tool offers a different approach to animating images and brings a fresh perspective to the field. Released on GitHub, Follow Your Click allows users to animate specific parts of a picture with just a click and a simple text prompt. Unlike previous tools that would animate the entire scene, this tool lets you focus on the exact bits you want to move. For example, if you want a bird to flap its wings, all you need to do is click and type "flap the wings," and you'll have a video of a rainbow bird doing exactly that.


The Advantages of Follow Your Click

What sets Follow Your Click apart from other tools is its user-friendly interface and precision. It offers simplicity and control rolled into one, allowing users to create animated sequences with ease. The collaboration between Tencent and renowned research institutions highlights the global nature of AI video generation. It's no longer solely dominated by Silicon Valley's brightest minds, as newcomers like Tencent and stalwarts like Alibaba have entered the field with their unique offerings. Tencent's Follow Your Click, along with its Videoc Crafter 2 toolkit, represents a broader shift towards more nuanced and user-controlled AI video generation. In contrast to Microsoft's Pix 2 GIF, which feels more like a proof of concept, Follow Your Click is a more polished and practical application. It goes beyond adding a dash of motion to images and aims to unlock a new realm of creativity and expression in video generation.


Conclusion

While Microsoft's Pix 2 GIF and Tencent's Follow Your Click both explore the possibilities of AI animation, they provide different experiences and target different user needs. While Pix 2 GIF may be seen as a quirky toy with limited practical applications, Follow Your Click offers a more refined and user-friendly approach to animating images. In the realm of technology, not all that glitters is gold. While the pursuit of innovation often leads us down uncharted paths, it's important to assess the practicality and usefulness of the tools we encounter.