アニメと実写のミックス動画を4つの生成AIで作成する方法

2024年11月1日 18:24

　記事を書くきっかけになったのは僕がXで投稿したポストです。

ImageFX、Ideogram、Hailuo AI、Haiperの4つのAIを使って現実とアニメの世界を組み合わせてみました。画像、動画生成はガチャの要素が強いので何度か試す必要はありますが、無料で動画作成が簡単にできるのは生成AIの魅力です。 pic.twitter.com/2iSTlel3ev
— 田中勇道 (@yudotanaka) October 23, 2024

　この投稿で「作成法のレクチャーをお願いします」というリプを頂いたのですが、Xは無課金だと文字数制限があるのでとても書ききれず、せっかくの機会だし記事にしてみるか、ということで記事を書くに至りました。

　ポストに記載していますが使ったのはImageFX、Ideogram、Hailuo AI、Haiperの4つ。まずはImageFXとIdeogramでそれぞれi2v用の画像を生成します。プロンプトはFeloに作成してもらいました。

Image to video用の画像を用意

A teenage Japanese girl and an anime-style beautiful girl are having a conversation. Both are dressed casually. The Japanese girl has long black hair, wearing a light blue t-shirt and denim shorts, smiling and looking at the anime girl. The anime girl has vibrant pink hair styled in pigtails, wearing a cute graphic tee and a skirt. They are standing in a park with cherry blossom trees in the background, enjoying a sunny day.

　ImageFXは僕が動画を作成した10月23日時点ではアスペクト比が1:1しかありませんでしたが、現在は1:1も含めて5種類（3:4、4:3、9:16、16:9）から選べます。残りの2枚はIdeogramで生成しました。

"A realistic scene depicting a young man in casual clothing, smiling and engaging in conversation with an anime-style boy. The anime boy has vibrant, large eyes and spiky hair, dressed in a colorful outfit that reflects a playful personality. The setting is a lively urban park, filled with greenery and cherry blossom trees. The atmosphere is cheerful and inviting, with soft sunlight filtering through the leaves. The young man appears friendly and approachable, while the anime boy expresses excitement and joy, capturing the essence of their interaction in a vibrant, high-quality illustration."

"A high-quality image of a teenage Japanese boy having a conversation with an anime-style boy. The Japanese boy has short black hair and is wearing casual clothing, displaying a cheerful expression. The anime boy features bright, colorful hair and large, expressive eyes, dressed in a trendy outfit typical of anime characters. The background is a lively urban scene, filled with elements like cherry blossoms and traditional Japanese architecture. Focus on their facial expressions and upper bodies, ensuring that their hands are not visible, creating a warm and engaging atmosphere."

IdeogramはImageFXと比べて破綻が起きやすいので、少ない回数で済ませたい方はネガティブプロンプトを入れた方が良いかもしれません。

Hailuo AIとHaiperで動画化

　まずはImageFXで生成した画像を動かすためにHailuo AIを使いました。すべてHailuo AIでも良かったのですが、無料版だと1日3回の制限があるのと、動画生成は画像生成と同様に1回だけで思ったように生成されるとは限りません。なのでほかのAIを使ってクレジットを消費させないようにしました。ちなみにHailuo AIで使ったプロンプトは以下の通りです。

Here's a prompt for generating a high-quality video based on the image of a realistic girl and an anime girl together:

"Create a 6-second animated video featuring a charming interaction between a realistic human girl and an anime girl in a picturesque cherry blossom park.

The scene begins with the realistic girl, dressed casually in a light blue T-shirt, smiling as she stands under blooming cherry trees. Next to her, the anime girl with vibrant pink hair and twin ponytails, wearing a playful T-shirt with a character design, responds with a cheerful expression.

As they engage in lighthearted conversation, the camera zooms in slightly, capturing their expressions of joy and friendship. Soft petals fall gently around them, creating a serene atmosphere. The video concludes with both girls laughing, encapsulating the warmth of their friendship against the backdrop of springtime beauty."

　プロンプトはChatGPTに画像を読み込ませて英語で作成するように指示しています。再生時間は必要ないと思いますが一応念のため。Haiperで使ったプロンプトも画像の下に載せておきます。

"Create a 6-second animated video featuring a joyful interaction between a real-life man and a vibrant animated boy character. The scene is set in a beautiful park filled with blooming cherry blossoms, capturing the essence of spring. The real-life man, with a warm smile and casual attire, engages in a cheerful conversation with the animated boy, who is full of energy and enthusiasm. The boy is depicted with bright eyes and colorful hair, wearing a vibrant patterned shirt. As they chat, the animated boy expresses excitement with lively gestures, bouncing on his feet and playfully raising his arms. The man responds with laughter, leaning forward to engage with the animated character, creating a charming and heartwarming moment. The video concludes with both characters sharing a laugh, showcasing the delightful blend of reality and animation in a picturesque outdoor setting."

"Create a 6-second animated video depicting an engaging conversation between a cheerful real-life boy and an energetic animated boy character in a vibrant street filled with cherry blossoms. In the scene, the real-life boy, dressed casually with a backpack, smiles broadly as he interacts with the animated character, who has spiky, colorful hair and a lively expression. The animated boy is animatedly gesturing with excitement, showcasing his dynamic personality. As they converse, the animated character excitedly points to the surrounding cherry blossoms, expressing joy about the beautiful scenery. The real-life boy responds with laughter and nods, clearly enjoying the animated character's enthusiasm. The video concludes with both characters sharing a light-hearted moment, emphasizing the charming blend of the real and animated worlds set against a backdrop of blooming cherry blossoms."

　プロンプトが長くて辟易するかもしれませんが、気になる方は具体的な文字数を指定してください。最後にそれぞれ作成した3つの動画をFlexClipで繋げて1本にまとめました。