profile

Visually AI

Midjourney Character Consistency is here!

Published about 2 months ago • 4 min read

Hello Reader,

Welcome to Visually AI!


🔮 AI News This Week

Top Generative AI Tools

Andreesen Horowitz published “The Top 100 Gen AI Consumer Apps,” and it’s full of interesting findings.

Apps were analyzed based on monthly visits to determine how consumers used these tools.

The report compares the new rankings to the previous report from 6 months ago, and more than 40% of the brands are new to the updated list!

Read the full report here.

I will cover some of the apps on these lists over the next several weeks.

Top AI Web Apps

Andreesen Horowitz’s report divided the generative AI apps into web and mobile categories.

I’ll summarize three of the top five web apps below this image:

Here is a quick overview of some apps close to the top which I don't normally speak about:

Liner

Liner is an AI-powered productivity tool that utilizes GPT-4 to provide instant answers, summarize articles and documents, and assist with writing. (link)

Character.AI

Character.AI is an AI chatbot platform that allows users to converse with a wide variety of AI-powered characters, as well as create and train their own custom AI characters. (link)

QuillBot

QuillBot is an AI-powered writing tool that offers a suite of features to help improve writing quality and efficiency. (link)


Midjourney Character Consistency

But I know this is why you are here.

Let's get into it.

I am EXCITED!

With Midjourney's new Character Reference (--cref), you can transfer a character's attributes to new images quickly and easily.

Similar to Midjourney’s recently added Style Reference (--sref), --cref works by matching the character from the uploaded image to characters in your results.

It works on the new Midjourney website for users with >1k images or in Discord.

But how do you use Character Reference?

To use it, simply include --cref URL after your prompt. You can specify how much you want to match the URL character by using --cw (0 for face only to 100 for face, clothes & hair), or even combine features from multiple image URLs.

Here’s an example with the Yakuza character on the left, used with a prompt to place him reflecting in deep thought, on a mountain - notice that it doesn’t matter if the character is facing forward or wearing similar clothes:

RunwayML Lip Sync

Okay, let's spice it up even more.

Runway's Lip Sync feature lets you create generative videos where a selected face appears to be speaking the audio you provide.

To use Lip Sync, you'll need an audio clip with clear spoken words, as well as an image or video of a face you want to animate.

The face should be front-facing, framed from the shoulders up, and photorealistic in style for best results.

For video inputs, minimal mouth/camera/body movement and lighting changes work better.

How to make a Lip Sync video:

  1. Go to the Generative Audio > Text to Speech section on Runway
  2. Get your audio ready by uploading an existing file, recording a new clip, or generating text-to-speech audio
  3. Upload or select the image/video of the face you want to animate
  4. Click Generate

Runway generates a new video file with convincing lip-sync to your audio track. (link)

So, what can you do with these tools?

I used the Character Reference and Style Reference features of Midjourney in combination to create images that featured one of my photorealistic personal avatars set in dramatic movie scenes:

Then, I tested Runway’s Lip Sync feature with my cloned voice in a similar image, but it didn’t produce the effect I wanted.

I recorded my own voice saying a quick line I made up that seemed to fit the scenes above.

I used the built-in iOS voice note app on my iPhone, air-dropped it to my MacBook, and converted the recording from an M4a file to an MP3 with a free online tool called Restream.

Note: You can use several free tools for quick file conversions, especially an issue with iOS devices that automatically convert images, videos, and audio files to HEIC, MOV, and M4a.

Finally, I uploaded my recorded voice and a still image to Runway’s Generative Audio tool.

This is the result:

video preview

Lip Sync Use Cases

From content creators to SaaS brands and beyond, Lip Sync tools from Runway, Pika, SyncLabs, HeyGen, and D-ID, offer a wide range of potential use cases.

Here are 10 ideas, each tailor-made for a specific field:

This is what YOU can do:

For Content Creators:

  • Animate static character artwork or portraits.
  • Sync podcast guest interviews with visual avatars.
  • Add visual flair to audiobook recordings or voiceover projects.

For SaaS Brands:

  • Create engaging product demos and tutorials, or internal training videos.
  • Prototyping interactive AI assistants or chatbots with a realistic animated face.
  • Building more immersive user experiences for voice interfaces and audio apps.

For Developers:

  • Designing creative animated portraits that can speak custom messages or greetings.
  • Designing engaging motion graphics videos with synced speech elements.

For Graphic Designers:

  • Designing distinctive video ads with synced brand messages and product imagery.

AI continues to change the game and add new deliverables for you to apply to your own work.

This isn't limited to a particular field.

We're entering a new age of exciting times.


You could have your AI service, tool, or event seen by Visually AI’s community of over 9,100 subscribers:

Advertise with me


🚀 This Week’s AI Tools

Anthropic Prompt Library: Use Anthropic’s free prompt library full of optimized prompts for personal and business questions. (link)

KREA AI Patch Enhance: Use inpainting to quickly fix or enhance areas of your image. (link)

Magnific: Added a new Transfer Style feature to quickly transform images with multiple settings and variations (link)

LipSync: Free online lip sync tool from wav2lip++ generates convincing results. Upgrade to a paid subscription for watermark-free videos. (link)

Bith.AI: AI-powered content creation platform that generates articles, blog posts, product descriptions, and repurposes landscape videos to vertical shorts. (link)


🎁 Get it free: The AI Visual Creator’s Toolkit

Boost your content with my all-in-one, free visual AI toolkit!

Access AI-powered tools for AI-generated images, image editing, and more: Get your toolkit

📸 Free Gift: Realistic Photography Cheat Sheet

Prompt like a pro with easy-to-understand photography terms and example images to guide you as a reference for amazing photorealistic images.

Download your free guide: Photography Cheat Sheet


Thanks for reading, and have a creative week!

Visually AI

Heather Cooper

Your weekly dose of AI news, tools, and innovation with a visual twist. Breaking down barriers to make AI content creation accessible to all. Expressing my own personal takes and educating readers in the world of Artificial Intelligence.

Read more from Visually AI

Created in Midjourney AI Navigation - The Simple Strategy Total reading time around 5 minutes. Welcome to Visually AI! Good morning Reader! I’m overwhelmed. And I'm sure you are too. The number of AI products available is growing and growing and I can’t find the time to try many outside of what I already use. I imagine you feel the same way, so I thought a quick strategy guide overview might help you with your choice. Understanding Generative AI Tools Generative AI has introduced a surge of...

6 days ago • 5 min read

The next new shiny AI tool... Hello Reader, In the last year and a half, the landscape of Artificial Intelligence has changed dramatically. Every week brings a new gadget, app, or tool claiming to revolutionize how we live, work, and play. With so much to choose from, how do we decide what’s actually beneficial for us? Think Before You Leap Before you jump on the latest AI trend, take a moment to reflect on what you really need. An AI tool should not just be a shiny new toy; it should offer...

13 days ago • 5 min read

Hello Reader, Meta, (formerly Facebook), has been a big player in the evolution of artificial intelligence (AI) within the tech industry. And before we dive into their recent advances, let's take a quick look at how they've been a leading player in AI. Meta's journey into AI began as a quest to enhance user interactions and streamline content delivery across all of its platforms. It started in 2013 when Meta established its AI Research Lab (FAIR). One of the earliest applications of AI at...

20 days ago • 6 min read
Share this post