Breaking news

Try the ‘img2img’ mode of ‘Stable Diffusion’ that automatically generates photos and illustrations with drawings and character strings – GIGAZINE


Create an image that looks like it was drawn by a human according to a keywordStable Diffusion” AI has been released to the public, and a large amount of all kinds of high-quality images are generated. In Stable Diffusion, in addition to “txt2img (text to image)” that generates images from character strings, there is img2img (Image to Image) that can generate new images not only from characters but also from images. Demo page where you can try this Stable Diffusion img2img for free “Diffuse The Rest” was published, so I actually tried it.

Diffuse The Rest – a Hugging Face Space by huggingface
https://huggingface.co/spaces/huggingface/diffuse-the-rest

Below isDiffuse The Rest page. In the center is a canvas for painting.


Click the black square on the far left to change the color, and click the round black to change the thickness. The following icons are buttons that allow you to switch to pen, switch to eraser, and erase all.

cbc94e789c.jpg


First, draw a suitable illustration on the canvas, enter the letters related to the picture at the bottom, and click “diffuse the f rest”. This time, I drew a picture of tofu and entered “tofu”. Waiting for about 2 minutes and 40 seconds for image creation ……

41501fe7f2.jpg


A picture like this was generated. At first glance, it’s clearly not tofu, but the white body has a brown color that looks like grilled marks, and there are things like tableware, so if you say “it’s tofu,” you’ll probably be convinced. .

26ef3c879c.jpg


Now draw a picture of an apple and enter “Apple”.

22c5d2e068.jpg


Then, for some reason Apple’s corporate logo was generated.

5470b28c99.jpg


Next, I tried to enter a sentence that combines words. Draw a picture like this: “a man with a gun, the sun is rising, standing on the desert, skull lying on the ground.” Skull lying on the ground), airplane (airplane), a vulture is flying (flying vulture)” …

b77271e5dd.jpg


A picture like a scene of a science fiction movie was generated like this. The sun, the desert, the man with the gun, and even the vulture are properly generated, but the plane and the skull seem to have disappeared somewhere.

cac30cb0fe.jpg


Multiple images are generated, and you can enjoy several different patterns.

6210f2921f.jpg


Now enter ‘Astronauts in Space, The lush green earth is about to be attacked by extraterrestrials’.

63aa12cda4.jpg


Then, he adjusted the illustration like this.

451138e369.jpg


Another generated image looks like this.

ca8ae627f7.jpg


It is possible to generate a new image from a photo, so I will try this as well. First, upload an image from local storage to the canvas by clicking and dragging.

7221927cb6.jpg


This time we used “Pino fragrant milk tea“Photo of. If you enter “chocolate ice cream” and “pino” as a bad source … …

7571a44adc.jpg


As expected, an image of Pino was not generated, but we succeeded in generating an image of chocolate ice cream with a similar color.

2e0a5ffc6e.jpg


In addition, Reddit has also posted that it succeeded in generating the following image. This person said “A man with golden armor, and mask, rises from the sands, a shiny golden magical staff in one hand, Artstation, Cinematic, Golden Hour, Sunlight, detailed, elegant, ornate, desert, rocky mountains, a big shiny white sun in the background, Illustration, by Weta Digital, sandstorm, Painting, Saturated, Sun rays”.

Copy the title and URL of this article


The article is in Japanese

Tags: img2img mode Stable Diffusion automatically generates photos illustrations drawings character strings GIGAZINE

NEXT “Seikado Art Museum” holding 7 national treasures, reopened in Marunouchi-Impress Watch