https://www.traffickinggame.com/ai-assisted-graphics/ LogoLogo TwitterTwitter Follow MeFollow Me TweetTweet FacebookFacebook fb-share-iconfb-share-icon LogoLogo * Home * Blog + Devblog Main + Crash course + AIadventure + Unrelated * Media * About * Discord * dAb * Devblog AI assisted graphicsAI assisted graphics January 4, 2023 AI assisted graphics Final in-game capture As a fun little prototype, I wanted to see how much work would it be to use AI to create as much of the art for a 2.5D point and click style game as possible. I figured the backgrounds would be a given, as the game would pretty much be 2D, but the characters were more complicated. I would need to have a lightning fast pipeline, a pipeline that allows me to use mocap data so creating animations would not be a bottle neck. I needed a way to translate AI generated art into form that can accept motion capture. The best way seemed to be to generate character concepts with AI and model them into 3D. I have been working in the games industry for 20+ years, modeling characters and backgrounds for a large part of it. So it would be interesting to see how AI would enable me to work faster. And by how much? I planned to use the characters in wide shots only, so the possible low quality or messed up details would not matter as much, but the AI tech has come a long way since and the coherency of the art is way better than it used to be mere months ago. Prompt building I started by ordering the AI (Midjourney in this proto, but I use stable diffusion more) to make me a model sheet with turnaround images of a character. Similar to one you would have at an animation studio. That would be a good starting point for a thing like this. [image-1024x683][svg]cyberpunk point and click adventure game character model sheet turnaround -v 4 -ar 3:2 The first result was very promising. Naturally it was not good for me as it was in black and white, but model sheets usually are. I try to not use any reference to any living (or dead) artists. But with AI it is impossible to not get influences from a bunch of artists. This way I just wish the waters are more muddled and there is no direct reference to anyone specific. [image-2-1024x683][svg]cyberpunk point and click adventure game character model sheet turnaround full color -v 4 -ar 3:2 The second try was not great either. But it was a step in the right direction. After some tweaking I had a prompt that produced art that was usable for me to use as a base for the 3D step: [image-13-1024x683][svg][image-12-1024x683][svg][image-11-1024x683] [svg][image-10-1024x683][svg][image-9-1024x683][svg] [image-8-1024x683][svg][image-7-1024x683][svg][image-6-1024x683][svg] [image-5-1024x683][svg][image-4-1024x683][svg][image-3-1024x683][svg] cyberpunk point and click adventure game character, full body, model sheet turnaround, full color, two thirds wiew, front::4 view and back view -v 4 -ar 3:2 The images had surprisingly good coherence for the different angles. These are very usable for modeling and texture projection. There is one major issue though: the images have perspective shift and are often from odd angles. But I had some ideas on how to overcome these issues. As these images are created by an AI, no one has a claim to their copyright. That is the "contract" you sign when working with AI at the moment. They can be freely used by anyone, as replication of these images is pretty trivial. At least this is how I feel about AI art. Modeling I chose an image the AI produced that had a good front and side view, but a challenging back view. Just to get to solve that problem and see how it affects things. is it even possible to extract textures for the final mode from this? [Character_01_Turnaround_front][svg][Character_01_Turnaround_side] [svg][Character_01_Turnaround_back-side][svg] I started by using the side and the front view to get a first draft of the character going in Modo. Once the character was done, it was pretty clear to see that the different texture projections did not match properly on the mesh. [modo_j66EXpnDAa-601x1024][svg][modo_3S2POnZDn7-600x1024][svg] To fix this, I created morph maps for each projection, making sure the front, side and back thirds view matched on the mesh as well as possible. [modo_2WEmonbbak-506x1024][svg]Front projection [modo_8GajTecf4Y-461x1024][svg]Side projection [modo_Y8s2gLytW9-618x1024][svg]Back thirds projection Next I needed to do an old school UV unwrap on the mesh. It is time consuming and tedious, but had to be done properly so blending the textures together in photoshop would be easier to do. After the UV was done it was time to project all the different images on the UV using their respective morph maps. [Character_01_front-1024x1024][svg]Front projection [Character_01_side-1024x1024][svg]Side projection [Character_01_back-side-1024x1024][svg]Back thirds projection [Character_01_UVcomposite-1024x1024][svg]Final combined textures with some overpaint The finished model The model is now finished and ready for rigging, for this I used Mixamo. In the past I have not used any auto-rigging tools, but in the spirit of efficiency I wanted to see if there would be a way to make this process as quick as possible. Mixamo did a pretty good job at rigging the character, but I needed to do some touch up on it. Especially the beard. Background image The background image was a lot simpler, as it would be used as a 2D image, not a 3D model. [JussiK_cyberpunk_point_and_click_adventure_game_screenshot_mark_d77c4843-49ac-447d-9058-842c7f39b752-1024x683] [svg]cyberpunk point and click adventure game screenshot marketplace exterior -v 4 -ar 3:2 Even though the image is 2D, it requires some work to merge the 3D character in it beautifully. First, we need to get the camera data from the image. I used a free tool called fSpy to reverse-engineer the camera. [image-14-1024x615][svg]The image in fSpy fSpy has an import add-on for Blender, so it was very easy to get the image and camera to blender for modeling a rough representation of the location. [image-15-1024x812][svg]the location in blender The 3D version of the location is required for the perspective shift on the character to match, and to allow the character to pass behind objects. It is also useful for setting up the lights in 3D space and to get shadows from the location on the character. Blender also has a great tool for generating UVs from camera projection, so it was the perfect tool for this step, although I needed to learn everything from scratch as the software is very alien to me. Putting it all together Now that I have the all the pieces of the puzzle, it was just a matter of putting them together. I used Unity for this. I created a simple animator for the character locomotion, scaled the 3D location to match the character and set up some lights to match the scene lighting so the character would not stand out so much. Conclusion I spent 18 hours working on the 3D assets and unity scripting for this prototype. 12hours on the character model/uv/morph/textures/ rigging - 3 hours on the location camera & mesh - and the rest on game scripting - not including any of the AI prompting. On minimum the AI saved me 2 days of work on the character and 3 on the location. As per my estimation. The end results are not perfect by any means. Closeups of the character are not ideal. The location is hard to art direct and can be very random. But if you accept the AIs shortcomings and work around them, creating a full game using AI as a co-worker is perfectly possible. It enables the creation of games that would otherwise be left unmade because of budget or time constraints for sure! facebookfacebookShare on Facebook TwitterTwitterTweet Related Posts: * Cross-Platform & car update & UICross-Platform & car update & UI Cross-Platform & car update & UI * Fast-travel for open world point & clickFast-travel for open world point & clickFast-travel for open world point & click * Very early gameplayVery early gameplayVery early gameplay * Motion capture & sneaky peeksMotion capture & sneaky peeksMotion capture & sneaky peeks * 3-point turns3-point turns3-point turns * Introducing our AI overlordsIntroducing our AI overlords Introducing our AI overlords Jussi 0 Tags : AIArtModeling Post navigation Introducing our AI overlords Leave a Reply Cancel reply You must be logged in to post a comment. Recent Posts * Introducing our AI overlordsIntroducing our AI overlords Introducing our AI overlords 7 months ago With the emergence of AI image generation tools such as... Read More >> * First PivotFirst Pivot First Pivot 1 year ago My goal for this project has always been to create... Read More >> * Pushing a car into the oceanPushing a car into the ocean Pushing a car into the ocean 2 years ago In this post I will tell about the game scripting... Read More >> * Planar Reflections and Patrol BoatsPlanar Reflections and Patrol Boats Planar Reflections and Patrol Boats 2 years ago After modeling a small patrol boat I realised that I... Read More >> * Isometric, large location learningsIsometric, large location learnings Isometric, large location learnings 2 years ago After working on the ship location for a while, I... Read More >> You might also like * Planar Reflections and Patrol BoatsPlanar Reflections and Patrol Boats Planar Reflections and Patrol Boats 2 years ago After modeling a small patrol boat I realised that I... Read More >> * Low-Polygon waterLow-Polygon water Low-Polygon water 2 years ago I have worked on a few water shaders in previous... Read More >> * Introducing our AI overlordsIntroducing our AI overlords Introducing our AI overlords 7 months ago With the emergence of AI image generation tools such as... Read More >> Search [ ] [Search] Archives * January 2023 * May 2022 * August 2021 * April 2021 * February 2021 * December 2020 * November 2020 * October 2020 * September 2020 Tags AdventureCreator AI Animation Art Car Character Code Community Effects Hardware Maps Mocap Modeling Ship Sound Story Vegetation VFX Water Subscribe Please leave this field empty[ ] First name[ ] Email *[ ] [Subscribe!] Check your inbox or spam folder to confirm your subscription. Meta * Log in * Entries feed * Comments feed * WordPress.org * Home * Blog * Media * About * Discord * dAb Copyright (c)2020 Dinosaurs are Better [ ] [Search]