Utilization of Image-generating AI in the Architectural Design Process - Focusing on the Comprehension and Expressiveness of Sketch-to-image Input-based Image-generating AI

Oct 29, 2026

Study examines how image-generating AI supports architectural design when driven by hand-drawn sketches. Five sketch-to-image web tools—fabrie, LookX AI, PromeAI, mnml.ai, and Rerender AI—are assessed for comprehension and expressiveness. Architectural experts identify key features visible in sketches, then expert perceptions are compared with AI outputs to judge spatial interpretation, material depiction, and awareness of spatial context. Results show differing strengths, with proposals for integrating AI visualization with sensor feedback loops and material-aware simulation to improve early-stage design ideation, evaluation, and automation.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages24

Reading Time1 h 0 min

AccessFree to download

1. Introduction

1.1 Background and objectives

1.2 Research methods and scope

Sensors and Materials, Vol. 37, No. 6 (2025) 2607–2629 2607 MYU Tokyo S & M 4077 Utilization of Image-generating AI in the Architectural Design Process: Focusing on the Comprehension and Expressiveness of ‘Sketch-to-image’ Input-based Image-generating AI Han Yeol Baek 1 and Jung Hoon Kim2* 1Department of Architecture, Hannam University, Daejeon 34430, Korea 2Department of Urban Planning and Real Estate Studies, Pyeongtaek University, Gyeonggi-Do 17869, Korea (Received February 3, 2025; accepted June 13, 2025) Keywords: image-generating AI, sketch-to-image tool, AI-based visualization, generative AI in architecture, architectural design In this study, we explore the role of image-generating AI in architectural design, focusing on sketch-to-image AI tools and their ability to interpret hand-drawn sketches. Five AI tools, namely, fabrie, LookX AI, PromeAI, [mnml.ai](mnml.ai), and Rerender AI, were analyzed for their comprehension and expressiveness in architectural contexts. To evaluate the effectiveness of these AI tools, architectural experts were surveyed to identify key architectural features present in sketches. These expert insights were then compared with AI-generated outputs to assess their accuracy in spatial perception, material expression, and spatial context awareness. Fabrie excelled in spatial interpretation and material representation, efficiently converting conceptual sketches into detailed visualizations. PromeAI demonstrated strong creative flexibility, supporting iterative design processes with diverse customization options. However, some contextual inconsistencies and missing environmental elements were noted. Importantly, in this study, we discuss how AI-generated imagery can be integrated with sensor-based feedback loopsand material-aware simulation tools to enhance the design process. By combining AI visualization with sensor-informed environmental data and performance metrics, architects canmore effectively evaluate spatial quality and environmental responsiveness in early-stage design. The study highlights AI’s potential as a complementary tool in early-stage design, enhancing rapid ideation, visualization, and design automation. By integrating AI into workflows, architects can expand creativity and efficiency while exploring a wider range of design possibilities. Furthermore, advancements in AI learning models, prompt engineering, and collaborative design processes particularly those that incorporate sensor-derived data are emphasized to strengthen AI’s role in bridging digital tools with human-driven creativity in architectural practice. * Corresponding author: [e-mail:](e-mail: urban@ptu.ac.kr)[ ](e-mail: urban@ptu.ac.kr)[urban@ptu.ac.kr](e-mail: urban@ptu.ac.kr)[ ](e-mail: urban@ptu.ac.kr)[https://doi.org/10.18494/SAM5592](https://doi.org/10.18494/SAM5592) ISSN 0914-4935 © MYU K.K. [https://myukk.org/](https://myukk.org/) 1. Introduction 1.1 Background and objectives In 2022, the artwork Theatre D’opera Spatial, created using the image-generating AIMidJourney, won the grand prize at the Colorado State Fair Fine Arts Competition, sparking widespread controversy.(1,2) Additionally, in 2024, OpenAI, a leading AI company, introduced Sora, an AI designed for video production. Its realistic and expressive results became a global topic of discussion.(3) AI, by leveraging vast datasets and computational processes, generates novel outputs in a fraction of the time it would take a human.(4) Given that both AI and humans engage in creative processes by building on existing knowledge, it is increasingly challenging to draw a clear boundary between the two.(5) MidJourney, a prominent example of image-generating AI, is renowned for its ability to produce creative and artistic images. The platform generates images on the basis of textual prompts, allowing the AI to interpret the user’s intent and produce related imagery.(6) Such applications of image-generating AI have transcended tra

FAQs

Which sketch-to-image AI tools are evaluated in the study?

The study analyzes five tools: fabrie, LookX AI, PromeAI, mnml.ai, and Rerender AI.

How does the study measure AI performance in architectural design contexts?

Architectural experts identify key architectural features in sketches, and those insights are compared against AI-generated outputs to evaluate accuracy in spatial perception, material representation, and contextual awareness.

What is the reported value of integrating AI-generated imagery with sensor feedback loops?

Combining AI visualization with sensor-informed environmental data and performance metrics helps architects evaluate spatial quality and environmental responsiveness earlier in the design process, supporting rapid ideation and iterative improvement.

Oct 29, 2026

Upload by Guten tag