Students will delve into state-of-the-art image generation and editing techniques using generative models. They will learn how these models create high-quality images from text descriptions and their applications in conceptual design and architectural visualization.


Syllabus

Generative AI 

MaCAD Digital Tools for GENERATIVE AI SEMINAR

 


SDXL image with text inputs by Michael Walsh. MaCAD 2023/24

The Digital Tools for Generative AI seminar explores the practical uses of image generation in the Architecture, Engineering, and Construction (AEC) industry. Integrating these tools into design practice marks a transformative shift, enabling professionals to redefine traditional workflows. Architects, engineers, and designers can leverage generative AI to discover new design possibilities, streamline processes, and tackle complex challenges in innovative ways.

Students will delve into state-of-the-art image generation and editing techniques using generative models. They will learn how these models create high-quality images from text descriptions and their applications in conceptual design and architectural visualization. The seminar includes generating visuals with existing models, fine-tuning them using Low-Rank Adaptation (LoRA) with custom datasets, and experimenting with model parameters to understand their influence on image quality outputs.

By the end of the course, students will integrate their results into interactive applications using Gradio, enabling seamless exploration and presentation of their AI-generated visuals.

Learning Objectives

  • Learn about the history of machine learning for image generation.
  • Understand key concepts of the image generation process, including embeddings, latent space, network architecture, denoising, sampling, conditional generation, guidance, training, and fine-tuning.
  • Generate high-quality images from both text prompts and image inputs.
  • Edit and expand images while maintaining stylistic coherence.
  • Efficiently fine-tune models using custom datasets.
  • Control image generation with additional inputs (sketches, edges, and depth maps).
  • Utilize batch prompting strategies to iterate on images with a structured approach.
  • Create interfaces to present and interact with generative workflows.

 

KEYWORDS

image generation, text-to-image, image-to-image, generative flow and diffusion models, controlnet, low-rank adaptation (LoRA), interfaces, python, google collab, comfyUI, gradio.


Faculty


Projects from this course

Portfolio Enhancer

Our portfolios are dynamic records that show not only our completed projects but also the changing methods styles and visual languages we use as designers and architects. However as visualization trends change—from stylized schematics to photorealistic renderings—our older images may begin to seem out of place. With the Portfolio Enhancer a proof-of-concept interface that uses … Read more

Design Development: Image to image generator

Project Objective The project objective is to develop an interface where users can batch upload images of an established design, usually in the Design Development phase when materials and small tweaks are being considered. The goal is for a user in a traditional architecture office to batch upload images of their 3d model to quickly … Read more

VAN GOGH ART REVIVAL

Grasshopper ↔ Gradio Workflow for AI-Aided Visual Storytelling” “WORKFLOW“ Creating concept with Grasshopper and testing it with Gradio with LoRA for visualization. Testing the workflow with styling with trained model from Van Gogh work . Collecting city, landscape and architecture paintings to created hybrid styling between architecture language in the past and present. Modeling Grasshopper … Read more

Mas Profundo: Model to Building

Mas Profundo is a pipeline that allows designers to generate interesting architectural images from simple models using a live camera feed.  Architectural models tend to portray a reduced colorway and detail is limited by workmanship and time.   Mas Profundo allows each model ideation to be visualized more realistically than a simple foam model. Mas Profundo … Read more

FGSketch: image to sketch web-app

Introduction We are Aleyna and Francesco, and in this post, we present FG Sketches—a generative tool developed as part of the Artificial Intelligence in Architecture (AIA) module within the MaCAD Generative AI program. The objective of this project was to design a system capable of learning from the sketching language of Frank Gehry and translating … Read more

isOGen

ISOGEN — Isometric Building Generation with AI By Joaquín Broquedis & Marco DurandFinal project for Generative AI Introduction This project explores the use of generative AI to produce isometric visualizations of architectural typologies. We developed ISOGEN, a small-scale prototype aimed at testing whether a custom-trained image-to-image LoRA (Low-Rank Adaptation) model could learn to generate building … Read more

Meaning by Machine

Outline: Depth and canny of an object by Jose Lazokafatty and Paul Suarez Introduction The Machine, as a creative AI-powered image generator that turns your sketches and prompts into richly detailed visions. Born from curiosity—how does a machine interpret an abstract outline of a doodle? or the depth of an image? this project is as … Read more

KG LineART

A GRADIO tool that generates architectural line drawings from Rhino3D Viewport screenshots by relating on a trained LoRA of architectural line drawings that takes the viewport input prompt option setting and generate a ready to use line drawing The User even have the option to edit the Hue and Saturation of the line drawing and … Read more

PLEINAR _ a 3d model to watercolour INTERFACE

Imagine transforming any 3D model into an expressive, hand-rendered-style watercolor sketch, a visualization that breathes life into architectural concepts. Pleinar: the interface that transforms 3D models into captivating, multiview, generative watercolor sketches, inspired by the brilliant artistry of Liz Steel. __________________________________________________________________________________________________________________________________________________________________________ __________________________________________________________________________________________________________________________________________________________________________ The LoRA – training DATASET We trained this LoRA on the work of … Read more

ARchitect

Sketches in Space with AI and LoRA What if architects could doodle inside their designs—live, in 360°? ARchitect is a mixed-reality interface I developed for stylizing architectural spaces using expressive, cartoon-like overlays. Powered by LoRA fine-tuning and a custom-trained Flux, ARchitect reimagines how we interact with our built environment—by making architectural visualization playful, intuitive, and … Read more

Beyond The Frame

Visual Storytelling using SDXL _LoRA_Gradio Exploring Dali and Bosch-inspired storytelling with SDXL + Gradio Our project is a tool that helps architects turn stories into surreal image sequences. We explored styles inspired by Dali and Bosch to create dreamlike visuals. Although we trained a custom model, we used prompt-based image generation in the final version. … Read more

Pavilion 3D & 2D Generator

Problem statement Pavilion design is deceptively demanding. Even though these structures are small, the creative expectations are incredibly high. In most competitions or studio settings, we’re expected to deliver rich, meaningful concepts – drawing on cultural references, environmental context, and symbolic language – all within just a few days or even hours. At the same … Read more

Panton vs Lumon: An Aesthetic Showdown in Pixels

Welcome to Panton vs Lumon, the app we built during the GenAI course to explore what happens when you pit two aesthetic extremes against each other, then hand over control to the user. Think Verner Panton meets Severance’s Lumon Industries. This isn’t just style transfer – it’s a design identity crisis turned into a creative … Read more

Preserving a Photographic Legend

Slim Aarons’s Aesthetic Meets Generative AI Slim Aarons’ Aesthetic and Legacy Slim Aarons (1916–2006) built a career photographing the glamour of high society in the postwar 20th century. A combat photographer in World War II turned lifestyle chronicler, Aarons famously vowed to only capture “attractive people doing attractive things in attractive places” after witnessing the … Read more

The Storyteller: Revolutionizing Architectural Communication

How two architects transformed the way we present architectural projects by creating an AI-powered storytelling interface that turns technical drawings into compelling visual narratives. The Genesis: Beyond Plans and Sections Traditional architectural presentations often fail to bridge the gap between professional technical documentation and client understanding. James discovered that: So who is this storyteller platform … Read more

Inpaint Materiality

Intro Designers know the pain: a perfect image—ruined by one wrong material. A distracting object. A missing texture. An awkward composition. You could retouch it manually, but how long will that take? And will it ever really blend? What if you could just circle the problem area and ask for something better? Something that fits … Read more