The whole AEC industry is challenged by the high CO2 footprint caused by the increasing population and construction. Introducing regulations to the construction industry is a solution to reduce CO2 footprint. The workflow behind Leed mini consultant goes as follows: starting with gathering the regulation in a dataset and setting it up, training a rag with it, then feeding images of leed buildings to image to text models, and lastly comparing text with leed and going again to image.
![](https://blog.iaac.net/wp-content/uploads/2024/07/Screenshot-2024-07-10-132759-1024x564.png)
Starting with the first step, we used LM studio to train our models and dataset in pdf format. In details, We loaded the model in LM studio then load the embedding model and then go to vs code, there we input our pdf and text files, transform them to vector encoding train the rag with LM Studio and get in vector encoding the leed consultant.
![](https://blog.iaac.net/wp-content/uploads/2024/07/Screenshot-2024-07-10-132837-1024x568.png)
For the dataset we used 3 pdf official files – the LEED Certification guidebook – the LEED Building Design and Construction AND the LEED Rating System for Green Buildings.
![](https://blog.iaac.net/wp-content/uploads/2024/07/Screenshot-2024-07-10-133306-1024x558.png)
After that we analyse our pdfs to convert them into txt format. And here we can see that from this process the text that came out needed some cleaning and transformation…like removing unnecessary spaces before feeding it into the RAG.
![](https://blog.iaac.net/wp-content/uploads/2024/07/Screenshot-2024-07-10-133650-1024x556.png)
Text in chunks and then converted to vectors.
![](https://blog.iaac.net/wp-content/uploads/2024/07/Screenshot-2024-07-10-133704-1024x580.png)
![](https://blog.iaac.net/wp-content/uploads/2024/07/Screenshot-2024-07-10-134259-1024x577.png)
![](https://blog.iaac.net/wp-content/uploads/2024/07/image-44-1024x585.png)
In the third step we will explore the image to text method to extract LEED specific sustainable characteristics from building images.
![](https://blog.iaac.net/wp-content/uploads/2024/07/image-45-1024x562.png)
![](https://blog.iaac.net/wp-content/uploads/2024/07/image-46-1024x584.png)
![](https://blog.iaac.net/wp-content/uploads/2024/07/image-47-1024x554.png)
![](https://blog.iaac.net/wp-content/uploads/2024/07/image-48-1024x596.png)
![](https://blog.iaac.net/wp-content/uploads/2024/07/image-49-1024x548.png)
![](https://blog.iaac.net/wp-content/uploads/2024/07/image-50-1024x571.png)
![](https://blog.iaac.net/wp-content/uploads/2024/07/image-51-1024x566.png)
![](https://blog.iaac.net/wp-content/uploads/2024/07/image-52-1024x595.png)