The speed with which fresh technologies appeared on the market is nothing compared to the speed at which talented researchers find inventive ways of using them, training and even transforming into things without which we cannot live. One of such researchers is the Mad Mad Fellow Alexander Htet KyawPhD student performing the scientific degree of a double master’s degree in the field of architectural research in the field of calculations, electrical engineering and computer science.
Kyaw accepts technologies such as artificial intelligence, augmented reality and robotics, and combines them with a gesture, speech and recognition of objects to create the flows of human work-Ai, which may interact with our built-up environment, change the way of purchasing, designing sophisticated structures and creating physical things.
One of his latest innovations is Curator AI, for which he and his student partners myth adopted the first prize – $ 26,000 in OpenAi and Gash products – on compilation AI MIT AI Build: Generative Voice Ai Solutions, a weekly hackaton in myth with final presentations from the last autumn in Recent York. At work with Kyaw were Richa Gupta (architecture) and Bradley Bunch, Nidhish Sagar and Michael Won – all from the Department of Electrical Engineering and Computer Science MIT (EECS).
The curator AI aims to improve online furniture purchases by providing recommendations of products aware of the context using AI and AR. The platform uses AR to take the dimensions of the room with windows, doors and existing furniture. Users can then talk to the software to describe what fresh equipment they want, and the system will employ the AI model in the vision language to search and display various options that match both the user’s hints and the visual features of the room.
“Buyers can choose from suggested options, visualize products in AR and use natural language to ask for search modifications, thanks to which the furniture selection process is more intuitive, efficient and personalized,” says Kyaw. “The problem we are trying to solve is that most people do not know where to start, sharing a room, which is why we have developed AI curator to provide intelligent, contextual recommendations based on what your room looks like.” Although the custodian AI was developed for furniture purchases, it can be extended to employ in other markets.
Another example of Kyawa’s work is the estimation, the product that he and three other graduates created during the Hackathon conference Mit Sloan Product Tech Conference in March 2024. This competition was helping miniature companies; Kyaw and the team decided to base their work on a painting company in Cambridge, which employs 10 people. The estimation uses AR and AI technology to recognize objects for precise measurement of the room and generate detailed cost estimation for renovation and/or painting. It also uses generative artificial intelligence to display room or rooms that may look after painting or renovation, and generates an invoice after the project is completed.
The team won this hackathon and $ 5000 in cash. Colleagues from the Kyawa team were Guillaume Allegre, May Khine and Anna Mathy, all of whom completed the myth in 2024 with a master’s degree in business analysis.
In April, Kyaw will give a TEDX conversation at his home university, Cornell University, in which I will describe the AI curator, estimates and other projects that AI, AR and robotics to design and build things.
One of these projects is illogical for which Kyaw connected AR with gestures recognizing to build a software that draws a contribution from the touch of the fingertip on the surface of the material, and even in the air to map the dimensions of construction components. In this way, Ungloge was created – a high artistic sculpture made of ash standing on the Cornell campus.
Recognition of gestures for mixed reality based on feedback and robotic manufacturing of the Inglog tower
Video: Alexander Htet Kyaw
Invol represents the possibility of building structures directly from the entire journal, instead of going to a wood mill, which is to be transformed into boards or two, and then sent to a wholesaler or seller. This is a good representation of Kyawa’s desire to employ building materials in a more balanced way. Article about this work “Recognition of gestures for a coupling based on a mixed reality of the Inglog Tower Case study“It was published by Kyaw, Lok, Lawson Spencer and Sasa Zivkovic in the proceedings of the 5th International Conference on the design and production of robots, January 2024.
Another system was developed by Kyaw, integration of physics simulation, gesture recognition and AR for designing vigorous bending constructions made of bamboo poles. Gesture recognition allows users to manipulate bamboo digital modules in AR, and the simulation of physics is integrated to visualize how bamboo turns and where to attach bamboo poles in a manner forming a stable structure. These works appeared in the proceedings of 41. Education and research in the field of computer -assisted architectural design in Europe, August 2023 as “Active bending in mixed reality based on physics: design and production of a reconfigurable modular bamboo system. “
Kyaw issued a similar idea using bamboo modules to create implemented structures for Mitdesignx last year, the Mit Mad program, which chooses promising startups and provides them with coaching and funds for their launch. Kyaw has founded since then Bendshelters To build prefabricated, modular bamboo shelters and social spaces for refugees and displaced people in Myanmar, his country.
“Where I grew up, in Myanmar I saw many everyday effects of climate change and extreme poverty,” says Kyaw. “There is a huge crisis for refugees in the country and I want to think about how I can make a contribution to my community.”
His work with Bendshelters was recognized by the Sandbox myth, PKG Social Innovation Challenge and the Amazon Robotics award for social goods.
At Mit Kyaw, he cooperates with Professor Neil Gershenfeld, director of the Center for Bits and Atom, and PhD student Miana Smith to employ speech recognition, 3D generative artificial intelligence and robotic arms to create a flow of work that can build objects in available, on demand and balanced way. Kyaw has a bachelor’s degree in architecture and computer science from Cornell. Last year, he received a SJA scholarship from the Steve Jobs archive, which ensures financing of projects at the intersection of technology and art.
“I like to discover different types of technology to design and do things,” says Kyaw. “Being part of MAD made me think about how my whole work connects and helped explain my intentions. My research vision is to design and develop systems and products that allow natural interactions between people, machines and the world around us.”