Following these activities, a was conducted to collect their insights about the use of GenAI in the AT adaptation process in their .
“AI prompt composition and the usefulness of generated ATs still require an OT's eyes on it... it's important to ensure there is no potential for skin breakdown or harm.”
but
applications
time and resources
Interface Prototype
AI is useful, ...
The AT adaptation process includes stages such as clinical assessment, searching for off-the-shelf ATs, adaptation, AT evaluation, and further adjustment.
Image download
GAP 2
Over 80
Product Type Specification
GAP 3 - 2
“Having the initial prompts is really helpful...if you don’t know how to talk to [the AI], which is like half of the battle, then you're not going to get the desired result.”
Procedure
Image to 3D AI generator.
Exploring the potential of this AI tool for individuals without OT expertise who seek opportunities to access adaptive solutions.
AT User Profile Form
3D model preview window
Not suitable for complex adaptations
Adding more keywords
02
03
Keywords such as "Designed for the elderly" and "Designed for people with limited hand mobility" ensure that the products are tailored to specific user groups with varying levels of hand function.
Midjourney's extensive repository enhances the feasibility of generated products, while also delivering the .
Image Styles
reduce communication efficiency
40-70 minutes testing session
GAP 3 - 1
3D model generation button
Printed double-grip cup for eldery designed by OT3 .
An exploratory study that investigates the potential of in enhancing the workflow of occupational therapists for assistive technology solutions for people who live with limited hand mobility.
Meshy produces highly and can generate them within just 1 to 2 minutes.
Midjourney
AI can the gap!
Existing products offer and are mostly . is another critical factor that occupational therapists (OTs) need to consider when selecting devices.
Next...
less engaged
UI components -
image-to-3D tab
It can...
“It’s just point and click... this would be used on the therapist’s laptop or desktop.”
"adding more ADLs and IADLs to expand usage scenarios, like handwriting"
Requires OT professional expertise to evaluate usefulness
cat.
adaptive technology, designed for people who have limited hand strength, aid designed for the elderly, cutting knife, angled utensil, holder, wood, precisionism, perspective view, white background
generative AI
Interface Suggestions
assistive device, aid designed for the elderly, designed for people who have limited hand mobility, designed for people who have limited hand strength, grip with textured surface, photo, white background, perspective view, cup, holder, two handles on the side, lidded cup
cat.
Easy to use
accurate 3D models
Image upload
Activities of Daily Living (ADLs)
Target User
"including “build-up handle” as an option for adaptation type, as it is a widely used term in the industry"
04
Keywords are helpful
limited design options
to craft precise prompts efficiently.
"including keywords for generating images with hands to provide better context for the AT's use"
06
trial and error to find the right words
Image display
semi-structured interview
Image generation button
limitations in generating novel and stylish
3D model download
one-size-fits-all
cat.
Prior to the workshop, the OTs completed an to create a hypothetical client profile. The form included information such as the user's age, gender, diagnosis, and functional limitations. This form served as a reference for the OTs to create suitable ATs using GenAI according to the user's needs and impairment type.
Optimizing the AI to specialize in designing AT adaptations.
Keywords function
find the GAP...
Assist OTs in turning generated concepts into .
OTs may not always have sketching skills, so they often prefer hands-on prototyping. However, this approach can take as they experiment and test various designs to find the right solution.
Interface Insights
What are the keywords that work for both and ?
Text-to-image AI generator.
During the workshop, the OTs used text-to-image AI generator to generate visual representations of the desired ATs, and then employed the 3D AI generator to produce 3D models from the generated images.
Prompts and Generated Images.
Conducting tests with additional OTs and individuals with disabilities to evaluate the interface and explore its potential to enhance their quality of life.
Quickly generate
cat.
Human-AI Interaction UI/UX Design Paper admitted to the ASSETS '24 Conference
GAP 4
text-to-image tab
Material & Finish
UI components -
Keywords!
cat.
professional design terminology
Selected keywords include "Aid device," "Adaptive technology," and "Assistive technology," covering a range of products designed for various assistive needs.
Exploring diverse approaches to incorporating AI for OTs and individuals living with disabilities.
tangible outcomes
Keywords such as "bathing," "dressing," and "feeding" were used to identify hand-related ADLs that need improvement. Sub-categories like "spoon," "weighted grip," and "extended grip" further specify specific utensils and adaptation types to better address user needs and functionality.
lack a clear visual concept
Scroll down
Cost
AI
5 OTs
BRIDGE
GAP 1
“Sometimes it just might require someone to custom fit something to a patient... like a splint where you have to adjust their wrist, finger, and knuckles positioning.”
and are selected as the primary AI generators and integrated their official APIs into Thera AI.
Use
clinical practice
It requires significant to explore various solutions, and complex adaptations are challenging to if they break.
OTs can add, edit, and delete keywords to create a personalized keyword library for quick prompt composition.
“If I don’t have the main idea in my mind, I can just use whatever keyword is here. And you also have free typing for keywords, which is great.”
diverse concepts based on OT's input and inquiries.
typing aid, assistive device, universal cuff, plastic, photo, perspective view, stylus
Limitations of current AI generator
Clients often of the adapted products they will use, which can and make them in the design process.
OTs
Keywords such as "grip with textured surface" were included to add texture and improve usability for weak grip strength.
Usability test
"frustration when AI-generated images do not meet all specified keywords in the prompt"
Refining and expanding the keyword library to improve prompt creation and ensure more accurate outputs.
- **OT2:** “It generated it pretty quickly and it’s pretty easy to see what it was like. It’s not warping it to a crazy amount... it’s showing the right dimensions of everything.”
- **OT5:** “I can show the wife or the mother, ‘Hey look, this works,’ and they go, ‘OK,’ and they can duplicate that.”
- **OT3:** “I like it, I think these are the words I will say all day with a client. The process is fun, try different terms.”
“AI adds more freedom to choose the exact right thing for the patient...if a patient has multiple conditions... sometimes a general solution doesn’t work.”
Visualization
- **OT5:** “I can show the wife or the mother, ‘Hey look, this works,’ and they go, ‘OK,’ and they can duplicate that.”
Customization
- **OT3:** “This tool is very useful in the field, even in the clinic... they could sit together, do search term, and then look at the images with the clients, and back in the office later, the clinician would go to this phase [image to 3D], and do the printing.”
- **OT2:** “If this was more developed and publicly available... I want more ideas or maybe I wanna show a patient something that I'm thinking of... this can be super helpful.”
“This gonna be so much more patient specific... down to the measurement, even into the color, even the type of grip, this would be the best for their hands.”
- **OT3:** “It gives you an idea you haven’t even thought about yet... it gives good ideas back to the people who are doing the searching.”
- **OT5:** “If I was working in a rehab clinic, I could print out a right-handed 90-degree spoon on my 3D printer...the 3D one would just be a prototype or a tool to use for practice...you don't want to have them put out $100 for adaptive devices that don't work.”
- **OT2:** “Knowing that this is gonna be a 3D image, you could also just generate the initial keywords differently...definitely potential to change even just the first picture and then get a better 2nd 3D picture.”
AI workflow
- **OT2:** “It generated it pretty quickly and it’s pretty easy to see what it was like. It’s not warping it to a crazy amount... it’s showing the right dimensions of everything.”
Customization
- **OT3:** “It gives you an idea you haven’t even thought about yet... it gives good ideas back to the people who are doing the searching.”
- **OT2:** “If this was more developed and publicly available... I want more ideas or maybe I wanna show a patient something that I'm thinking of... this can be super helpful.”
Practical
Efficiency
- **OT3:** “It gives you an idea you haven’t even thought about yet... it gives good ideas back to the people who are doing the searching.”
Willingness to Use
- **OT3:** “It gives you an idea you haven’t even thought about yet... it gives good ideas back to the people who are doing the searching.”
Creative
- **OT3:** “It gives you an idea you haven’t even thought about yet... it gives good ideas back to the people who are doing the searching.”
- **OT5:** “I can show the wife or the mother, ‘Hey look, this works,’ and they go, ‘OK,’ and they can duplicate that.”
- **OT2:** “I think that I'm excited about their potential use...I'm pretty eager about it. So, I do think the possibilities are endless...”
Practical
- **OT3:** “This tool is very useful in the field, even in the clinic... they could sit together, do search term, and then look at the images with the clients, and back in the office later, the clinician would go to this phase [image to 3D], and do the printing.”
- **OT5:** “If I was working in a rehab clinic, I could print out a right-handed 90-degree spoon on my 3D printer...the 3D one would just be a prototype or a tool to use for practice...you don't want to have them put out $100 for adaptive devices that don't work.”
Willingness to Use
Willingness to Use
- **OT3:** “I like it, I think these are the words I will say all day with a client. The process is fun, try different terms.”
- **OT2:** “It generated it pretty quickly and it’s pretty easy to see what it was like. It’s not warping it to a crazy amount... it’s showing the right dimensions of everything.”
- **OT2:** “If you learn how to use AI, it could save you so much time instead of experimenting on your own... You could be more efficient with just digitally making a bunch of products.”
- **OT2:** “Even when the AI does something wrong or different, it still gives me ideas for what it could be used for... it sparks your thought process.”
- **OT2:** “I think that I'm excited about their potential use...I'm pretty eager about it. So, I do think the possibilities are endless...”
Creative
- **OT3:** “I like it, I think these are the words I will say all day with a client. The process is fun, try different terms.”
- **OT2:** “Even when the AI does something wrong or different, it still gives me ideas for what it could be used for... it sparks your thought process.”
- **OT5:** “If I was working in a rehab clinic, I could print out a right-handed 90-degree spoon on my 3D printer...the 3D one would just be a prototype or a tool to use for practice...you don't want to have them put out $100 for adaptive devices that don't work.”
Creative
- **OT2:** “I think that I'm excited about their potential use...I'm pretty eager about it. So, I do think the possibilities are endless...”
- **OT3:** “Having the patients see it beforehand helps them, help us, pick the right terms... that visual is very helpful for clients.”
- **OT2:** “It generated it pretty quickly and it’s pretty easy to see what it was like. It’s not warping it to a crazy amount... it’s showing the right dimensions of everything.”
- **OT3:** “Having the patients see it beforehand helps them, help us, pick the right terms... that visual is very helpful for clients.”
- **OT3:** “I like it, I think these are the words I will say all day with a client. The process is fun, try different terms.”
Visualization
- **OT5:** “I can show the wife or the mother, ‘Hey look, this works,’ and they go, ‘OK,’ and they can duplicate that.”
- **OT2:** “I think that I'm excited about their potential use...I'm pretty eager about it. So, I do think the possibilities are endless...”
- **OT3:** “I like it, I think these are the words I will say all day with a client. The process is fun, try different terms.”
“AI adds more freedom to choose the exact right thing for the patient...if a patient has multiple conditions... sometimes a general solution doesn’t work.”
- **OT2:** “If this was more developed and publicly available... I want more ideas or maybe I wanna show a patient something that I'm thinking of... this can be super helpful.”
- **OT3:** “This tool is very useful in the field, even in the clinic... they could sit together, do search term, and then look at the images with the clients, and back in the office later, the clinician would go to this phase [image to 3D], and do the printing.”
- **OT2:** “If this was more developed and publicly available... I want more ideas or maybe I wanna show a patient something that I'm thinking of... this can be super helpful.”
“This gonna be so much more patient specific... down to the measurement, even into the color, even the type of grip, this would be the best for their hands.”
Willingness to Use
Efficiency
- **OT3:** “Having the patients see it beforehand helps them, help us, pick the right terms... that visual is very helpful for clients.”
“This gonna be so much more patient specific... down to the measurement, even into the color, even the type of grip, this would be the best for their hands.”
- **OT3:** “I like it, I think these are the words I will say all day with a client. The process is fun, try different terms.”
- **OT2:** “Knowing that this is gonna be a 3D image, you could also just generate the initial keywords differently...definitely potential to change even just the first picture and then get a better 2nd 3D picture.”
- **OT2:** “Knowing that this is gonna be a 3D image, you could also just generate the initial keywords differently...definitely potential to change even just the first picture and then get a better 2nd 3D picture.”
- **OT3:** “It gives you an idea you haven’t even thought about yet... it gives good ideas back to the people who are doing the searching.”
AI workflow
Efficiency
- **OT3:** “This tool is very useful in the field, even in the clinic... they could sit together, do search term, and then look at the images with the clients, and back in the office later, the clinician would go to this phase [image to 3D], and do the printing.”
- **OT2:** “It generated it pretty quickly and it’s pretty easy to see what it was like. It’s not warping it to a crazy amount... it’s showing the right dimensions of everything.”
AI workflow
- **OT5:** “I can show the wife or the mother, ‘Hey look, this works,’ and they go, ‘OK,’ and they can duplicate that.”
- **OT2:** “It generated it pretty quickly and it’s pretty easy to see what it was like. It’s not warping it to a crazy amount... it’s showing the right dimensions of everything.”
- **OT3:** “This tool is very useful in the field, even in the clinic... they could sit together, do search term, and then look at the images with the clients, and back in the office later, the clinician would go to this phase [image to 3D], and do the printing.”
- **OT3:** “Having the patients see it beforehand helps them, help us, pick the right terms... that visual is very helpful for clients.”
Practical
Customization
- **OT3:** “This tool is very useful in the field, even in the clinic... they could sit together, do search term, and then look at the images with the clients, and back in the office later, the clinician would go to this phase [image to 3D], and do the printing.”
“This gonna be so much more patient specific... down to the measurement, even into the color, even the type of grip, this would be the best for their hands.”
- **OT2:** “Even when the AI does something wrong or different, it still gives me ideas for what it could be used for... it sparks your thought process.”
- **OT3:** “Having the patients see it beforehand helps them, help us, pick the right terms... that visual is very helpful for clients.”
“AI adds more freedom to choose the exact right thing for the patient...if a patient has multiple conditions... sometimes a general solution doesn’t work.”
“AI adds more freedom to choose the exact right thing for the patient...if a patient has multiple conditions... sometimes a general solution doesn’t work.”
- **OT2:** “If you learn how to use AI, it could save you so much time instead of experimenting on your own... You could be more efficient with just digitally making a bunch of products.”
Creative
- **OT2:** “It generated it pretty quickly and it’s pretty easy to see what it was like. It’s not warping it to a crazy amount... it’s showing the right dimensions of everything.”
“This gonna be so much more patient specific... down to the measurement, even into the color, even the type of grip, this would be the best for their hands.”
- **OT3:** “It gives you an idea you haven’t even thought about yet... it gives good ideas back to the people who are doing the searching.”
- **OT3:** “Having the patients see it beforehand helps them, help us, pick the right terms... that visual is very helpful for clients.”
- **OT5:** “I can show the wife or the mother, ‘Hey look, this works,’ and they go, ‘OK,’ and they can duplicate that.”
- **OT5:** “I can show the wife or the mother, ‘Hey look, this works,’ and they go, ‘OK,’ and they can duplicate that.”
“This gonna be so much more patient specific... down to the measurement, even into the color, even the type of grip, this would be the best for their hands.”
- **OT2:** “If this was more developed and publicly available... I want more ideas or maybe I wanna show a patient something that I'm thinking of... this can be super helpful.”
- **OT2:** “Knowing that this is gonna be a 3D image, you could also just generate the initial keywords differently...definitely potential to change even just the first picture and then get a better 2nd 3D picture.”
Customization
- **OT2:** “If you learn how to use AI, it could save you so much time instead of experimenting on your own... You could be more efficient with just digitally making a bunch of products.”
- **OT2:** “Knowing that this is gonna be a 3D image, you could also just generate the initial keywords differently...definitely potential to change even just the first picture and then get a better 2nd 3D picture.”
- **OT2:** “Even when the AI does something wrong or different, it still gives me ideas for what it could be used for... it sparks your thought process.”
- **OT2:** “I think that I'm excited about their potential use...I'm pretty eager about it. So, I do think the possibilities are endless...”
Efficiency
- **OT2:** “If this was more developed and publicly available... I want more ideas or maybe I wanna show a patient something that I'm thinking of... this can be super helpful.”
“AI adds more freedom to choose the exact right thing for the patient...if a patient has multiple conditions... sometimes a general solution doesn’t work.”
- **OT5:** “If I was working in a rehab clinic, I could print out a right-handed 90-degree spoon on my 3D printer...the 3D one would just be a prototype or a tool to use for practice...you don't want to have them put out $100 for adaptive devices that don't work.”
- **OT2:** “If you learn how to use AI, it could save you so much time instead of experimenting on your own... You could be more efficient with just digitally making a bunch of products.”
“AI adds more freedom to choose the exact right thing for the patient...if a patient has multiple conditions... sometimes a general solution doesn’t work.”
- **OT2:** “I think that I'm excited about their potential use...I'm pretty eager about it. So, I do think the possibilities are endless...”
Creative
- **OT2:** “I think that I'm excited about their potential use...I'm pretty eager about it. So, I do think the possibilities are endless...”
Willingness to Use
- **OT5:** “If I was working in a rehab clinic, I could print out a right-handed 90-degree spoon on my 3D printer...the 3D one would just be a prototype or a tool to use for practice...you don't want to have them put out $100 for adaptive devices that don't work.”
Creative
“AI adds more freedom to choose the exact right thing for the patient...if a patient has multiple conditions... sometimes a general solution doesn’t work.”
Visualization
Visualization
- **OT2:** “Knowing that this is gonna be a 3D image, you could also just generate the initial keywords differently...definitely potential to change even just the first picture and then get a better 2nd 3D picture.”
- **OT2:** “Knowing that this is gonna be a 3D image, you could also just generate the initial keywords differently...definitely potential to change even just the first picture and then get a better 2nd 3D picture.”
- **OT2:** “Even when the AI does something wrong or different, it still gives me ideas for what it could be used for... it sparks your thought process.”
- **OT3:** “Having the patients see it beforehand helps them, help us, pick the right terms... that visual is very helpful for clients.”
- **OT2:** “If you learn how to use AI, it could save you so much time instead of experimenting on your own... You could be more efficient with just digitally making a bunch of products.”
- **OT3:** “I like it, I think these are the words I will say all day with a client. The process is fun, try different terms.”
Practical
Willingness to Use
Visualization
Visualization
- **OT2:** “It generated it pretty quickly and it’s pretty easy to see what it was like. It’s not warping it to a crazy amount... it’s showing the right dimensions of everything.”
- **OT2:** “Even when the AI does something wrong or different, it still gives me ideas for what it could be used for... it sparks your thought process.”
- **OT3:** “I like it, I think these are the words I will say all day with a client. The process is fun, try different terms.”
- **OT2:** “If you learn how to use AI, it could save you so much time instead of experimenting on your own... You could be more efficient with just digitally making a bunch of products.”
- **OT5:** “If I was working in a rehab clinic, I could print out a right-handed 90-degree spoon on my 3D printer...the 3D one would just be a prototype or a tool to use for practice...you don't want to have them put out $100 for adaptive devices that don't work.”
- **OT2:** “Even when the AI does something wrong or different, it still gives me ideas for what it could be used for... it sparks your thought process.”
Practical
Willingness to Use
Customization
- **OT3:** “It gives you an idea you haven’t even thought about yet... it gives good ideas back to the people who are doing the searching.”
- **OT2:** “If this was more developed and publicly available... I want more ideas or maybe I wanna show a patient something that I'm thinking of... this can be super helpful.”
Efficiency
Creative
Visualization
- **OT5:** “If I was working in a rehab clinic, I could print out a right-handed 90-degree spoon on my 3D printer...the 3D one would just be a prototype or a tool to use for practice...you don't want to have them put out $100 for adaptive devices that don't work.”
Customization
Willingness to Use
AI workflow
- **OT2:** “Even when the AI does something wrong or different, it still gives me ideas for what it could be used for... it sparks your thought process.”
- **OT5:** “I can show the wife or the mother, ‘Hey look, this works,’ and they go, ‘OK,’ and they can duplicate that.”
Efficiency
- **OT3:** “Having the patients see it beforehand helps them, help us, pick the right terms... that visual is very helpful for clients.”
Customization
AI workflow
“This gonna be so much more patient specific... down to the measurement, even into the color, even the type of grip, this would be the best for their hands.”
Efficiency
“AI adds more freedom to choose the exact right thing for the patient...if a patient has multiple conditions... sometimes a general solution doesn’t work.”
Customization
Practical
Visualization
Practical
- **OT2:** “If this was more developed and publicly available... I want more ideas or maybe I wanna show a patient something that I'm thinking of... this can be super helpful.”
- **OT5:** “If I was working in a rehab clinic, I could print out a right-handed 90-degree spoon on my 3D printer...the 3D one would just be a prototype or a tool to use for practice...you don't want to have them put out $100 for adaptive devices that don't work.”
- **OT2:** “Knowing that this is gonna be a 3D image, you could also just generate the initial keywords differently...definitely potential to change even just the first picture and then get a better 2nd 3D picture.”
AI workflow
Creative
- **OT2:** “I think that I'm excited about their potential use...I'm pretty eager about it. So, I do think the possibilities are endless...”
- **OT3:** “This tool is very useful in the field, even in the clinic... they could sit together, do search term, and then look at the images with the clients, and back in the office later, the clinician would go to this phase [image to 3D], and do the printing.”
- **OT2:** “If you learn how to use AI, it could save you so much time instead of experimenting on your own... You could be more efficient with just digitally making a bunch of products.”
- **OT3:** “This tool is very useful in the field, even in the clinic... they could sit together, do search term, and then look at the images with the clients, and back in the office later, the clinician would go to this phase [image to 3D], and do the printing.”
Efficiency
“This gonna be so much more patient specific... down to the measurement, even into the color, even the type of grip, this would be the best for their hands.”
Practical
AI workflow
- **OT2:** “If you learn how to use AI, it could save you so much time instead of experimenting on your own... You could be more efficient with just digitally making a bunch of products.”
AI workflow
Generated images and printed 3D model
Custom Keyword Library
a lot of time
Keywords like "precisionism," "photo," "perspective view," and "white background" were selected to produce clear images for 3D modeling.
highest image quality
01
--- Click to view other works ---
Relying solely on human thinking can lead to design concepts.
6
reproduce
cat.
OTs' Perspectives on AI Integration and Workflow in Clinical Practice
adaptive feeding tool for a patient with limited grip and finger function with Velcro strap to secure around hand or wrist, adaptive technology, assistive product, designed for people who have limited hand strength, designed for people who have limited hand mobility, thickened grip, hand grip, grip with textured surface, white background, weighted grip, top view, fork
kitchen aid for cooking, assistive device, aid designed for the elderly, designed for people who have limited hand mobility, designed for people who have limited hand strength, wider grip, grip with textured surface, photo, rocker knife, white background, perspective view
It takes time for novice users to come up with suitable prompts, and the process often involves . Moreover, achieving precise, realistic images requires familiarity with .
Meshy
prompts were tested using terms commonly used by OTs in daily practice and were grouped into categories.
Contact PageContact
Contact PageHome Page HPContact
Contact PageGRACE LI
Home Page HPHome Page HPWork
Home Page HPHome Page HPWork
Home Page HP40 to 70 minutes
creating and adapting
Free text entry box
05
Missing certain commands in the prompt