Updates

 

On this page

  1. Update 1: Project Goals 
  2. Update 2: Competitive Analysis
  3. Update 3
  4. Update 4
  5. Update 5
  6. Update 6
  7. Update 7
  8. Update 8
  9. Update 9

Weekly Update 9: 12/12/23

Weekly Update 8: 12/5/23

Meeting with jessica

Jessica is using a laptop stand as a keyboard easel, main components include a circular base, a gently angled platform, and a lip at the base’s end to prevent the laptop from slipping. Additionally, the stand incorporates a friction pad to securely hold the keyboard in place.

The stand was originally designed to hold a laptop and the setup has been customized to prop up a keyboard on the stand along with a base under the heel for support.

Sketch of the laptop stand at a 1/3 angle 
Sketch of the laptop stand side view, showing keyboard and the lip of the stand
Sketch of the laptop stand at a 1/3 angle  Sketch of the laptop stand side view, showing keyboard and the lip of the stand
Image of the actual setup showing part of the stand and the mouse pad

 
 
A sketch of the setup with the stand, a box used for support and a mouse pad used for padding
 
 
Image of the actual setup showing part of the stand and the mouse pad A sketch of the setup with the stand, a box used for support and a mouse pad used for padding

 

Actual image of jessica using the setup and typing with her feet
A sketch of the setup highlighting all essential components and feet placement
Actual image of jessica using the setup and typing with her feet A sketch of the setup highlighting all essential components and feet placement

 

Some notes:

  • Jessica mentioned that she’s comfortable with the angle of this stand, and doesn’t need to be changed. We explored ideas for different use cases: 
    • If the chair is a bit farther, or she is leaning backward, the angle of the stand would need to be adjusted to be higher, and the support below her heels will need to be closer to the stand.
  • The lip at the edge of the stand limits access to some keys, particularly the space bar and command key. The stand already has friction pads that would keep the keyboard from slipping and doesn’t need the lip.
  • For the heel support, Jessica is a mouse pad placed on a box. This has significantly improved her posture and she’s able to see the keys without bending down. Instead of a box, we could work with a cylindrical element to give her a wider range of motion and additional support to her foot arch.
  • The width of the stand is designed for a laptop. Since the keyboard is wider, using the number keys can be tricky and the keyboard often flips over due to uneven pressure.


Key Takeaways:

  • Adding heel support and elevating the keyboard on an inclined stand has improved Jessica’s posture significantly.
  • We will continue prototyping a customised solution, that provides angle variability, fits the width of the keyboard, and replaces the box with something with more motion and comfort.

Weekly Update 7: 11/28/23

During our meeting with Jessica, we discussed the idea of adding a support box under her heels for support and comfort, and also explored the option of elevating her keyboard. We also considered transitioning to a touch-screen keyboard. However, Jessica expressed a preference for a physical keyboard.

To test our proposed solutions, Jessica tried using an Amazon box under her heels and a laptop stand to elevate her keyboard at an angle. According to Jessica, these adjustments have made a significant positive difference in her typing experience. She mentioned feeling more comfortable and noted that she no longer needs to look down while typing with her feet.

Jessica has agreed to continue using this setup, and she plans to provide more feedback after further use. This iterative feedback loop is essential in refining our solutions to better suit Jessica’s needs and preferences, ensuring that our assistive tools enhance her overall typing experience.

 

Weekly Update 6: 11/21/23

This week, we focused on exploring keyboard simulators, which are crucial for understanding Jessica’s typing behavior. This step allows us to adapt our approach based on her preferences. Additionally, we looked into customizable keyboards for tablets and iPads, aiming to create a more user-friendly solution. Our research also involved considering flexible touch screens as a potential option, showcasing our commitment to staying informed about innovative technologies in assistive tools.

 

Weekly Update 5: 11/14/23

 

During our meeting with Anita, our primary focus was on exploring potential solutions to address the impact of various muscle joints on Jessica’s typing experience. Anita proposed a multi-faceted approach, starting with adjustments to the angles of the iPad. To achieve this, she suggested the implementation of a stand for the iPad, complemented by ankle support.

Anita’s vision for the iPad stand included a modular design with slats, allowing for both height and angle customization. This adaptability would cater to Jessica’s specific needs based on her posture, ensuring optimal comfort and support not only when she’s sitting upright but also when she wants to lean back. Anita emphasized the importance of considering not only the toes and ankle but also the calves when determining the ideal angle and height for the iPad.

In addressing the tactile aspect of typing, Anita proposed enhancements to the home keys. For the on-screen keyboard on the monitor, she recommended a clear sheet of plastic, possibly made of vinyl, to delineate key locations or using high contrast so Jessica can see which keys are being typed via the simulation of the screen. 

This sheet would be easily removable, offering flexibility and convenience. Additionally, for the iPad, Anita suggested using tape to create a similar delineation of keys, or using a clear sheet or providing tactile feedback .

In summary, we will develop a comprehensive solution to accommodate the impact of muscle joints on Jessica’s typing. The proposed measures included a versatile iPad stand with ankle support, along with enhancements to the home keys using clear sheets of plastic or tape for both the on-screen keyboard and the iPad.

A sketch of potential way of using the keyboard when sitting up with support under heel and tablet set on an angled stand.
A sketch of potential way of using the keyboard when leaning back with support under calves and tablet set on a higher angle.
A sketch of potential way of using the keyboard when sitting up with support under heel and tablet set on an angled stand. A sketch of potential way of using the keyboard when leaning back with support under calves and tablet set at a higher angle.

Weekly Update 4: 11/7/23

 

The feedback from the mid-term presentation has provided valuable insights and suggestions for further refinement of our project. Here is a detailed elaboration on the key points raised:

  1. Utilizing Phone Cameras for Foot Movement: Can we use phone cameras to capture foot movement? By leveraging phone cameras, we can potentially create a more accessible and user-friendly solution for monitoring foot movement. This approach could eliminate the need for mirrors and enhance the overall efficiency and versatility of our system.
  2. Challenges with Mirrors and Low-Light Conditions: The feedback points out the limitations of using mirrors, particularly in low-light conditions. Exploring alternative solutions such as utilizing phones as cameras may offer a more practical and adaptable approach, potentially mitigating the challenges associated with mirrors.
  3. Addressing Toe Arthritis and Touch Typing Challenges: A main feedback and concern from the audience and our instructors was the possibility of toe arthritis and the difficulty of touch typing on a touch screen.  Key guards with a touch screen may offer a solutions – we will explore this further with Anita.
  4. Exploring Different Text Input Methods: In addition to keyboard and touch screen, there are alternative ways to type such a voice, such as voice recognition or other innovative approaches that cater to different abilities and preferences.
  5. No Hands Mouse and Gesture-Controlled Keyboard: The feedback prompted exploration into no hands mouse options and gesture-controlled keyboards, indicating a broader consideration for users with varying levels of physical mobility. This aligns with the overarching goal of creating a universally accessible system that caters to diverse user needs.

Feedback based progress:

Significant progress has been made in our efforts to enhance Jessica’s typing experience, with a focus on developing a customized solution tailored to her specific needs. One notable achievement is the successful coding of a keyboard simulator, designed to visually display the keys being pressed in real-time. This simulator serves as a valuable tool in understanding Jessica’s typing patterns and preferences.

In addition to the keyboard simulator, our team has been diligently working on a touch screen keyboard that goes beyond standard customization. This specialized keyboard will be crafted to cater specifically to Jessica’s requirements, providing not only visual but also tactile and haptic feedback reminiscent of a traditional physical keyboard. This innovation aims to bridge the gap between the digital interface and the tangible feel of typing, thereby hoping to enhance Jessica’s overall typing experience.

Recognizing the importance of collaboration and seeking expertise, we have taken proactive steps by reaching out to a contact within Apple. Our objective is to establish a connection with the accessibility team at Apple, exploring the possibility of collaborative efforts in designing a keyboard tailored for iPad users with unique needs. This strategic outreach aligns with our commitment to leveraging industry expertise and resources to create an inclusive and effective solution for this project.

As we continue to advance these initiatives, our goal remains to seamlessly integrate technology and accessibility, ensuring that Jessica has a personalized and empowering typing experience on her iPad. We will also continue to improve upon her current setup andiwork wit a physical keyboard too.

Weekly Update 3: 10/31/23

Overview & Competitive Analysis

Who is Jessica?
Our team is working with Jessica Cox, who was born with no arms due to a rare congenital limb difference. She can type 25 words per minute, using her toes. Jessica uses a mechanical keyboard. In the past, she’s tried several alternative options but they have caused her strain.

What are Jessica’s needs i.e. our goals
We want to eliminate, or at least reduce, her back and neck pain caused by having to look down at the keyboard. We also want to prioritize physical support for the main muscles used while typing like the thighs, calves, and ankles. We are also exploring alternative versions of a computer mouse.

What’s our project: pain points addressed vs not

  1. Customizing a touchscreen keyboard, making the keys bigger with haptic feedback, and elevating the tablet so she can see the keys she’s typing with ease.
  2. Having a simulation of the keys she types in real-time. 
  3. Using mirrors to see the reflection of the keyboard so she doesn’t need to look down.

What exists in the market today?
Foot pedals for typing are used to alleviate pressure but they can’t be used as a replacement for the keyboard. 

A trackpad is a good replacement for a traditional mouse since it can be flat on the ground. It also doesn’t need to be moved around and is touch-sensitive. Neck cradles can alleviate neck strain and voice-to-text can be used as an alternative to typing.

Some research talks about creating larger touch surfaces – like turning the floor into  a touchscreen that in turn can be used as a keyboard. There’s also work on using foot gestures to replace some keys and novel layouts to make typing easier and faster. 

 

Weekly Update 2: 10/24/23 (Competitive Analysis)

Existing Technology Solutions

Papers

  • Augsten et. al paper talks about a shoe design that detects motion at high precision. It focuses on creating larger touch serves by integrating high-resolution multitouch input into a back-projected floor.
    • Saunders et al paper explores the use of foot gestures – as a way to  enable primary foot-only application control and use of mouse and keyboard. This encourages physical activity while performing these tasks.
    • Protim et. al paper proposes a keyboard for disabled people namely BADHON specifically focusing on thumb & ankle movement for faster typing.
    • Turpin et. al  explored and researched 14  alternative computer input devices suitable for people with disabilities and to provide comparative data.

Weekly Update 1: 10/17/23 (Goals)

  • Meeting # 1 / Team Name: ToeTapText

    Group Members:

    • Aliza Habib, M.P.S.Interactive Telecommunications, NYU TISCH.
    • Kisha Ravi, M.S. Integrated Design and Media, NYU Tandon.
    • Both Aliza and Kisha will communicate with Jessica and Patrick. This can be adjusted if required.  

Jessica was born with no arms due to a rare congenital limb difference. She can type 25 words per minute, using her toes on the home keys. Jessica shared her relationship with typing– she first started and learned typing in the 7th grade. She demonstrated how she types with her toes on the home keys and the rest of her fingers gliding over the keyboard. This helped to understand her typing methodology and how we can design to best fit her needs.We discussed two focus areas:

  1. Back and neck strain and pain caused by having to look down at the keyboard as she types.
  2. Exploring alternative versions of a computer mouse as the current versions are not optimized for users that operate a computer mouse with their feet.
    • Abilities & Challenges:To address the pain and tension in Jessica’s shoulders and back, we discussed exploring different methods including a neck cradle and posture corrector. We also went over her current abilities and method of typing with a focus on what muscles are more engaged.To provide us with a better understanding of these options, she generously shared her experience with different products she’s tried. This allowed us to gain valuable insight into the effectiveness and her comfort with these solutions.We brainstormed ideas that could help craft a chair for optimal support and posture. Among the various chairs she has experimented with, she highlighted the current chair she’s using. This chair has proven to be significantly beneficial in providing support to her thighs while she types.

Conceivable Proposals: 

  • Mirrors: Mirrors can help Jessica see the keys without having to look down, allowing her to maintain better posture and reduce the strain on her neck. The low-tech option seems accessible and feasible and could be implemented at schools and organizations that may not have easy access to hi-tech solutions.
  • Touch Screen Keyboard: A touch screen with haptic feedback could provide tactile sensations to simulate the feeling of pressing physical keys. This option could help Jessica customize the spacing and size of the keyboard to her liking.