���ճԹ�51

The was the very first device in the Makers Making Change library. In fact, it inspired the whole Makers Making Change movement — open source designs for assistive technology that could be built by makers for just the cost of parts for people with disabilities who need them.

And the LipSync has served our community great. Since our first public build event nearly seven years ago, over 1,400 LipSyncs have been built and deployed to users all over the world. These devices have helped people with limited mobility access their phones, computers, gaming consoles, and much more.

Based on feedback from users, clinicians, and makers, we incrementally improved the original LipSync design and software over the years. But it was time for a bigger upgrade.

For the fourth iteration of the LipSync, we’ve completely re-designed it from the ground up, with new hardware and new software. It is now easier to use, easier to build, and provides greater user independence.

Highlights

The new version of the LipSync features several exciting changes:

• A two-part, modular architecture featuring the LipSync Joystick and LipSync Hub.
• An easier to move, more reliable joystick (80% less force!)
• User adjustable settings via a modular Hub with a visual interface.
• User switchable operating modes (USB Mouse, Wireless Bluetooth Mouse, or USB Gamepad).
• Compatibility with PC, Mac, Android, and iOS operating systems.
• Compatibility with the Xbox Adaptive Controller for adapted gaming.
• Three integrated ports for connecting assistive switches.
• Buttons on the modular Hub for alternative access from a support person.

The LipSync Joystick

The new Joystick features a new, completely re-designed magnetic joystick, a softer, more comfortable mouthpiece, and a rotatable mount. All of this is housed in a customizable 3D printed enclosure.

In the original LipSync design, a big issue for many users was the joystick itself. A major part of that was cursor drift — the cursor continuing to move even when you don’t want it to. The stiffness of the joystick also caused problems for a lot of users — the amount of force needed to move the mouthpiece was causing some users fatigue, while some people couldn’t even use it due to the strength required.

We were able to reduce the operating force and reduce drift by replacing the force sensitive resistors (FSRs) in the original design (left in the image below) with a new joystick based around a 3D magnetic sensor and rare earth magnets (right in the image below). The 3D magnetic sensor precisely measures the position of the magnet as it moves with the mouthpiece. And instead of springs to keep the joystick centered, the new design uses a second pair of magnets.

There are numerous advantages to this new approach. The force required to deflect the mouthpiece by the user has been reduced from 300 grams-force to 50 grams-force (about 80%). This reduction will make the joystick easier and less likely to cause soreness or fatigue for all users and make the new LipSync an option for those who weren’t able to use the stiffer one.

The digital magnetic sensor will significantly cut down any cursor drift. And the movement is more consistent, something you’ll particularly notice with circular and diagonal movements.

In another important improvement for user comfort, we’ve switched up the mouthpiece with a flexible, softer, more comfortable mouthpiece tip.

You’ll also notice that the new enclosure is rotatable, allowing you to mount the LipSync from any angle that you need. For some users it’s more convenient to mount it upside down or from the side. With the new rotatable case, the mount can be attached at any angle, and the LipSync can be rotated so that the “up” direction on the joystick matches “up” on the screen.

The Brand New LipSync Hub

Perhaps one of the first things you might notice with the new LipSync is that there are more components, the LipSync Joystick, and the brand new LipSync Hub.

One of the big goals of re-designing the LipSync from scratch was to take advantage of the technological advancements that occurred over the last eight years since we first designed the open source LipSync. In the original hardware, we used about 96% of the memory, leaving little room for adding new features or complex coding. It also meant that we had to have different versions of the LipSync — we couldn’t fit gaming mode and mouse mode on the same device, hence the previous different versions for adaptive gaming and using your devices.

However, as we began working on the prototype for the fourth LipSync, the LipSync head simply became too big. It was difficult to mount due to its weight and the joystick force required, it was bulky and uncomfortable, and obstructed some users vision of their screens.

The solution was to separate much of the hardware into a separate LipSync Hub.

The new Hub allows you to switch between modes — as a USB mouse, wireless mouse with Bluetooth, or as a USB gamepad for adaptive gaming — as well as jacks for assistive switches, allowing users who can’t use sip and puff an alternative input method.

Now, instead of needing to choose which LipSync you need, or having multiple different LipSyncs, it’s all in one device.

Another important goal was increasing user independence.

Previously, to calibrate the LipSync, or change the cursor speed, you had to press buttons on the back of the LipSync enclosure, something that is impossible for many LipSync users and required help.

With the LipSync Hub, the user can now adjust several settings independently using sip and puff. Through a menu displayed on the Hub, a user can calibrate the LipSync, change the operating mode, adjust key settings such as the cursor speed or sip and puff sensitivity, and reset the device. The menu can also be navigated using the buttons on the Hub, or through assistive switches attached to the Hub.

Buildability

Like the other Open Assistive Technology (OpenAT) devices in our library, the LipSync is intended to be built as do-it-yourself, or do-it-together project by users and/or volunteer makers. We’ve made several improvements to make this version of the LipSync easier to build.

One of the first things we learned early on when we began hosting build events in 2017, was that certain parts of the LipSync build were quite challenging. And over the years, it has become more difficult and more costly to source some of the parts for the original design, with some of the parts now discontinued.

We’ve removed some of the big sticking points for makers. The fragile force-sensitive resistors have been replaced with the new magnet sensing system. We’ve reduced the custom circuit boards from three to one, and all of the soldered components are thru-hole. There are no more tricky surface mount components to solder — this design takes advantage of off-the-shelf STEMMA QT development boards for some of the tiny components. These STEMMA QT boards are then connected by cables. You can also say goodbye to the baby powder and superglue. An easier process will result in more successful builds.

All of the parts can be sourced from two suppliers, greatly reducing shipping costs and delivery time for parts.

In all, this new LipSync can be built for about $350 for a single unit, or for about $170 if you’re making multiple and buying components in bulk. (The old LipSync could be made for about $400, but that’s before shipping from multiple suppliers).

The Future

The files and documentation for the new LipSync are now available .

Over the next few weeks, we’ll be building and delivering the new LipSync to a group of initial users and continuing with internal testing as we continue to refine the device. We’ll also be sending a couple units to each of our , rehab centers, and other partners.

We also have a limited number of units available at reduced cost for Canadians with disabilities through funding by the Government of Canada’s Innovation Science and Economic Development Assistive Technology Program through to the end of March.

Need a new LipSync? to be added to added to the waitlist.

Previous Designs

We’ve retired V3.0 of the LipSync (renamed to ), , , and , as well as the . The files and documentation will remain publicly available on GitHub, but these devices will no longer be available for build requests through our library.

Open Source Hardware

The LipSync is Open Source Hardware – the design is publicly available such that anyone can make, modify, distribute and use it. Like the original 3D printed LipSync, the latest version has been released with open source licenses. This version has also been certified as Open Source Hardware by the Open Source Hardware Association under the .

Acknowledgements

The development of the LipSync has been made possible through contributions from a variety of sources, including funders and donors; users, clinicians, and volunteer makers; and the larger open source community.

The initial development of a 3D printable LipSync was financially supported by the Google Impact Challenge: Disabilities grant from Google.org. Further development was supported through the Government of Canada’s Innovation Science and Economic Development Assistive Technology Program. These and other funders and donors have also enabled Neil Squire’s Makers Making Change program to deploy numerous LipSyncs to users at reduced cost.

The latest design incorporates feedback and suggestions from numerous users, clinicians, and volunteer makers. This design also incorporates several open source hardware components and software libraries that have been developed and shared by the open source community.

A huge thank you to everyone who has supported the development of the LipSync and helped make this device available for those that need it.