Guilherme Rambo

An app I’m developing, tapAudio does similar thing. It gives haptic feedback on the bass or on certain sound of the music based on osu beatmap

Cool. I did something similar for the intro that plays in the onboarding of ChibiStudio 2.0

Unfortunately I’ve found that there can be unavoidable delays when using the Taptic Engine, especially with repeated haptics (any way to avoid this?)

6s will always get the delay due to its first gen Taptic Engine...

How do you get the haptic engine to play music? The API let you send a specific frequency?

hes jailbroken (I assume) and sending signals to the taptic engine directly (since he is jailbroken he can bypass sandboxed apis and just ask the taptic engine directly)

Ah, got it.

Basically that. There are APIs to tell the Taptic Engine to play a waveform (that’s what the OS uses for normal haptic feedback)

So cool. Throwing music at it was a great idea!

And that’s why we gave up the headphone jack for a bigger Taptic Engine

That’s sounds... way better than I thought it would

This

I guess one could use this to develop a music player for deaf people. Or even something that takes the audio from the mic, to help them "hear" the sounds around them.

deaf people can't hear through their hands.

By "hear" I mean that they'd be able to perceive sounds as vibrations.

they could hear that there's a sound, but they wouldn't be able to hear frequency accurately, and the whole thing with overtones, which hearing relies on, wouldn't work. formants would just be math.

But some deaf people - myself included - may have a good recollection of how the music sounds. The haptics would help to... trigger the memory, if that makes sense. I’ve found that with some Switch games. I can’t hear anything, but the vibration triggers a sound memory of sorts.