HID multitouch display support in JavaFX

jfx user2 jfxuser2 at gmail.com
Thu Aug 20 03:09:54 UTC 2020

HID support specifically would be good b/c there seem to be lots of cases
where the OS's are properly recognizing HID compatible displays with touch
events working through the HID APIs but do not work in JavaFX since it
relies on the OS's (native?) support.  For example, I have multiple HID
displays that work as HID devices on MacOS, Windows, Linux (Mint and Ubuntu
at least), and Raspberry Pi.  But they fail to work in JavaFX except on
Windows and sometimes on the Raspberry PI (except you have to run as root).

Direct HID support in JavaFX seems like a viable solution to cover more
displays on more OSes and bypass the overhead of installing a separate
driver that pipes HID events into the OSes touch interfaces.

If someone who understands the touch support in JavaFX today could comment
that would be great.  Touch is critical for the majority of targeted
devices (Android, iOS, Pi, and hopefully... Apple Silicon).  HID support
would expand the ability to test rapidly on existing desktops apart from
Windows only.

Also, is there a specific GTK issue on Linux b/c I could have sworn HID
displays were working fine awhile ago (doesn't work on latest Mint for

On Wed, May 13, 2020 at 5:17 AM Michael Paus <mp at jugs.org> wrote:

> Having proper and consistent Multitouch support on all platforms is
> certainly
> an interesting goal, especially if your development is targeting a
> mobile platform. If one
> could test the input behavior already on the desktop, this would be an
> enormous time saver because the turn-around times
> (edit-compile-build-deploy-debug-curse)
> for mobile are currently still extremely high and thus not very
> development-friendly.
> I learned from your mail that the situation on Windows seems to be better
> than on macOS, which is my current development environment. That gives
> me an idea :-)
> Am 13.05.20 um 10:15 schrieb jfx user2:
> > Nobody is biting... so is anyone else out there interested in using HID
> > touchscreens with JavaFX on OSX (or any other plaform) without using a
> > third party driver?
> >
> > On Fri, May 8, 2020 at 4:18 AM jfx user2 <jfxuser2 at gmail.com> wrote:
> >
> >> Multitouch display support JavaFX on Windows, iOS, and Android seems
> >> straightforward.  If the OS recognizes the display as multitouch, then
> the
> >> chances are that JavaFX will also work with it since it relies on the
> >> native multitouch support of the OS.
> >>
> >> When it comes to Linux and OSX, it's not always as easy.  Linux
> sometimes
> >> requires device mapping.  I'm not sure if it works at all in OSX unless
> you
> >> have specific drivers for the display.
> >>
> >> All of the platforms seem to support HID so maybe JavaFX could have
> direct
> >> support for HID devices (optionally) if they are present instead of just
> >> the current method.  It may also improve performance in cases where the
> OS
> >> is just piping HID events through their own API's to support multitouch.
> >> Why not just go straight to the HID source and bypass that conduit.
> >>
> >> This would vastly improve multitouch app development on OSX.  It would
> be
> >> possible to connect a HID display and use it for testing apps that are
> >> destined for platforms that formally support multitouch.
> >>
> >> Is there any work being done in this area?  Is there a bigger picture
> >> (e.g. better multi-display and connect/disconnect support in JavaFX)?
> >>
> >> ... coming from a frustrated OSX user with lots of HID displays and no
> >> easy JavaFX support.
> >>
> >> https://www.usb.org/hid
> >>

More information about the openjfx-dev mailing list