There seem to have been a lot of attempts to support GPU programming from Java and they always so far struggled to get adoption. HAT and TornadoVM look great, and it would be exciting if they took off. It's very impressive that TornadoVM in particular apparently has implemented pure java versions of a wide range of quite current models for inference and claims near-to-native performance on them. It's hard though to pull the trigger on investing time in these until we see actual adoption and usage start to take off in a major project somewhere.
There seem to have been a lot of attempts to support GPU programming from Java and they always so far struggled to get adoption. HAT and TornadoVM look great, and it would be exciting if they took off. It's very impressive that TornadoVM in particular apparently has implemented pure java versions of a wide range of quite current models for inference and claims near-to-native performance on them. It's hard though to pull the trigger on investing time in these until we see actual adoption and usage start to take off in a major project somewhere.
Maybe this and TornadoVM will lead to a native torch on the JVM. One can hope.