Does Triton support the installation on Nvidia Jetson aarch64?

[EddyGogogo]

I need to install Triton on Nvidia Jetson, but I couldn't find the aarch64 version. Could you please tell me if there is any installation method available currently?

[Jokeren]

aarch64 is supported.

Can you compile from source?

[EddyGogogo]

Is there a whl installation method?
I used compilation, but it conflicted with my local package and the compilation failed directly.

aarch64 Is there another way?

[Jokeren]

In theory if you install pytorch nightly the pytorch-triton shipped with it should be compatible

[malfet]

In theory if you install pytorch nightly the pytorch-triton shipped with it should be compatible

I don't think this work is done yet, as pytorch/pytorch#130558 is still open
Moreover, this will make it available for something like Grace Hopper, but Jetson is a really tiny device with a somewhat old toolkit, so I'm not sure if it'll work out of the box

[Jokeren]

hmm that's weird, pytorch-triton works for me well on my GH200

[Jokeren]

Oh, I get it now. It seems like installing aarch64 torch by default doesn't install triton for now, but I recompile triton from source every time. So this hasn't been a problem for me. Thanks @malfet for correcting me.

[EddyGogogo]

I compiled and installed triton in jetson agx orin, but it didn't work and there was no acceleration;
Is it a version problem? Or is triton not supporting aarch64?
What's the reason? @Jokeren @malfet

[Skylion007]

In theory if you install pytorch nightly the pytorch-triton shipped with it should be compatible

Is not even built for CUDA 12.6? We should support it now with the ManyLinux upgrade it, right?