HPC at Autodesk

by savin-goyal on 10/2/2023, 5:57:25 AM with 27 comments

  • by mgaunard on 10/3/2023, 8:35:03 PM

    In my experience ray in AWS is a good way to badly utilize resources and waste a lot of money (as is generally anything cloud or anything python; when you do both it multiplies).

    I'd rather have a real HPC cluster.

  • by kristianp on 10/3/2023, 9:47:55 PM

    Actual title: Autodesk and Outerbounds Partner to Open Source Ray and HPC Integration in Metaflow

  • by JamesCoyne on 10/3/2023, 7:29:34 PM

    Can anyone speak to the general appetite at Autodesk for open-source projects?

  • by riedel on 10/3/2023, 7:37:04 PM

    I do not quite get this. How does this enable someone to run ray or metaflow on a typical batch scheduled HPC system (slurm or alike)? Inter node communication is done via the lustre file system, right?