• JohnEdwa@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    5
    ·
    14 hours ago

    OpenAI isn’t running ChatGPT on RTX 5090’s, they use data centre hardware like the nVidia NVL72, which are entirely useless for anyone else. You wouldn’t even be able to boot it as it uses more power while idling than a residential home has access to, and up to 150kW at full load.

    • GamingChairModel@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      13 hours ago

      up to 150kW at full load.

      That’s the last generation. They’re moving from Blackwell to Rubin chips now, and the 72-GPU Rubin servers use up to 230 kW.

      The typical residential connection in the U.S. has a 24 to 48 kW electrical connection. A block of houses might not have enough power infrastructure to power just one of these server racks.