• beardown@lemm.ee
    link
    fedilink
    arrow-up
    0
    ·
    3 months ago

    But it says next to nothing about how reliable the LLM as an actual doctor.

    Yet these tests say anything about how a human would be as an actual doctor?

    • loathesome dongeater@lemmygrad.ml
      link
      fedilink
      English
      arrow-up
      0
      ·
      3 months ago

      It says as much as it does for an LLM but doctors have to have a lot of field experience after passing these tests before they get certified as doctors.

      • beardown@lemm.ee
        link
        fedilink
        arrow-up
        0
        ·
        3 months ago

        Then we should remove such tests and, if anything, increase such field experience

          • beardown@lemm.ee
            link
            fedilink
            arrow-up
            0
            ·
            3 months ago

            Because clearly passing such tests doesn’t matter. If it did matter then it would be noteworthy and have implications for the labor value of doctors that gpt could pass the tests to a better extent than many of them

            • loathesome dongeater@lemmygrad.ml
              link
              fedilink
              English
              arrow-up
              0
              ·
              3 months ago

              Tests are meant to gatekeep who gets to get the field training required to become a doctor. Sending every jabroni into residency willy-nilly is probably gonna collapse the healthcare system completely.