• 0 Posts
  • 127 Comments
Joined 1 year ago
cake
Cake day: June 16th, 2025

help-circle













  • LLMs are fundamentally limited, because ‘what’s the next word’ shouldn’t work.

    Yes, you’re right. However, for fear of coming off as an AI sycophant (I’ve yet to sacrifice my brain at the altar of our future AI overlords), LLMs aren’t the whole picture. Plenty of research is dedicated to essentially combining the best of each class of AI algorithms into a composite model of intelligence. For instance, “Neuro-Symbolic AI” is really just the result of giving an LLM (good at translation, search, synthesis, bad at symbolic reasoning) a symbolic inference engine like Prolog (good at symbolic reasoning, no native ability for translation/search/synthesis). I’ve been coding for over 20 years, and I’m impressed at its results for software development.

    This all is reminiscent of Moore’s Law; even though we keep running into the physical limits of CPU clock speeds, transistor size, etc. we keep finding clever ways to work around those limits.

    Of course I’m not saying we should; these models are, after all, models of intelligence, not wisdom.

    Edit: fix apostrophe splice



  • ExFed@programming.devtoAsk Lemmy@lemmy.world*Permanently Deleted*
    link
    fedilink
    arrow-up
    70
    arrow-down
    1
    ·
    2 months ago

    Trains in North America.

    We had them at one point, built the nation with them, then so summarily decided that the automobile was better, that we built all of our infrastructure assuming that nobody would ever not want a car to go everywhere, making it doubly hard to convince people that public transit doesn’t have to suck.