• 0 Posts
  • 7 Comments
Joined 10 months ago
cake
Cake day: April 8th, 2024

help-circle

  • Tom Goldstein, a computer scientist at the University of Maryland, and his colleagues added a twist to how they presented numbers to a transformer that was being trained to add, by embedding extra “positional” information in each digit. As a result, the model could be trained on 20-digit numbers and still reliably (with 98% accuracy) add 100-digit numbers, whereas a model trained without the extra positional embedding was only about 3% accurate.

    So they had an idea on how to fix a completely dysfunctional method and their result is, that a computing task that we can perform automatically and with 100% accuracy for 80 years or so, using a different and well understood method, can now be done at much higher energy costs using said inadequate method with 98% accuracy.

    Why are these people still receiving research money?




  • chaitae3@lemmy.worldtoMicroblog Memes@lemmy.worldMeat bags
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 month ago

    Yeah well and ideas occur to you after you’ve experienced something and by proxy that is one reason why people will always put their own basic needs above some abstract idea of a better world and everything. As opposed to “just think about a better world and talk about it and people will believe in it and fight for it”. Which doesn’t work, in case that’s news to anyone. Although in the 1840s, it really was.