3 comments

  • baalimago 0 minutes ago
    > "large large language models"
  • augment_me 35 minutes ago
    Quirks from the article:

    1) The performance numbers are simulated

    2) The details say that the performance numbers require 2.7x the overall power, so around 13.5W. Power needed for all the memory is not explicit in the numbers.

    3) The compiler is also simulated and it's a prototype, so it's not a drop-in replacement for anything like Nvidia ISAAC

    4) 5W seems to refer to sub-4B models, so not the 100B param ones.

  • tensward 59 minutes ago
    Wonder how it would feel because the details shown seems a bit slow to edge device use