The Inference Shift

(stratechery.com)

14 points | by swolpers 10 hours ago

2 comments

  • perarneng 32 minutes ago
    If it's that much faster then perhaps it can come up with 10 solutions and rank them and still have a total better performance than a larger LLM.
  • moveax3 10 hours ago
    [dead]