• 0 Posts
  • 1.61K Comments
Joined 3 years ago
cake
Cake day: July 9th, 2023

help-circle

  • I drafted several local-only designs for testing these models and that estimate looks about right (for sharding only, where most ancillary strategies come with some pretty big tradeoffs).

    It turns out the actual answer in practice is specialized private compute rental, meaning the actual hardware is generally shared. That made a lot more sense to me once I had an intuitive grasp of the fact that every second of idle time on a platform capable of running these bigger models well remains an intolerable expense, simply because they are built for specialized enterprise data center infrastructure.

    Put another way, to host locally you would end up needing to rent the idle time in order to make the infrastructural investment make sense financially, at which point you’re running your own data center and arrive at essentially the same destination.


  • Well-outside my wheelhouse mate, but since it’s been 3 days I’m likely all you’ll get…

    Patellar reflex.

    It’s a [muscle] stretch [-correction] reflex (sympathetic response) which occurs in the bones protecting the spinal cord (vertebrae depicted in OP) of many animals that have them.

    Your doctor activates this reflex on purpose by gently striking an exposed tendon beneath the patella (the knee bone) to observe the strength of the response.

    A lack of it (the joke above) is always abnormal and merits further investigation, as it could suggest neuropathy or injury to the central nervous system.