Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The magic of test time inference is the harness can improve even if the model is static. Every task outcome informs the harness.
 help



> The magic

Hilarious that you start with that as TAO requires

- Continuous adaptation makes it challenging to track performance changes and troubleshoot issues effectively.

- Advanced monitoring tools and sophisticated logging systems become essential to identify and address issues promptly.

- Adaptive models could inadvertently reinforce biases present in their initial training data or in ongoing feedback.

- Ethical oversight and regular audits are crucial to ensure fairness, transparency, and accountability.

Not much magic in there if it requires good old human oversight every step of the way, is there?


Goalposts wooshing by at maglev speed.

Of course it needs human supervision, see IBM 1979. Oversight however doesn’t mean the robots wait for approvals doing r&d and that’s where the magic is - the magic being robots overseeing their training and improvement of their harnesses.

IOW only the ethics and deployment decisions need to be gated by human decisions. The rest is just chugging along 1% a month, 1% a week, 1% a day…




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: