OK this thing is totally insane. Before going to bed I…

• used try to make a new qmdresearcher directory
• told my pi to read this github repo and make a version of that for the qmd query-expansion model with the goal of highest quality score and speed. Get training data from tobi/qmd github.
• woke up to +19% score on a 0.8b model (higher than previous 1.6b) after 8 hours and 37 experiments.

I’m not a ML researcher of course. I’m sure way more sophisticated stuff is being done by real researchers. But its mesmerizing to just read it reasoning its way through the experiments. I learned more from that than months of following ml researchers.

I just asked it to also make a new reranker and its already got higher base than the previous one. Incredible.