Notes
Mostly a scratch space for me. I will try to populate this with my thought on papers, ideas, topics etc. Hopefully I am more frequent than I expect myself to be! Best read on a laptop!
Adative Data Selection with Gradients
Paper: LESS: Selecting Influential Data for Targeted Instruction Tuning
— Xia et al.
Pretty cool to see the selection dynamics when the proposed method is used for Active Learning.