OR has some very interesting algorithms for very interesting problems. I don't do research on it anymore, but going to OR conferences was always interesting. Good mix of practitioners, researchers and end users. I'm way behind SOTA now, but I have a soft spot for evolutionary algorithms.
Can I say this seems to be fantastic work. I cloned your repo earlier today after seeing it on the tokenization discord. I know everyone in the tokenization community wants to absorb the lessons of how you got such a speedup. The caching and replacing the regex for pretokenization seem like generally useful ideas.
And screw all the 0.1% haters on here, this is great stuff.
Thanks for the kind words, Craig! I'm planning to do a technical writeup+paper and a presentation video on the project in the near future. Will make sure to share it with the Discord!
I’m not sure why you think this is ai slop. I work on tokenization research full time. My name is Craig Schmidt and I have a number of papers in the field. This researcher has done some very impressive work and I’m trying to defend him from the HN dismissive hoards.
There is a serious research community on tokenization, and we are quite interested in this work.
Which part of “doesn’t seem to be aislop signs” made you think I believe your comment was aislop?
As I said, It just might be the low information density approach to talking recently that seems off to me.
To explain a bit more, I kept reading and waiting for the penny drop but nothing.
“I cloned your repo” — okay then what happened? Nothing? I put my shoes on this morning.
“I know the tokrniziation community wants to absord tje lessons” okay? Tell me the point please! I know the AI community wants to understand the universe.
“These are useful ideas”. Yes.
Of course, you could argue that my comment falls in the same category in the sense that I am not actually contributing to the topic at hand but I am peeved with all low the information noise.
It is a recommendation system for new papers that come out each day. If you train it a bit by specifying what you like and don't like you'll get a pretty reliable feed.
It all depends on where you get your news. You need somewhere that puts things into context so you can understand why things are happening. Personally I really like the Economist. The weekly pace of publication also encourages analysis over “Trump puts tariffs on soybeans” headlines. News for smart people.
I'm no expert, and don't know if it applies in this case, but for a cancer I had (lymphoma) I was told that aggressive can often be easier to treat or "cure" (as defined by survival rates, etc.) since it also can often be hit more brutally by the treatments.
Anyway, since many in my family have died from this horrible cancer, its fantastic news to hear of any improvements there.
Sorry, it does not apply ... this drug inhibits (for the first time) the KRAS mutation (previously considered "undruggable") that is the primary cause of 90% of pancreatic cancers and 50% of colon cancers.
Lymphoma is a bit of an outlier. In the case of lymphoma, more aggressive types indeed respond better to treatment, and given that we are now fairly good at treating lymphoma, that translates to good outcomes.
Those are not global students. Those are people who are already living in the state. Foreign students typically pay the most tuition possible with no financial aid, subsidizing everyone else.
so all those foreign students could become "not foreign" by merely coming here for a tourist visit and overstaying? Quite the idea. I will suggest to a few college-age friends to claim to be illegal. Why pay more when you can pay less? Plus, there is no way to verify a LACK of citizenship or of SSN.
There are equal weight S&P ETFs, which avoid having a handful of stock dominating. However, they do have to do a lot more rebalancing to keep things in line.
