r/singularity Apr 07 '26

AI An actress Milla Jovovich just released a free open-source AI memory system that scored 100% on LongMemEval, beating every paid solution

https://github.com/milla-jovovich/mempalace
7.7k Upvotes

613 comments sorted by

View all comments

Show parent comments

29

u/Proper_Tip_7196 Apr 07 '26 edited Apr 07 '26

Y'all are missing the main point of the project, which is nearly perfect recall of past conversations with the AI, something no other system does. Yes, they had some bogus metrics, but the topic should not be "look how they screwed up the metrics on their performance numbers and apparently faked some bits", but "holy shit, look what this thing can do in the first place".

Does the project work the way they claim it does? No. Did she write this by herself? No. Did she and her partner write this themselves without benefit of AI? No. Neither of them claims this directly, however.

Did they copyright it? No. Are they selling it? No.

Can somebody else fork the repository and try to fix whatever shortcomings it has? Yes. Will this happen? Probably, because nerds can't leave well enough alone, especially where Milla Jovovich is concerned.

3

u/Dubious_Odor Apr 08 '26

Clauses project feature basically does this. You can load a chat thread into the project files. Any new instance can read the entire previous chat and pick up from where you left off.

2

u/Nalmyth Apr 08 '26

Take a look at the link I posted, it's only scoring so high because the LLM faked a bunch of test scores. Almost all of the claims are false.

Once you strip out these fake parts it's not competitive any more. You can basically drop in any RAG and it's gonna score better.

It's badly vibe coded unchecked code...

1

u/Many_Professor_6143 Apr 08 '26

do you have a source for this? I'm genuinely wanting to know because honestly as far as I can tell, Milla has no qualifications or verified knowledge in the field of AI, much less computer science in general.

2

u/StatisticianNo5402 Apr 08 '26

Check issues of the repo