by ltrg 10 hours ago

I was involved with this project as a reporter, though others from my organisation did most of the work.

HN readers may be interested to know a bit about the tech stack. The 15 million or so documents, mostly Outlook mailbox exports, were provided to partners in the consortium via a tool called OpenAleph [1], which is maintained by DARC and based on ElasticSearch and a schema called FollowTheMoney [2], developed specifically for the investigative journalism use case. A lot of the original work on this was done by Friedrich Lindenberg (@pudo), who now runs OpenSanctions [3].

The timing was v. interesting given where we are with LLMs -- it's the first major leak I've worked on where it was possible to leverage local models to do some of the heavy lifting, and this only got more possible as the project went on. The coordinators provided a centrally hosted chatbot with RAG, but I also managed to get some surprisingly useful material using Qwen3.6-35B-A3B on my 24GB M2 MBA via a custom agent harness for Aleph/OpenAleph. [4]

Happy to answer any questions about techy stuff, though I'm not a spokesperson for the project by any means. Seen a few people saying "just release the data!", but I think that slightly misunderstands what this work is. The whole point of forming a consortium of hundreds of journalists and sifting through the dump is to identify the bits that are in the public interest to report on -- especially important in jurisdictions like the UK, where I'm based, which have very strong defamation laws. Think Panama Papers, not Wikileaks.

[1] https://darc.li/openaleph/ [2] https://followthemoney.tech/ [3] https://www.opensanctions.org/ [4] https://github.com/data-desk-eco/sift

holgerschurig 7 hours ago

> maintained by DARC

DARC is the german ham radio club, equivalent to use US' "ARRL". It stands for Deutscher Amateur Radio Club. It's in use since ... probably right after WW2 then ham radio was again allowed in Germany.

This is the reason why their web address is darc.li, because darc.de is used by the ham radio people.

And if I read their impressum right, they aren't some "Data and Research Center", they are "IDIO Daten Import Export GmbH" based in Berlin.

Weird.

noman-land 7 hours ago

Curious how, specifically, you wove the local models into your process. Were you using them in agentic harnesses? Were they writing code or analyzing text themselves?

Also, presumably you used local models so the stories wouldn't leak via cloud providers but do you mind spelling out the specific value proposition local models gave you, for the benefit of the global audience reading these comments.

  • ltrg 6 hours ago

    I started off just running Qwen in hax [1], a minimal coding harness, and having it use the OpenAleph API to read documents (Aleph does OCR already), emails, etc. in a free-form session based on hypotheses I had -- kind of like a smart search engine, but context length was limited so these stalled early. I then used Claude to write a harness in Swift (CLI/menu bar app, see above) that uses one model session to queue a load of tasks for short follow-ups, followed by summarisation, which generated pretty useful Markdown reports on my queries, with links through to Aleph for the originals. These mostly related to the bank's involvement with the oil and gas industry (the focus of my research).

    On the value prop of local models, it's very important with projects like these to have the data touch the absolute minimum number of machines, both for security against leaks and subpoenas as you say, but also to demonstrate responsible handling practices in case of legal pushback from the subject of the investigation.

    https://github.com/OleksandrChekhovskyi/hax

mlmonkey 9 hours ago

> especially important in jurisdictions like the UK, where I'm based, which have very strong defamation laws.

So, naturally, will you not err on the side of caution and not say anything that could remotely be used to file a defamation case against you? You will self-censor for the exact reasons you state!

UK is not a domain of free speech. People are being jailed for SM posts[1]. And you expect UK journalists to speak freely?

[1] https://www.forbes.com/sites/steveforbes/2025/09/09/people-a...

  • pnut 9 hours ago

    I'm not reading any US based journalists' comments about participating in this project, so why the nationalist slander?

    • mlmonkey 9 hours ago

      There is no "nationalist slander", I'm just responding to what they wrote.

      • ltrg 8 hours ago

        To be honest, you're absolutely right that draconian libel and defamation laws like we have in the UK have a chilling effect on freedom of expression, e.g. via SLAPPs. [1] But that is of course balanced against the journalist's incentive (career, love of the game) to publish the best story they can get. I've personally never experienced a situation like you describe, where less interesting stories are selected to 'play it safe'. What you'll often see instead are big stories that read a bit weirdly, or seem to lack some crucial explanatory detail, because they've been pared back by media lawyers.

        [1] https://en.wikipedia.org/wiki/Strategic_lawsuit_against_publ...

  • lentil_soup 9 hours ago

    I read that as, dumping a bunch of raw data without context with names of people that might or might not be bad actors can lead to defamation lawsuits in places like the UK

    • mlmonkey 9 hours ago

      I'm no lawyer, but here's what I think: just like the "safe harbor" provision protects carriers, if the raw data is dumped then there's some possibility of "safe harbor"-style protections; if, on the other hand, you offer up your interpretation of the data, then you open yourself up to lawsuits.

    • ltrg 8 hours ago

      This is exactly what I meant, thank you. There is also data protection law to consider -- we have our own version of the EU GDPR (regrettably).

    • user00005 7 hours ago

      Isn't that what people want with the Epstein files?

  • Nursie 2 hours ago

    That article is pretty bad.

    It harps on about the old canard that a politician’s wife being arrested/sentenced for a social media post - yes, one in which she directly incited the burning down of hotels full of refugees with them inside.

    Linehan’s case was indeed police overreach, and the courts supported him and have awarded him damages.

    And yes, the UK has restrictions on what people can do around abortion clinics after years of campaigns of harassment of women masquerading as protest.

    While the UK does have problems, this sort of hysterical write up is worthless to actually understand anything, and seems only to exist to try to make right wing Americans feel good about themselves, which they really shouldn’t be doing right now. You want to talk about “moral decay” like that article? Perhaps remove the beam from your own eye first.