<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/"><channel><title>Science on alper.nl</title><link>https://alper.nl/categories/science/</link><description>Recent content in Science on alper.nl</description><generator>Hugo -- 0.165.0</generator><language>en-US</language><lastBuildDate>Sat, 13 Jun 2026 21:52:25 +0200</lastBuildDate><atom:link href="https://alper.nl/categories/science/feed.xml" rel="self" type="application/rss+xml"/><item><title/><link>https://alper.nl/posts/18879/</link><pubDate>Sat, 13 Jun 2026 21:52:25 +0200</pubDate><guid isPermaLink="false">https://alper.nl/posts/18879/</guid><description>&lt;p&gt;The value of real skills is going up day by day for those of us who have them.&lt;/p&gt;</description><content:encoded><![CDATA[<p>The value of real skills is going up day by day for those of us who have them.</p>
<p>Learning things <em>is</em> hard but that&rsquo;s the whole reason people go to universities. Nobody needs a university education to ask Claude to do their work for them.</p>
<p><a href="https://www.dailycal.org/news/campus/academics/failing-grades-soar-as-professors-see-greater-ai-usage-dwindling-math-skills-in-uc-berkeley/article_16fad0bf-02cb-4b8c-8d88-888ffd9f8608.html"  target="_blank" rel="noreferrer">https://www.dailycal.org/news/campus/academics/failing-grades-soar-as-professors-see-greater-ai-usage-dwindling-math-skills-in-uc-berkeley/article_16fad0bf-02cb-4b8c-8d88-888ffd9f8608.html</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/18784/</link><pubDate>Wed, 21 Jan 2026 22:49:40 +0100</pubDate><guid isPermaLink="false">https://alper.nl/posts/18784/</guid><description>&lt;p&gt;Psychedelics being responsible for humans developing quicker and smarter than other species is a delightful notion. The proof isn&amp;rsquo;t very solid, but that&amp;rsquo;s fine for a &amp;ldquo;notion&amp;rdquo;.&lt;/p&gt;</description><content:encoded><![CDATA[<p>Psychedelics being responsible for humans developing quicker and smarter than other species is a delightful notion. The proof isn&rsquo;t very solid, but that&rsquo;s fine for a &ldquo;notion&rdquo;.</p>
<p><a href="https://davidluke543044.substack.com/p/reawakening-the-stoned-ape"  target="_blank" rel="noreferrer">https://davidluke543044.substack.com/p/reawakening-the-stoned-ape</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/18256/</link><pubDate>Thu, 05 Jun 2025 22:22:58 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/18256/</guid><description>&lt;p&gt;For the many people who may not be intimately familiar with the workings of Turing machines, this visual and interactive guide should get them up to speed really nicely.&lt;/p&gt;</description><content:encoded><![CDATA[<p>For the many people who may not be intimately familiar with the workings of Turing machines, this visual and interactive guide should get them up to speed really nicely.</p>
<p>It&rsquo;s mostly just the mechanics of the machine and doesn&rsquo;t go into the more fun and formal parts such as reductions and proofs. But it&rsquo;s a start.</p>
<p><a href="https://samwho.dev/turing-machines"  target="_blank" rel="noreferrer">https://samwho.dev/turing-machines</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/18238/</link><pubDate>Tue, 27 May 2025 06:11:11 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/18238/</guid><description>&lt;p&gt;A twofer on software estimation that also tallies with my intuition. People are really great at estimating the median which is impossible to communicate to people without deep intuition for software engineering and statistics.&lt;/p&gt;</description><content:encoded><![CDATA[<p>A twofer on software estimation that also tallies with my intuition. People are really great at estimating the median which is impossible to communicate to people without deep intuition for software engineering and statistics.</p>
<p>It makes total sense as a guideline to multiply your initial guess x1.6 for the mean, x5 for the 95th percentile and x10 for the 99th percentile. This is also why deadlines are irrelevant and counterproductive in software engineering. There are much better ways to achieve the same goals.</p>
<p><a href="https://thesearesystems.substack.com/p/task-estimation-conquering-hofstadters"  target="_blank" rel="noreferrer">https://thesearesystems.substack.com/p/task-estimation-conquering-hofstadters</a></p>
<p><a href="https://erikbern.com/2019/04/15/why-software-projects-take-longer-than-you-think-a-statistical-model.html"  target="_blank" rel="noreferrer">https://erikbern.com/2019/04/15/why-software-projects-take-longer-than-you-think-a-statistical-model.html</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/18231/</link><pubDate>Tue, 27 May 2025 05:44:41 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/18231/</guid><description>&lt;p&gt;The Return To Office debate has been very contentious and hardly productive. Here in HBR is an ethics based approach to create solutions here that work for everybody. A lot of it is common sense but this is coherent and a useful lens.&lt;/p&gt;</description><content:encoded><![CDATA[<p>The Return To Office debate has been very contentious and hardly productive. Here in HBR is an ethics based approach to create solutions here that work for everybody. A lot of it is common sense but this is coherent and a useful lens.</p>
<p><a href="https://hbr.org/2025/05/the-workplace-psychological-contract-is-broken-heres-how-to-fix-it"  target="_blank" rel="noreferrer">https://hbr.org/2025/05/the-workplace-psychological-contract-is-broken-heres-how-to-fix-it</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/18229/</link><pubDate>Tue, 27 May 2025 05:40:59 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/18229/</guid><description>&lt;p&gt;We use reservoir sampling a lot day to day and here&amp;rsquo;s a great visual explanation of how this algorithm does this seemingly impossible task.&lt;/p&gt;</description><content:encoded><![CDATA[<p>We use reservoir sampling a lot day to day and here&rsquo;s a great visual explanation of how this algorithm does this seemingly impossible task.</p>
<p><a href="https://samwho.dev/reservoir-sampling"  target="_blank" rel="noreferrer">https://samwho.dev/reservoir-sampling</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/18220/</link><pubDate>Wed, 23 Apr 2025 23:58:57 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/18220/</guid><description>&lt;p&gt;A dive into Stafford Beer&amp;rsquo;s systems thinking that uncovers the ANT-style depth that&amp;rsquo;s often glossed over. That notwithstanding, I still think the glib and reductive &lt;a href="https://en.wikipedia.org/wiki/The_purpose_of_a_system_is_what_it_does" target="_blank" rel="noreferrer"&gt;POSIWID&lt;/a&gt; has its uses.&lt;/p&gt;</description><content:encoded><![CDATA[<p>A dive into Stafford Beer&rsquo;s systems thinking that uncovers the ANT-style depth that&rsquo;s often glossed over. That notwithstanding, I still think the glib and reductive <a href="https://en.wikipedia.org/wiki/The_purpose_of_a_system_is_what_it_does"  target="_blank" rel="noreferrer">POSIWID</a> has its uses.</p>
<p><a href="https://joelitobarski.com/posiwid/"  target="_blank" rel="noreferrer">https://joelitobarski.com/posiwid/</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/18117/</link><pubDate>Tue, 25 Feb 2025 22:30:25 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/18117/</guid><description>&lt;p&gt;Lots of people are going to have a problem with the truth going forward, so get those Wikipedia backups handy and start thinking about how to host it in a more distributed and resilient way.&lt;/p&gt;</description><content:encoded><![CDATA[<p>Lots of people are going to have a problem with the truth going forward, so get those Wikipedia backups handy and start thinking about how to host it in a more distributed and resilient way.</p>
<p><a href="https://www.404media.co/wikipedia-prepares-for-increase-in-threats-to-us-editors-from-musk-and-his-allies"  target="_blank" rel="noreferrer">https://www.404media.co/wikipedia-prepares-for-increase-in-threats-to-us-editors-from-musk-and-his-allies</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/18077/</link><pubDate>Tue, 18 Feb 2025 17:11:08 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/18077/</guid><description>&lt;p&gt;Quanta&amp;rsquo;s write-ups of math discoveries are always enjoyable to read. In this case an undergraduate (!) figured out something new about hash tables and how fast they can be. Not sure yet when this will be shipped in code, but still it&amp;rsquo;s a pretty amazing discovery.&lt;/p&gt;</description><content:encoded><![CDATA[<p>Quanta&rsquo;s write-ups of math discoveries are always enjoyable to read. In this case an undergraduate (!) figured out something new about hash tables and how fast they can be. Not sure yet when this will be shipped in code, but still it&rsquo;s a pretty amazing discovery.</p>
<p><a href="https://www.quantamagazine.org/undergraduate-upends-a-40-year-old-data-science-conjecture-20250210/"  target="_blank" rel="noreferrer">https://www.quantamagazine.org/undergraduate-upends-a-40-year-old-data-science-conjecture-20250210/</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/18059/</link><pubDate>Sat, 08 Feb 2025 20:49:25 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/18059/</guid><description>&lt;blockquote&gt;&lt;p&gt;LLMs are fundamentally matching the patterns they’ve seen, and their abilities are constrained by mathematical boundaries. Embedding tricks and chain-of-thought prompting simply extends their ability to do more sophisticated pattern matching. The mathematical results imply that you can always find compositional tasks whose complexity lies beyond a given system’s abilities.&lt;/p&gt;</description><content:encoded><![CDATA[<blockquote><p>LLMs are fundamentally matching the patterns they’ve seen, and their abilities are constrained by mathematical boundaries. Embedding tricks and chain-of-thought prompting simply extends their ability to do more sophisticated pattern matching. The mathematical results imply that you can always find compositional tasks whose complexity lies beyond a given system’s abilities.</p>
</blockquote><p>LLMs are still very useful in a bunch of domains but here&rsquo;s an article explaining (from a <a href="https://arxiv.org/pdf/2412.02975"  target="_blank" rel="noreferrer">paper with a novel bound</a> on computational complexity) why improvements in reasoning seem to have run out of steam.</p>
<p><a href="https://www.quantamagazine.org/chatbot-software-begins-to-face-fundamental-limitations-20250131/"  target="_blank" rel="noreferrer">https://www.quantamagazine.org/chatbot-software-begins-to-face-fundamental-limitations-20250131/</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/18007/</link><pubDate>Wed, 05 Feb 2025 22:45:13 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/18007/</guid><description>&lt;p&gt;The scientists are all on Bluesky which is understandable given the war on science and truth taking place on Twitter.&lt;/p&gt;</description><content:encoded><![CDATA[<p>The scientists are all on Bluesky which is understandable given the war on science and truth taking place on Twitter.</p>
<p><a href="https://www.nature.com/articles/d41586-025-00177-1?linkId=12635521"  target="_blank" rel="noreferrer">https://www.nature.com/articles/d41586-025-00177-1?linkId=12635521</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/17917/</link><pubDate>Tue, 14 Jan 2025 08:44:58 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/17917/</guid><description>&lt;p&gt;The Agents chapter from Chip Huyen&amp;rsquo;s book &amp;ldquo;AI Engineering&amp;rdquo; is clear and enjoyable to read. She&amp;rsquo;s right that &amp;ldquo;the concept of an agent is fairly simple&amp;rdquo; but building something functional still looks like a massive lift.&lt;/p&gt;</description><content:encoded><![CDATA[<p>The Agents chapter from Chip Huyen&rsquo;s book &ldquo;AI Engineering&rdquo; is clear and enjoyable to read. She&rsquo;s right that &ldquo;the concept of an agent is fairly simple&rdquo; but building something functional still looks like a massive lift.</p>
<p><a href="https://huyenchip.com/2025/01/07/agents.html"  target="_blank" rel="noreferrer">https://huyenchip.com/2025/01/07/agents.html</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/17888/</link><pubDate>Wed, 08 Jan 2025 08:55:50 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/17888/</guid><description>&lt;p&gt;Let&amp;rsquo;s see how this develops but good to see a positive healthcare story for AIs.&lt;/p&gt;</description><content:encoded><![CDATA[<p>Let&rsquo;s see how this develops but good to see a positive healthcare story for AIs.</p>
<p><a href="https://www.theguardian.com/society/2025/jan/07/more-breast-cancer-cases-found-when-ai-used-in-screenings-study-finds"  target="_blank" rel="noreferrer">https://www.theguardian.com/society/2025/jan/07/more-breast-cancer-cases-found-when-ai-used-in-screenings-study-finds</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/17886/</link><pubDate>Wed, 08 Jan 2025 08:53:07 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/17886/</guid><description>&lt;p&gt;A very useful thought experiment whenever anybody tries to pretend LLMs are &amp;lsquo;human&amp;rsquo; because they sound human.&lt;/p&gt;</description><content:encoded><![CDATA[<p>A very useful thought experiment whenever anybody tries to pretend LLMs are &lsquo;human&rsquo; because they sound human.</p>
<p><a href="https://bsky.app/profile/colin-fraser.net/post/3ldoyuozxwk2x"  target="_blank" rel="noreferrer">https://bsky.app/profile/colin-fraser.net/post/3ldoyuozxwk2x</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/17879/</link><pubDate>Mon, 06 Jan 2025 06:14:08 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/17879/</guid><description>&lt;p&gt;&lt;a href="https://arxiv.org/abs/2412.02830" target="_blank" rel="noreferrer"&gt;RARE: Retrieval-Augmented Reasoning Enhancement for Large Language Models&lt;/a&gt;&lt;/p&gt;</description><content:encoded><![CDATA[<p><a href="https://arxiv.org/abs/2412.02830"  target="_blank" rel="noreferrer">RARE: Retrieval-Augmented Reasoning Enhancement for Large Language Models</a></p>
<blockquote><p>Medical QA depends heavily on domain-specific knowledge that is not always available within pre-trained models, necessitating knowledge-based retrieval from external sources.</p>
</blockquote><blockquote><p>In addition medical knowledge evolves rapidly, and new treatments or updated guidelines may not be included in the model&rsquo;s pertained corpus.</p>
</blockquote><p>The question example for the reasoning process in Figure 1 is on a multiple-choice question. That seems overly simple.</p>
<blockquote><p>In parallel, Commonsense Question Answering shares similar complexities with Medical QA, particularly in its reliance on structured multi-step reasoning and iterative evidence retrieval.</p>
</blockquote><blockquote><p>rStar (<a href="https://arxiv.org/abs/2408.06195"  target="_blank" rel="noreferrer">Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers</a>)</p>
</blockquote><p>The rStar approach seems worth diving into. That will be the paper I read next.</p>
<blockquote><p>Monte Carlo Tree Search</p>
</blockquote><blockquote><p>enabling the open source LLMs (LLAMA3.1) to achieve competitive performance with top closed-source LLMs like GPT-4 and GPT-4o.</p>
</blockquote><p>We&rsquo;ll come to this later in the paper. Their conclusion is that they can trick out LLAMA to get similar performance to GPT-4 in these domains.</p>
<blockquote><p>Upper Confidence Bound applied on trees (UCT)</p>
</blockquote><blockquote><p>In contrast, rStar incorporates five distinct actions that enable more adaptive exploration:</p>
<p>A1: Propose a One-Step Thought. This action generates the next reasoning step based on previous steps, allowing the LLM to build the solution incrementally.</p>
<p>A2: Propose Remaining Thought Steps. This action enables the LLM to produce all remaining reasoning steps in one inference, similar to CoT, for simpler questions.</p>
<p>A3: Generate Next Sub-question and Answer. This action decomposes the main problem into a sequence of sub-questions, each solved in turn. A4: Re-answer Sub-question. This action allows the LLM to re-answer a previously generated sub- question, increasing accuracy by using few-shot prompting.</p>
<p>A5: Rephrase Question/Sub-question. This action rephrases the question to clarify conditions and reduce misunderstandings, enhancing the LLM’s interpretation of the problem.</p>
</blockquote><p>I need to trace the rStar algorithm after reading the original paper. The explanation here is too short.</p>
<blockquote><p>These queries target information that can either support or refute the content of each statement, ensuring comprehensive factual verification.</p>
</blockquote><p>How does this approach deal with (non-)negation that LLMs often have a lot of trouble with? From a language perspective it could just as easily say I can or can&rsquo;t eat grapefruit (iykyk) based on the temperature that day but especially in a medical context these kind of errors can be catastrophic.</p>
<blockquote><p>RARE achieves substantial gains, outperforming rStar by 5.17% on MedQA, 2.19% on MedMCQA and 2.39% on MMLU-Medical.</p>
</blockquote><p>Even if these numbers are statistically significant (which they don&rsquo;t say), these increases are really modest. I would not call this in any way &ldquo;substantial&rdquo;.</p>
<p>Looking at Table 1, RARE is as much of an increase over rStar as rStar is over the next best approach so from that perspective maybe you could call it significant. The difference between worst and best framework here is around 10% across CoT, RAG, SC, rStar, RARE.</p>
<blockquote><p>evaluated on StrategyQA (SQA), CommonsenseQA (CQA), Social IQA (SIQA) and Physical IQA (PIQA)</p>
</blockquote><p>The main question I have is from what percentage accuracy such a system would be reasonably possible to use in a real world context. Even at 90-95% that would seem like it would be too low to rely on when the stakes are high.</p>
<blockquote><p>By enhancing LLMs with retrieval-augmented reasoning, RARE bridges the gap between open source models and state-of-the-art proprietary systems.</p>
</blockquote><blockquote><p>The framework has only been tested on open source models like LLaMA 3.1 and not on larger proprietary models such as GPT-4. This is due to the high number of API calls required by RARE&rsquo;s iterative retrieval and reasoning process, making evaluation on closed source models prohibitively costly.</p>
</blockquote><p>So here they repeat the statement that they&rsquo;ve bridged the gap but they say they haven&rsquo;t used this approach with a model like GPT-4 because the number of API calls would make it too expensive.</p>
<p>That leaves on the table that these kind of many-call approaches are open to OpenAI because they <em>can</em> do these numbers of calls much more affordably from inside the house. No real gap has been closed here and it shows again how big of an advantage OpenAI has.</p>
<p>That raises the question: What makes GPT-4 so good? Why does it perform so much better than open source models?</p>
<blockquote><p>RARE is designed to identify a single reasoning trajectory that leads to a correct answer but does not necessarily optimise for the best or shortest path that maximises robustness.</p>
</blockquote><blockquote><p>Any integration into medical workflows must be supervised by qualified practitioners to ensure patient safety and ethical use.</p>
</blockquote>]]></content:encoded></item><item><title/><link>https://alper.nl/posts/17833/</link><pubDate>Thu, 02 Jan 2025 07:17:08 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/17833/</guid><description>&lt;p&gt;&lt;a href="https://arxiv.org/abs/2411.00412" target="_blank" rel="noreferrer"&gt;Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation&lt;/a&gt;&lt;/p&gt;</description><content:encoded><![CDATA[<p><a href="https://arxiv.org/abs/2411.00412"  target="_blank" rel="noreferrer">Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation</a></p>
<p>A paper where they fine tune an LLM to be able to answer some questions itself and figure out for which questions it needs to use a specialized tool. Intelligent tool usage seems like it would expand the use cases for LLM driven systems much more than any kind of scaling (real or imagined).</p>
<blockquote><p>However, scholars note that their abilities are capped at approximately high-school levels</p>
</blockquote><p>That seems like a noteworthy statement especially if you are looking to LLMs to provide &ldquo;novel thinking&rdquo;. It would seem much more that high school problems are abundantly available and relatively trivial so they see a specific focus.</p>
<blockquote><p>For numerical answers in the MATH and SciBench datasets, we consider answers correct if they fall within a small tolerance range of the true value, specifically within ±5%.</p>
</blockquote><p>Don&rsquo;t really see why you could not get exact answers in a mathematical domain.</p>
<blockquote><p>This performance gap on public benchmarks is likely due to the larger parameter count and specific optimization of state-of-the-art models on the open-source datasets.</p>
</blockquote><p>Same as with the high school questions. These datasets are easily available and draw attention so the models overfit on them.</p>
<blockquote><p>The model Ours-Pn demonstrates performance comparable to Base-Pf , both showing a significant improvement over the base model. This similarity indicates successful internalization of distilled knowledge from tools. The transition from Ours-Pn to Ours-Pi showcases further improvement in answer accuracy, resulting from the model’s enhanced ability to intelligently switch to tools for harder questions.</p>
</blockquote><p>This is the core proposition of the paper. Looking at Table 1 with the accuracy percentages there is something of an improvement but it does not really look dramatic or so convincing that you could use these systems in any critical context.</p>

<figure>
        <img
          class="my-0 rounded-md"
          loading="lazy"
          decoding="async"
          fetchpriority="auto"
          alt=""
          width="2064"
          height="640"
          src="/posts/17833/CleanShot-2025-01-02-at-08.10.34@2x_hu_48165cd3c7954184.png"
          srcset="/posts/17833/CleanShot-2025-01-02-at-08.10.34@2x_hu_48165cd3c7954184.png 800w,/posts/17833/CleanShot-2025-01-02-at-08.10.34@2x_hu_eff851df6f1caa55.png 1280w"
          sizes="(min-width: 768px) 50vw, 65vw"
          data-zoom-src="/posts/17833/CleanShot-2025-01-02-at-08.10.34@2x.png"
        />
  
  
  </figure>
<p>We&rsquo;re looking at increases of 10-20% and an accuracy that&rsquo;s still well under 90% (which I&rsquo;m also not convinced would be usable).</p>
<blockquote><p>We introduced a novel two-component fine-tuning approach to enhance Large Language Models (LLMs) in solving <strong>scientific</strong> <strong>problems</strong> of varying complexity.</p>
</blockquote><p>One of the key issues with the paper I have is how much work the term &ldquo;scientific problems&rdquo; is doing. If this is published, people are going to think that the LLM is solving actual novel issues where in this case it&rsquo;s just filling in relatively basic question/answer pairs that are well understood. Calling them problems is problematic.</p>
<p>The most interesting part of the paper is the appendix where you can see the actual questions and answers in the various datasets and the prompts they used (with example responses). The answers mostly are multiple choice which already influences how many of them you should expect to be correct.</p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/17831/</link><pubDate>Tue, 31 Dec 2024 14:23:39 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/17831/</guid><description>&lt;p&gt;&lt;a href="https://arxiv.org/abs/2209.07663" target="_blank" rel="noreferrer"&gt;Monolith: Real Time Recommendation System With Collisionless Embedding Table&lt;/a&gt;&lt;/p&gt;</description><content:encoded><![CDATA[<p><a href="https://arxiv.org/abs/2209.07663"  target="_blank" rel="noreferrer">Monolith: Real Time Recommendation System With Collisionless Embedding Table</a></p>
<p>I didn&rsquo;t get that much from this paper, probably because it&rsquo;s pretty high level and I don&rsquo;t have a strong background in recommendation systems.</p>
<p>The approach is their Cuckoo Hashmap for embedding from which they can update parameters on the fly using existing data engineering pipeline technology.</p>
<blockquote><p>Instead of reading mini-batch examples from the storage, a training worker consumes realtime data on-the-fly and updates the training PS. The training PS periodically syn- chronizes its parameters to the serving PS, which will take effect on the user side immediately. This enables our model to interactively adapt itself according to a user’s feedback in realtime.</p>
</blockquote>]]></content:encoded></item><item><title/><link>https://alper.nl/posts/17829/</link><pubDate>Tue, 31 Dec 2024 10:17:34 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/17829/</guid><description>&lt;p&gt;&lt;a href="https://arxiv.org/abs/2304.00612" target="_blank" rel="noreferrer"&gt;Eight Things to Know about Large Language Models&lt;/a&gt;&lt;/p&gt;</description><content:encoded><![CDATA[<p><a href="https://arxiv.org/abs/2304.00612"  target="_blank" rel="noreferrer">Eight Things to Know about Large Language Models</a></p>
<p>A bunch of stuff that maybe was somewhat surprising a year ago but by now should be common knowledge for anybody even half following the developments in this field.</p>
<p>Some interesting bits in there but for the rest it&rsquo;s a bit rah-rah because the author works at Anthropic.</p>
<blockquote><p>In particular, models can misinterpret ambiguous prompts or incentives in unreason- able ways, including in situations that appear unambiguous to humans, leading them to behave unexpectedly.</p>
</blockquote><blockquote><p>Our techniques for controlling systems are weak and are likely to break down further when applied to highly capable models. Given all this, it is reasonable to expect a substantial increase and a substantial qualitative change in the range of misuse risks and model misbehaviors that emerge from the development and deployment of LLMs.</p>
</blockquote><blockquote><p>The recent trend toward limiting access to LLMs and treating the details of LLM training as proprietary information is also an obstacle to scientific study.</p>
</blockquote>]]></content:encoded></item><item><title>Witches Kitchen</title><link>https://alper.nl/posts/witchs-kitchen/</link><pubDate>Fri, 27 Dec 2024 20:22:46 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/witchs-kitchen/</guid><description>&lt;figure&gt;
&lt;img
class="my-0 rounded-md"
loading="lazy"
decoding="async"
fetchpriority="auto"
alt=""
width="1680"
height="1258"
src="https://alper.nl/posts/witchs-kitchen/CleanShot-2024-12-27-at-21.16.15@2x_hu_698e7f2328b6eb25.png"
srcset="https://alper.nl/posts/witchs-kitchen/CleanShot-2024-12-27-at-21.16.15@2x_hu_698e7f2328b6eb25.png 800w,/posts/witchs-kitchen/CleanShot-2024-12-27-at-21.16.15@2x_hu_64a0202d5617fca4.png 1280w"
sizes="(min-width: 768px) 50vw, 65vw"
data-zoom-src="https://alper.nl/posts/witchs-kitchen/CleanShot-2024-12-27-at-21.16.15@2x.png"
/&gt;
&lt;/figure&gt;
&lt;p&gt;From &lt;a href="https://www.ams.org/notices/200410/fea-grothendieck-part2.pdf" target="_blank" rel="noreferrer"&gt;the Grothendieck biography&lt;/a&gt;, funny to see that the legend would express himself in German.&lt;/p&gt;</description><content:encoded><![CDATA[
<figure>
        <img
          class="my-0 rounded-md"
          loading="lazy"
          decoding="async"
          fetchpriority="auto"
          alt=""
          width="1680"
          height="1258"
          src="/posts/witchs-kitchen/CleanShot-2024-12-27-at-21.16.15@2x_hu_698e7f2328b6eb25.png"
          srcset="/posts/witchs-kitchen/CleanShot-2024-12-27-at-21.16.15@2x_hu_698e7f2328b6eb25.png 800w,/posts/witchs-kitchen/CleanShot-2024-12-27-at-21.16.15@2x_hu_64a0202d5617fca4.png 1280w"
          sizes="(min-width: 768px) 50vw, 65vw"
          data-zoom-src="/posts/witchs-kitchen/CleanShot-2024-12-27-at-21.16.15@2x.png"
        />
  
  
  </figure>
<p>From <a href="https://www.ams.org/notices/200410/fea-grothendieck-part2.pdf"  target="_blank" rel="noreferrer">the Grothendieck biography</a>, funny to see that the legend would express himself in German.</p>
<blockquote><p>Riemann-Roch&rsquo;scher Satz: der letzte Schrei: der Diagramm […] ist kommutatif!<br>
Um dieser Aussage über f:X-&gt;Y einen approximativen Sinn zu geben, musste ich nahezu zwei Stunden lang die Geduld der Zuhörer missbrauchen. Schwartz auf weiss (in Springer Lecture Notes) nimmt&rsquo;s wohl an die 400,500 Seiten.<br>
Ein packendes Beispiel dafür, wie unser Wissens und Entdeckungsdrang sich immer mehr in einem lebensentrückten logischen Delirium auslebt, während das Lebens selbst auf Tausendfache Art zum Teufel geht – und mit endgültiger Vernichtung bedroht ist. Höchste Zeit unsern Kurs zu ändern!</p>
<p>—Alexander Grothendieck</p>
</blockquote>]]></content:encoded></item><item><title/><link>https://alper.nl/posts/17809/</link><pubDate>Thu, 26 Dec 2024 23:31:13 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/17809/</guid><description>&lt;p&gt;&lt;a href="https://arxiv.org/pdf/1706.03762" target="_blank" rel="noreferrer"&gt;Attention Is All You Need&lt;/a&gt;&lt;/p&gt;</description><content:encoded><![CDATA[<p><a href="https://arxiv.org/pdf/1706.03762"  target="_blank" rel="noreferrer">Attention Is All You Need</a></p>
<p>I thought I&rsquo;d dive back into history and read the original paper that started it all. It&rsquo;s somewhat technical about encode/decoder layouts and matrix multiplications. None of the components are super exciting for somebody who&rsquo;s been looking at neural networks for the past decade.</p>
<p>What&rsquo;s exciting is that such a simplification generates results that are <em>that</em> much better and how they came up with it. Unfortunately, they don&rsquo;t write how they found this out.</p>
<p>The paper itself is a bit too abstract so I&rsquo;m going to look for some of those YouTube videos that explain what is actually going on here and why it&rsquo;s such a big deal. I&rsquo;ll update this later.</p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/17805/</link><pubDate>Thu, 26 Dec 2024 23:12:15 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/17805/</guid><description>&lt;p&gt;&lt;a href="https://arxiv.org/pdf/2305.10601" target="_blank" rel="noreferrer"&gt;Tree of Thoughts: Deliberate Problem Solving with Large Language Models&lt;/a&gt;&lt;/p&gt;</description><content:encoded><![CDATA[<p><a href="https://arxiv.org/pdf/2305.10601"  target="_blank" rel="noreferrer">Tree of Thoughts: Deliberate Problem Solving with Large Language Models</a></p>
<p>I came across this paper after the recent <a href="https://arcprize.org/blog/oai-o3-pub-breakthrough"  target="_blank" rel="noreferrer">o3 high score</a> on the ARC-AGI-PUB test. It&rsquo;s a quick read and details how to scale LLMs at inference stage by generating new states at every node and so create a tree on which to perform DFS/BFS search algorithms.</p>
<blockquote><p>A specific instantiation of ToT involves answering four questions: 1. How to decompose the intermediate process into thought steps; 2. How to generate potential thoughts from each state; 3. How to heuristically evaluate states; 4. What search algorithm to use.</p>
</blockquote><p>For each of these steps they can deploy the LLM to generate the desired results which then scaled over the search space balloons the number of calls that need to be done (costing almost 200x the compute).</p>
<p>This isn&rsquo;t your normal LLM stochastic parrot anymore. We&rsquo;ve gone one up the abstraction chain and here we have a computer science algorithm running with LLM calls as its basic atoms.</p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/17690/</link><pubDate>Sun, 03 Nov 2024 22:14:36 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/17690/</guid><description>&lt;p&gt;I don&amp;rsquo;t really know where to find a Honeycrisp apple locally, but since moving to Germany I have been eating tons of amazing juicy, sweet, crisp apples. It turns out that this is deliberate and these are not the apples of my childhood.&lt;/p&gt;</description><content:encoded><![CDATA[<p>I don&rsquo;t really know where to find a Honeycrisp apple locally, but since moving to Germany I have been eating tons of amazing juicy, sweet, crisp apples. It turns out that this is deliberate and these are not the apples of my childhood.</p>
<p><a href="https://www.scientificamerican.com/article/apples-have-never-tasted-so-delicious-heres-why"  target="_blank" rel="noreferrer">https://www.scientificamerican.com/article/apples-have-never-tasted-so-delicious-heres-why</a></p>
]]></content:encoded></item><item><title>Literature review of measures against the common cold</title><link>https://alper.nl/posts/literature-review-of-measures-against-the-common-cold/</link><pubDate>Mon, 08 Jan 2024 15:57:36 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/literature-review-of-measures-against-the-common-cold/</guid><description>&lt;p&gt;I refer to this piece of writing regularly:&lt;/p&gt;</description><content:encoded><![CDATA[<p>I refer to this piece of writing regularly:</p>
<p><a href="https://srconstantin.wordpress.com/2017/12/11/preventing-respiratory-tract-infections/"  target="_blank" rel="noreferrer">https://srconstantin.wordpress.com/2017/12/11/preventing-respiratory-tract-infections/</a></p>
<p>It&rsquo;s a review of the scientific literature to see what actually works against respiratory tract infections to either prevent them or to get better more quickly.</p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/17108/</link><pubDate>Sun, 05 Mar 2023 13:51:46 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/17108/</guid><description>&lt;p&gt;The hype train around AI now should be very familiar if you paid any attention during the previous crypto cycle. It&amp;rsquo;s the same people pushing this technology in the world in the same overblown and damaging way.&lt;/p&gt;</description><content:encoded><![CDATA[<p>The hype train around AI now should be very familiar if you paid any attention during the previous crypto cycle. It&rsquo;s the same people pushing this technology in the world in the same overblown and damaging way.</p>
<blockquote><p>We’ve learned to make “machines that can mindlessly generate text,”Bender told me when we met this winter. “But we haven’t learned how to stop imagining the mind behind it.”</p>
</blockquote><p><a href="https://nymag.com/intelligencer/article/ai-artificial-intelligence-chatbots-emily-m-bender.html"  target="_blank" rel="noreferrer">https://nymag.com/intelligencer/article/ai-artificial-intelligence-chatbots-emily-m-bender.html</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/16946/</link><pubDate>Fri, 06 Jan 2023 19:45:18 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/16946/</guid><description>&lt;p&gt;Everything we continue to learn about the very earliest people is completely fascinating.&lt;/p&gt;</description><content:encoded><![CDATA[<p>Everything we continue to learn about the very earliest people is completely fascinating.</p>
<p>Next time I go to Turkey, a visit to the Taş Tepeler is definitely in order.</p>
<p><a href="https://www.spectator.co.uk/article/does-an-unknown-extraordinarily-ancient-civilisation-lie-buried-under-eastern-turkey-/"  target="_blank" rel="noreferrer">https://www.spectator.co.uk/article/does-an-unknown-extraordinarily-ancient-civilisation-lie-buried-under-eastern-turkey-/</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/16942/</link><pubDate>Fri, 06 Jan 2023 18:55:08 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/16942/</guid><description>&lt;p&gt;Machine learning looks like a very challenging field to keep up with let alone to study it. This guide by Vicki Boykis gives a bunch of pointers around reading, mapping and learning that can be applied to any large field you want to get into.&lt;/p&gt;</description><content:encoded><![CDATA[<p>Machine learning looks like a very challenging field to keep up with let alone to study it. This guide by Vicki Boykis gives a bunch of pointers around reading, mapping and learning that can be applied to any large field you want to get into.</p>
<p><a href="https://vickiboykis.com/2022/11/10/how-i-learn-machine-learning/"  target="_blank" rel="noreferrer">https://vickiboykis.com/2022/11/10/how-i-learn-machine-learning/</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/16910/</link><pubDate>Tue, 27 Dec 2022 14:02:17 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/16910/</guid><description>&lt;blockquote&gt;&lt;p&gt;Even a cursory dip into the subreddits and other social media posts, whitepapers, and other documentation and community discussions surrounding generative AI, makes it hard to miss the spite and negativity directed at human creativity. They are almost necessary preconditions to be part of the development community. Ironically, of course, the developers celebrate their own creativity in building these software tools, despite the fact that they implicitly rebuke the work and lives of everyone who creates or thinks meaning is confined to living things.&lt;/p&gt;</description><content:encoded><![CDATA[<blockquote><p>Even a cursory dip into the subreddits and other social media posts, whitepapers, and other documentation and community discussions surrounding generative AI, makes it hard to miss the spite and negativity directed at human creativity. They are almost necessary preconditions to be part of the development community. Ironically, of course, the developers celebrate their own creativity in building these software tools, despite the fact that they implicitly rebuke the work and lives of everyone who creates or thinks meaning is confined to living things.</p>
</blockquote><p>That perspective which I&rsquo;ve also noticed in the people pushing this stuff is incredibly damning. They hover up the sum creative works of humanity and privatize it into shitty models.</p>
<p><a href="https://davidgolumbia.medium.com/chatgpt-should-not-exist-aab0867abace"  target="_blank" rel="noreferrer">https://davidgolumbia.medium.com/chatgpt-should-not-exist-aab0867abace</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/16842/</link><pubDate>Sun, 21 Aug 2022 23:03:55 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/16842/</guid><description>&lt;p&gt;Any kind of workshop that you do virtually is going to be more difficult but in my experience a skilled facilitator and a motivated group can overcome these challenges.&lt;/p&gt;</description><content:encoded><![CDATA[<p>Any kind of workshop that you do virtually is going to be more difficult but in my experience a skilled facilitator and a motivated group can overcome these challenges.</p>
<p><a href="https://www.gsb.stanford.edu/insights/thinking-inside-box-why-virtual-meetings-generate-fewer-ideas"  target="_blank" rel="noreferrer">https://www.gsb.stanford.edu/insights/thinking-inside-box-why-virtual-meetings-generate-fewer-ideas</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/16819/</link><pubDate>Sun, 17 Jul 2022 09:02:34 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/16819/</guid><description>&lt;p&gt;&lt;a href="https://www.currentaffairs.org/2022/07/the-dangerous-populist-science-of-yuval-noah-harari" target="_blank" rel="noreferrer"&gt;https://www.currentaffairs.org/2022/07/the-dangerous-populist-science-of-yuval-noah-harari&lt;/a&gt;&lt;/p&gt;</description><content:encoded><![CDATA[<p><a href="https://www.currentaffairs.org/2022/07/the-dangerous-populist-science-of-yuval-noah-harari"  target="_blank" rel="noreferrer">https://www.currentaffairs.org/2022/07/the-dangerous-populist-science-of-yuval-noah-harari</a></p>
<p>For how popular and questionable Yuval Noah Harari&rsquo;s writing has been, it has barely seen any scrutiny. This critique by Darshana Narayanan is on point and most of the things in it were—I hate to say it—glaringly obvious from the get-go.</p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/16775/</link><pubDate>Sat, 09 Apr 2022 23:21:57 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/16775/</guid><description>&lt;p&gt;Lovely bit about the &lt;em&gt;broodje kroket&lt;/em&gt; and about Dutch colonial history.&lt;/p&gt;</description><content:encoded><![CDATA[<p>Lovely bit about the <em>broodje kroket</em> and about Dutch colonial history.</p>
<p><a href="https://theswordandthesandwich.substack.com/p/notable-sandwiches-22-broodje-kroket?s=w"  target="_blank" rel="noreferrer">https://theswordandthesandwich.substack.com/p/notable-sandwiches-22-broodje-kroket?s=w</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/16767/</link><pubDate>Sat, 09 Apr 2022 22:33:22 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/16767/</guid><description>&lt;p&gt;On old but interesting article about a study that indicates that people will use their cars a lot more once we get fully autonomous vehicles.&lt;/p&gt;</description><content:encoded><![CDATA[<p>On old but interesting article about a study that indicates that people will use their cars a lot more once we get fully autonomous vehicles.</p>
<p><a href="https://jalopnik.com/zombie-miles-and-napa-weekends-how-a-week-with-chauffe-1839648416"  target="_blank" rel="noreferrer">https://jalopnik.com/zombie-miles-and-napa-weekends-how-a-week-with-chauffe-1839648416</a></p>
]]></content:encoded></item><item><title>Property dealings in Berlin</title><link>https://alper.nl/posts/16736/</link><pubDate>Mon, 07 Mar 2022 12:01:57 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/16736/</guid><description>&lt;p&gt;&lt;a href="https://parisinstitute.org/the-real-academy-in-exile/#ref1" target="_blank" rel="noreferrer"&gt;https://parisinstitute.org/the-real-academy-in-exile/#ref1&lt;/a&gt;&lt;/p&gt;</description><content:encoded><![CDATA[<p><a href="https://parisinstitute.org/the-real-academy-in-exile/#ref1"  target="_blank" rel="noreferrer">https://parisinstitute.org/the-real-academy-in-exile/#ref1</a></p>
<p>Back when I read this exposé in November it struck me as gripping but also as something that could become messy. Turns out that&rsquo;s true since the piece now has the mark &ldquo;Censored&rdquo; and some choice parts of text have been blanked out. I did a quick search but can&rsquo;t find any updates what might have happened. If I find time later, I&rsquo;ll look in the Wayback Machine to see what pieces of text disappeared.</p>
<p>The kind of property deals that are described in the article are par for the course in any up and coming city. Recently there was a piece about resistance to the city giving away one of its largest buildings to a private art gallery: <a href="https://www.freitag.de/autoren/der-freitag/portraet-wut-motiviert-mich"  target="_blank" rel="noreferrer">https://www.freitag.de/autoren/der-freitag/portraet-wut-motiviert-mich</a></p>
<p>The academic backroom dealings should also be considered to be normal especially in small subfields such as Turkey studies. Academics are playing funding games more than they research and the web of foundations that float around are ways to creatively bookkeep and move money around. None of this is really surprising.</p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/16682/</link><pubDate>Fri, 31 Dec 2021 12:07:22 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/16682/</guid><description>&lt;p&gt;I had no idea that most of Tesla&amp;rsquo;s FSD videos were fake. Huh.&lt;/p&gt;</description><content:encoded><![CDATA[<p>I had no idea that most of Tesla&rsquo;s FSD videos were fake. Huh.</p>
<p><a href="https://blog.piekniewski.info/2021/12/18/farcical-self-delusion/"  target="_blank" rel="noreferrer">https://blog.piekniewski.info/2021/12/18/farcical-self-delusion/</a></p>
]]></content:encoded></item><item><title>German adjective inflections demystified</title><link>https://alper.nl/posts/german-adjective-inflections-demystified/</link><pubDate>Thu, 25 Mar 2021 10:08:16 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/german-adjective-inflections-demystified/</guid><description>&lt;p&gt;I see lots of people still struggle with the German adjectives and especially the fact that there are three tables, one for each of definite articles, indefinite articles and when there&amp;rsquo;s no article, for 48 separate inflections.&lt;/p&gt;</description><content:encoded><![CDATA[<p>I see lots of people still struggle with the German adjectives and especially the fact that there are three tables, one for each of definite articles, indefinite articles and when there&rsquo;s no article, for 48 separate inflections.</p>

<figure>
      <img class="my-0 rounded-md" src="https://pbs.twimg.com/media/ExT0oPsXAAIsLsG?format=jpg&amp;name=small" alt="Image" />
  
  <figcaption>Image</figcaption>
  </figure>
<p>It looks pretty intimidating and back in school my brain refused to do learn this. I crammed it for a test, immediately forgot it after and German classes turned into agony.</p>
<p>There are various mnemonics going around to make the table easier but I&rsquo;m not in favor of rote memorization if there&rsquo;s also a logic behind something. As with all language, the entire thing is based on the principle of energy conversation while maintaining essential information and harmony. That&rsquo;s my non-linguist intuition. Linguists feel free to chime in.</p>
<p>The entire table can be boiled down to <strong>five</strong> rules.</p>
<ul>
<li>Definite nom./acc. singular: all <strong>-e</strong> (because a definite article has all the information and is leading, so no further decoration or information required on the adjective) except for masc. acc. which is <strong>-en</strong> (because acc always has -en and it sounds weird without it)</li>
<li>Indefinite nom./acc. singular: all congruent with the article: ein<strong>er</strong> gut <strong>er</strong> Mann, für ein <strong>en</strong> gut <strong>en</strong> Mann, ein <strong>e</strong> gut <strong>e</strong> Frau, für ein <strong>e</strong> gut <strong>e</strong> Frau etc. (because the article still has all the information but it is weaker/indefinite so the adjective helps out)</li>
<li>Definite and indefinite gen./dat. singular: all <strong>-en</strong> (all the information is in the article so no need to repeat it but good to have some differentiation from the nom./acc. cases)</li>
<li>Definite and indefinite plural: all <strong>-en</strong> (because it’s plural)</li>
<li>No article: the adjectives take the endings that would normally have been carried by the article (because there is no article and otherwise the case information would not be there) except for masc./neut. gen. where the <strong>-s</strong> is on the noun</li>
</ul>
<p>That&rsquo;s it. I hope this adds some logic to something that otherwise feels totally random for German learners.</p>
<p>With practice you can look these inflections up in your head and with even more practice, anytime somebody uses the wrong inflection, it starts to sound wrong (that lack of harmony), just like it would to a native speaker.</p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/16397/</link><pubDate>Mon, 25 Jan 2021 21:22:48 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/16397/</guid><description>&lt;p&gt;When I still did photography, I read everything I could find about how cameras work and this is the mental model I built up back then.&lt;/p&gt;</description><content:encoded><![CDATA[<p>When I still did photography, I read everything I could find about how cameras work and this is the mental model I built up back then.</p>
<p>The lovely thing about this webpage is that it makes each of the mechanics interactive so you can play with them and see what happens.</p>
<p><a href="https://ciechanow.ski/cameras-and-lenses/"  target="_blank" rel="noreferrer">https://ciechanow.ski/cameras-and-lenses/</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/16267/</link><pubDate>Sat, 05 Sep 2020 13:57:00 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/16267/</guid><description>&lt;p&gt;An uncannily thorough treatment of why DARPA works and how you might go about replicating it. Maybe people at the European policy level should read this instead of trying all these initiatives where everything good dies in a committee.&lt;/p&gt;</description><content:encoded><![CDATA[<p>An uncannily thorough treatment of why DARPA works and how you might go about replicating it. Maybe people at the European policy level should read this instead of trying all these initiatives where everything good dies in a committee.</p>
<p><a href="https://benjaminreinhardt.com/wddw"  target="_blank" rel="noreferrer">https://benjaminreinhardt.com/wddw</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/16125/</link><pubDate>Sun, 21 Jun 2020 23:14:52 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/16125/</guid><description>&lt;p&gt;I&amp;rsquo;ve always felt that programming is more similar to languages than to mathematics. The number of hard maths problems that we solve as part of this work are really limited, the number of language problems on the other hand is immense.&lt;/p&gt;</description><content:encoded><![CDATA[<p>I&rsquo;ve always felt that programming is more similar to languages than to mathematics. The number of hard maths problems that we solve as part of this work are really limited, the number of language problems on the other hand is immense.</p>
<p><a href="https://www.nature.com/articles/s41598-020-60661-8"  target="_blank" rel="noreferrer">https://www.nature.com/articles/s41598-020-60661-8</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/15871/</link><pubDate>Wed, 27 Nov 2019 09:54:17 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/15871/</guid><description>&lt;p&gt;Turns out large parts of science and popular science are all contaminated by Epstein. Evgeny Morozov reveals his part and extricates himself.&lt;/p&gt;</description><content:encoded><![CDATA[<p>Turns out large parts of science and popular science are all contaminated by Epstein. Evgeny Morozov reveals his part and extricates himself.</p>
<p><a href="https://newrepublic.com/article/154826/jeffrey-epsteins-intellectual-enabler"  target="_blank" rel="noreferrer">https://newrepublic.com/article/154826/jeffrey-epsteins-intellectual-enabler</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/15794/</link><pubDate>Sun, 20 Oct 2019 14:47:58 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/15794/</guid><description>&lt;p&gt;“the resilience of a system corresponds to its adaptive capacity tuned to the future.”&lt;/p&gt;</description><content:encoded><![CDATA[<p>“the resilience of a system corresponds to its adaptive capacity tuned to the future.”</p>
<p><a href="https://lorinhochstein.wordpress.com/2019/08/20/tuning-to-the-future/"  target="_blank" rel="noreferrer">https://lorinhochstein.wordpress.com/2019/08/20/tuning-to-the-future/</a></p>
<p>“While counterfactual reasoning helps restore our feeling that the world makes sense, the problem with it is that it doesn’t help us get better at avoiding or dealing with future incidents. The reason it doesn’t help is that counterfactual reasoning gives us an excuse to avoid the messy problem of understanding how we missed those obvious-in-retrospect actions and signals in the first place.”</p>
<p><a href="https://lorinhochstein.wordpress.com/2019/08/22/the-problem-with-counterfactuals/"  target="_blank" rel="noreferrer">https://lorinhochstein.wordpress.com/2019/08/22/the-problem-with-counterfactuals/</a></p>
<p>The writings of Lorin Hochstein about resilience engineering are immensely valuable and illuminating. It&rsquo;s nice to be able to read the thinking of people who are current with the cutting edge of a profession.</p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/15724/</link><pubDate>Sun, 22 Sep 2019 20:58:39 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/15724/</guid><description>&lt;p&gt;Not surprising that those things at the MIT Media Lab that looked too good to be true, were in fact fake.&lt;/p&gt;</description><content:encoded><![CDATA[<p>Not surprising that those things at the MIT Media Lab that looked too good to be true, were in fact fake.</p>
<p><a href="https://gizmodo.com/mit-built-a-theranos-for-plants-1837968240"  target="_blank" rel="noreferrer">https://gizmodo.com/mit-built-a-theranos-for-plants-1837968240</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/15672/</link><pubDate>Mon, 02 Sep 2019 23:12:03 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/15672/</guid><description>&lt;p&gt;I&amp;rsquo;ve heard “if you&amp;rsquo;re so smart, then why aren&amp;rsquo;t you rich”more than a couple of times in my life. The answer it turns out is: unluckiness.&lt;/p&gt;</description><content:encoded><![CDATA[<p>I&rsquo;ve heard “if you&rsquo;re so smart, then why aren&rsquo;t you rich”more than a couple of times in my life. The answer it turns out is: unluckiness.</p>
<p><a href="https://www.technologyreview.com/s/610395/if-youre-so-smart-why-arent-you-rich-turns-out-its-just-chance/"  target="_blank" rel="noreferrer">https://www.technologyreview.com/s/610395/if-youre-so-smart-why-arent-you-rich-turns-out-its-just-chance/</a></p>
]]></content:encoded></item><item><title>The Theory of Society</title><link>https://alper.nl/posts/the-theory-of-society/</link><pubDate>Wed, 05 Jun 2019 21:40:37 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/the-theory-of-society/</guid><description>&lt;p&gt;I was arguing against Systems Theory today (a necessary evil when you live in Germany) which prompted the thought of searching for the conjunction of Bruno Latour and Niklas Luhmann. That led me to &lt;a href="https://wittenbrink.net/lostandfound/clash-of-culturesbruno-latour-trifft-niklas-luhmann/" target="_blank" rel="noreferrer"&gt;this gem&lt;/a&gt;.&lt;/p&gt;</description><content:encoded><![CDATA[<p>I was arguing against Systems Theory today (a necessary evil when you live in Germany) which prompted the thought of searching for the conjunction of Bruno Latour and Niklas Luhmann. That led me to <a href="https://wittenbrink.net/lostandfound/clash-of-culturesbruno-latour-trifft-niklas-luhmann/"  target="_blank" rel="noreferrer">this gem</a>.</p>
<p>It turns out that they met each other for a debate in 1996 in Bielefeld and Latour <strong>DESTROYED</strong> his opponent (<a href="https://www.leydesdorff.net/luhmannreconsidered/luhmann_and_latour.pdf"  target="_blank" rel="noreferrer">full article</a>).</p>
<p>Luhmann, as expected, failed to engage with the theme of the conference, Science and Technology Studies and didn&rsquo;t come out of his bubble. The same bubble that he has managed to trap most of the German humanities in.</p>
<blockquote><p>[Luhmann] only managed to address the theme of the conference—science and its sociological study—with half a sentence where he curtly asserted that <strong>science is an autopoietic subsystem of modern society</strong>.</p>
</blockquote><p>An autopoietic subsystem, my ass. Latour quickly riposted into a frontal assault at the entirety of Luhmann-ism.</p>
<blockquote><p>No, according to Latour, this theory didn&rsquo;t have anything to offer to him and neither he concluded any of those gathered there. A quick perusal of the conference program should have sufficed to ascertain that the empirically obsessed STSers could not recover their objects in this theory. This may be bemoaned from the high vantage point of the Theory of Society as poor, theoretically &ldquo;flat&rdquo; sociology, nonetheless, Latour replied, this empirical Zoology of STS gives an account of this society as it is and not how it may appear from the distance of the chilling heights of systems theory.
Latour clarified that fundamentally, systems theory represents everything that he and his colleagues in science studies have been battling for 20 years—yes, really battle and not just criticize. The purification of science, the simplification of the social by a demarcation with its environment, Luhmann&rsquo;s work as the embodiment of the &ldquo;cognitive turn&rdquo; in epistemology—for Latour these were the old buzzwords that had to miss what&rsquo;s special about science: its materiality. And in doing so of course also what&rsquo;s specific for modern society, the large technological networks.</p>
</blockquote><p>Latour battling ‘the purification of science [and] the simplification of the social’, a true hero of science and society.</p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/15475/</link><pubDate>Mon, 27 May 2019 22:30:29 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/15475/</guid><description>&lt;p&gt;Fijn zo&amp;rsquo;n land onder de zeespiegel dat wordt beheerst door klimaatontkenners. En gezien het Nederlandse asielbeleid is het niet heel waarschijnlijk dat klimaatvluchtelingen elders op een warm welkom zullen kunnen rekenen.&lt;/p&gt;</description><content:encoded><![CDATA[<p>Fijn zo&rsquo;n land onder de zeespiegel dat wordt beheerst door klimaatontkenners. En gezien het Nederlandse asielbeleid is het niet heel waarschijnlijk dat klimaatvluchtelingen elders op een warm welkom zullen kunnen rekenen.</p>
<p><a href="https://twitter.com/Jamrat"  target="_blank" rel="noreferrer">https://twitter.com/Jamrat</a>_/status/1132546604366475264</p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/15408/</link><pubDate>Sun, 12 May 2019 20:16:22 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/15408/</guid><description>&lt;p&gt;This article about forecasting dovetails nicely with the book about measuring risk that I just read. It makes the case for foxlike thinking, something of which I don&amp;rsquo;t need to be persuaded.&lt;/p&gt;</description><content:encoded><![CDATA[<p>This article about forecasting dovetails nicely with the book about measuring risk that I just read. It makes the case for foxlike thinking, something of which I don&rsquo;t need to be persuaded.</p>
<blockquote><p>Among those, they identified a small group of the foxiest forecasters—bright people with extremely wide-ranging interests and unusually expansive reading habits, but no particular relevant background—and weighted team forecasts toward their predictions. They destroyed the competition.</p>
<p>Tetlock and Mellers found that not only were the best forecasters foxy as individuals, but they tended to have qualities that made them particularly effective collaborators. They were “curious about, well, really everything,”as one of the top forecasters told me. They crossed disciplines, and viewed their teammates as sources for learning, rather than peers to be convinced. When those foxes were later grouped into much smaller teams—12 members each—they became even more accurate. They outperformed—by a lot—a group of experienced intelligence analysts with access to classified data.</p>
</blockquote><p><a href="https://www.theatlantic.com/magazine/archive/2019/06/how-to-predict-the-future/588040/"  target="_blank" rel="noreferrer">https://www.theatlantic.com/magazine/archive/2019/06/how-to-predict-the-future/588040/</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/15358/</link><pubDate>Sun, 28 Apr 2019 13:59:00 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/15358/</guid><description>&lt;blockquote&gt;&lt;p&gt;As you’ll see, everything is slightly approximate, slightly exaggerated — so that each step in the argument takes you further from what you’re prepared to agree to.&lt;/p&gt;</description><content:encoded><![CDATA[<blockquote><p>As you’ll see, everything is slightly approximate, slightly exaggerated — so that each step in the argument takes you further from what you’re prepared to agree to.</p>
</blockquote><p>It turns out Harari&rsquo;s books only go downhill after Sapiens.</p>
<p><a href="http://www.thewhitereview.org/reviews/yuval-noah-harari/"  target="_blank" rel="noreferrer">http://www.thewhitereview.org/reviews/yuval-noah-harari/</a></p>
]]></content:encoded></item><item><title/><link>https://alper.nl/posts/15284/</link><pubDate>Tue, 26 Mar 2019 23:02:55 +0000</pubDate><guid isPermaLink="false">https://alper.nl/posts/15284/</guid><description>&lt;p&gt;Theranos employees are suffering some adverse consequences for participating in that scam (and rightly so).&lt;/p&gt;</description><content:encoded><![CDATA[<p>Theranos employees are suffering some adverse consequences for participating in that scam (and rightly so).</p>
<p><a href="https://edition.cnn.com/2019/03/14/tech/theranos-employees/index.html"  target="_blank" rel="noreferrer">https://edition.cnn.com/2019/03/14/tech/theranos-employees/index.html</a></p>
]]></content:encoded></item></channel></rss>