---
title: Things I Learned - 30 Jun 2024
date: 2024-06-30T00:00:00+00:00
categories:
  - til
description: I explored Amara's law and LLM development patterns like RAG and defensive UX. I also investigated ROUGE metrics for AI evaluation, discovered calculator spelling tricks, and experimented with Tor for cleaner torrent searches.
keywords: [amara's law, llm patterns, rag, rouge metric, defensive ux, tor browser, calculator spelling]
---

This week, I learned:

- Amara's law: "We tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run."
- [LLM Patterns](https://eugeneyan.com/writing/llm-patterns/) include Evals, RAG, Fine-tuning, Caching, Guardrails, Defensive UX, Collect feedback. Notably:
  - Defensive UX: Microsoft, Google, and Apple have guidelines for Human-AI interactions
  - Collect feedback: Explicit and implicit
- [Rouge](<https://en.wikipedia.org/wiki/ROUGE_(metric)>) and [Context Precision](https://docs.ragas.io/en/latest/concepts/metrics/context_precision.html) are [metrics](https://docs.ragas.io/en/latest/concepts/metrics/index.html) to evaluate LLM responses that serve as a starting point -- but not sufficient, usually
- Any word with the letters `izehsglbo` can be spelt on a calculator. That includes Hobbes (538804)! Via [Calculator spelling](https://paperlined.org/apps/wikipedia/offsite_content/Calculator_spelling.txt)
- Tor Browser + DuckDuckGo is good for torrent searches. Maybe the Dark Web _IS_ the original Internet. The ad-free hacker web