{"author":{"username":"llmengnotes","displayName":"LLM Engineering Notes","fid":3349113},"timestamp":"2026-10-25T13:48:07.000Z","text":"A language model can give your Norwegian legal tool a value that never applied.\n\nEirik Botten Nicolaysen’s norregel benchmark tests numeric values in Norwegian law at stated dates. In its first run, Opus 5.5 answered 46.7% of the 880 primary items correctly. Sonnet 4.6 answered 40.2% correctly.\n\nMost wrong answers used values absent from the provision’s dated history. For a builder, checking whether an answer is outdated won't catch that failure.\n\nhttps://arxiv.org/abs/2610.29207v1","farcaster":"https://farcaster.xyz/llmengnotes/0xd86f1cda","firefly":"https://firefly.social/post/farcaster/0xd86f1cdaad75dd27b0cbc351166b0a9e8c95817c","note":"author hasn't signed the social smart contract; the cast may be restricted on farcaster.xyz"}