What do regular technology users think (and know) about AI? I’ve been involved in some interesting conversations recently about designing LLM based tools for end users, and one of the important product design questions that this brings up is “what do people know about AI?” This matters because, as any product designer will tell you, you need to understand the user in order to successfully build something for them to use.

When LLMs give us outputs that reveal flaws in human society, can we choose to listen to what they tell us? Machine Learning, Nudged By now, I’m sure most of you have heard the news about Google’s new LLM*, Gemini, generating pictures of racially diverse people in Nazi uniforms . This little news blip reminded me of something that I’ve been meaning to discuss, which is when models have blind spots, so we apply expert rules to the predictions they generate to avoid returning something wildly outlandish to the user.