Be Careful What You Think You Know