2022, Article in monograph or in proceedings (NordiCHI workshop - Age against the machine: A Call for Designing Ethical AI for and with Children)With the development of content-generating Artificial Intelligence (AI) systems, such as generating images from a textual description, new possibilities for using such system in design processes arise. In this position paper, we argue that we need to explicitly incorporate children's values when we develop design methods that incorporate content-generating AI to protect their creative processes. In a mini-inquiry we find that children from different ages have articulate ideas about being in the same design space as a content-generating AI’s. They share concerns about fidelity, transparency and how it changes the level-playing field for them. To setup a safe and ethical design space when co-creating with children we foresee three important steps: 1) explore the value of children with respect to content-generation AI. 2) improve the accessibility of these systems for children and 3) study the effect of using such a system on creativity and innovation in a design process.
