AEA’s Updated Ethical Guidelines

Purpose of the Guiding Principles: The Guiding Principles reflect the core values of the American Evaluation Association (AEA) and are intended as a guide to the professional ethical conduct of evaluators.

As a member of AEA and on the leadership team of the Youth-Focused Evaluation Topical Interest Group (YFE TIG), Nick attempts to operationalize these guidelines into all evaluation projects and initiatives to ensure that all participants are not harmed during the course of the research and evaluation work. Even better than doing no harm, these guidelines can serve to demonstrate the benefits that come with research and evaluation work which, ultimately, are meant to serve the common good in society.

AEA members recently voted on whether to adopt these guidelines. Please follow this link to learn more about the guidelines including how they were developed.

New Resources on the YFE Website!  Child and Youth Participation in Speaking Truth to Power

New Resources on the YFE Website!
Child and Youth Participation in Speaking Truth to Power

Written and assembled by Nick Petten


Seeking children and young people’s perspectives, ideas, opinions, and experiences through participatory approaches in research and evaluation is a valued focus of study and has the ability to speak truth to power. The power that adults typical wield in society often speak on behalf of children and young people and may not truly represent them and, sometimes, completely misrepresent them in order to gain more power.

Children and young people are one of the most marginalized and oppressed groups in society. And yet, today’s adults expect that tomorrow’s adults (children) will solve some pretty wicked, global, complex and complicated challenges that we face as a civilization—climate change, growing income inequality, a resurgence of autocratic and nationalist governments and policies, to name a few. We pin our hopes and dreams on our children and yet deny them the chance to truly participate in society, whether we allow them to vote at a younger age, decide what to learn in the classroom, or design an evaluation or research project.

Thankfully, there are lots (and growing number) of academics, evaluators, thought-leaders and practitioners that are acting in the best interests of the child and young person by co-designing approaches, methods, and processes to genuinely include their participation in things that matter most to them, like how the local playground should be designed, choosing politicians that represent their best interest, or how national policies could be designed to benefit their adult lives and thus the future of humanity. From these approaches, methods, and processes, children and young people stand a better chance of ‘speaking truth’ to powers that haven’t traditionally represented them authentically or have even co-opted their ‘voice’ to progress their own agenda.

If you are someone that works with children and young people and are looking for ways to design, implement and/or evaluate programs and services for them, we’ve collected and curated a list of resources that could help you in your journey.

Advice: Children’s Assent to Participate in Research

This post is the extended version of a post that I wrote for the American Evaluation Association’s AEA365 Blog.

Our work with children and young people over the last decade and a half has impressed upon us that they are fully capable of expressing and communicating their lived realities and that those realities are a valued focus of study. Just like any potentially vulnerable and marginalized population, conducting research with children requires an ethical understanding of how to involve them in the research and how not to perpetuate systemic injustices and discriminations that they so often face in their daily lives.

But before that, let’s go back to basics.

All research involves at least two main participants, the researcher and the subject. The relationship between researcher and subject is defined by the methodology of the research. The methodology is critical in determining any truth claim that a research study suggests. When researching childhood, a critical methodological concern is the power dynamics that occur between adults and children. Unequal power can compromise your data and severely distort truth. But more importantly, it can cause harm to your subject. In order to make any truth claims based on the scientific process, careful consideration must be given to the ethics of involving children in research so that power dynamics can become more equalized, while also acknowledging that they may never truly disappear.

The UN Convention on the Rights of the Child articulates various rights and responsibilities that children have. Article 3 states that the best interests of the child must be the primary concern in making decisions that may affect them—including on their participation in research. As holders of rights, even the youngest children are entitled to express their views. Young children are acutely sensitive to their surroundings and acquire an understanding of people, places and routines in their lives, along with the awareness of their own identity. They make choices and communicate their feelings, ideas and wishes in numerous ways, long before they are able to communicate through spoken or written language. It may be through drawings, body movements, or eye contact. Children even use silence to express themselves.

The new sociology of childhood is a scientific discipline that promotes the process of obtaining assent from children to participate in research. This discipline recognizes that children’s agency in research is based on the view that children are individuals who experience their worlds in unique ways, and that these unique experiences are a valued focus of study. So, what is assent? In addition to parents and guardians providing informed consent, seeking children’s assent is a process where children can exercise choice about their own research participation. There are different conceptions of assent and consent between the medical field and sociological studies—so, it is important to know how to use it and within which context.

So, how do you seek assent with children?

Tip #1: Researchers often balance written and visual information with verbal information. Knowing the individual child participants well enough to be able to make judgments about what information is necessary to facilitate their understanding is an ongoing process, also known as process assent. Respect for children as an individual also includes respect for their developing competencies. Competence is a developmental process. That means that the content and process of assent may have to be explained in different ways at different times. Develop an assent and accountability framework that will help you explain the process of research and its findings in a child-friendly manner and systematically ‘check-in’ with children about their participation in the research.

Tip #2: It is important that voluntary participation involves an active decision to take part—rather than failure to give dissent, or passive resignation. The voluntary nature of participation can also be undermined by things like obligations to parents or teachers. Familiar contexts, people and experiences can promote participation. However, familiarity can also put pressure on children to participate. Supportive contexts facilitate children’s developing competencies, while recognizing that their interests and understandings change. Develop protocols to use when seeking children’s assent that considers as many factors as possible about why they would answer in a particular way. 

Tip #3: Work with and build a relationship with children’s gatekeepers. In addition to parents as gatekeepers, there may also be teachers or managers at early childhood centres. Gatekeepers provide a familiar and trusted mediator between participants and researchers. They may have knowledge about the social and cultural contexts and language protocols. Building a relationship will give the researcher a better sense of a child’s interests and preferences which provides opportunities to gauge their comfort with participation. These relationships also allow a child to get to know the researcher within supportive and safe interactions. Dedicate time to building relationships and having conversations with the gatekeepers and remember that such conversations need to strike a balance between providing critical information and too much detail that can lead to confusion.

Tip #4: Researchers can use reflexivity to analyze the personal, intersubjective and social processes which shape their research and acknowledge their role. Reflexivity includes critical and ethical reflection on the assumptions underpinning the research and the processes to obtain assent, conduct the research and interpret the findings. Researchers should also be able to explain in an understandable way how the research findings will be used. Children may have critical and ethical questions about who benefits from the research; what is their future involvement; and how will they be represented in the research findings. Engage in internal reflection through an explicit and systematic process throughout the research process and think about how the insights gained may influence how you converse with children and their gatekeepers.

Rad resources:

If you are starting to think about how to genuinely involve children’s participation in research, you better be ready to read. By reading some of the great material on research with children you can begin to understand children’s position in research–and even in our adult-centric world. Meaningfully and authentically involving children’s participation in research can contribute immensely to the truths that you are trying to uncover in your research. Not only will your programs or studies be better off with a good understanding of your stakeholders, but you will be actively supporting and advocating for the realization of the UN Convention on the Rights of the Child–one of the most important and widely accepted international conventions. Doesn’t that sound great?!

Here is some material to get your started on you reading adventure:

Also, these organizations publish material that relates to involving children in research, monitoring and evaluations:

 

 

News: Published Article on Reflexivity

We are proud that one of our associates, Jenna van Draanen, has published an article on ‘Introducing Reflexivity to Evaluation Practice’ in the American Journal of Evaluation. The practice of reflexivity is something that we are actively exploring and employing in our evaluation and research work at Petten Consulting. We believe that it makes us more culturally competent and responsive to the complex needs of our clients. If you have access to scientific journals, please visit the Journal’s website and download the article.

Feel free to contact us with any questions. We’d love to hear what you think about the practice of reflexivity!

Abstract

There is currently a paucity of literature in the field of evaluation regarding the practice of reflection and reflexivity and a lack of available tools to guide this practice—yet using a reflexive model can enhance evaluation practice. This paper focuses on the methods and results of a reflexive inquiry that was conducted during a participatory evaluation of a project targeting homelessness and mental health issues. I employed an action plan composed of a conceptual model, critical questions, and intended activities. The field notes made throughout the reflexive inquiry were analyzed using thematic content analysis. Results clustered in categories of power and privilege, evaluation politics, the applicability of the action plan, and outcomes. In this case study, reflexivity increased my competence as an evaluation professional: The action plan helped maintain awareness of how my personal actions, thoughts, and personal values relate to broader evaluation values—and to identify incongruence. The results of the study uncovered hidden elements and heightened awareness of subtle dynamics requiring attention within the evaluation and created opportunities to challenge the influence of personal biases on the evaluation proceedings. This reflexive model allowed me to be a more responsive evaluator and can improve practice and professional development for other evaluators.

van Draanen, J. (2016). Introducing Reflexivity to Evaluation Practice An In-Depth Case Study. American Journal of Evaluation, 1098214016668401.

Report: Right To Play’s PAQE Program Baseline Evaluation 2016

The team at Petten Consulting (Nick, Jenna and Priya) worked with Right To Play, a child-oriented international development organization, to establish a baseline for the Play for the Advancement of Quality Education (PAQE) program that is operating in 8 countries around the world and funded by the Government of Canada. The PAQE program seeks to, “improve educational attainment and participation of girls and boys, aged 2-15 in eight countries with a child friendly approach to learning with play” (Global Affairs Canada, 2016).

Download the full report here [via Dropbox].

Report: UNICEF Evaluation Report – Peacebuilding, Education and Advocacy Programme

Nick Petten worked with an international team of evaluators at Avenir Analytics on the global evaluation of the Peacebuilding, Education and Advocacy (PBEA) programme in 14 conflict-afflicted countries around the world. Using an outcome harvest approach, the evaluation used mixed methods to evaluate the progress and impact of UNICEF’s and partnering organizations’ activities for peacebuilding, social cohesion and resilience, and education.

Download the report at UNICEF’s Global Evaluation Database

PBEA was designed to work at the nexus of education and conflict, to improve conflict sensitive programming and contribute to peacebuilding, social cohesion and resilience, using education as an entry point. Meaningful results were achieved in integrating conflict sensitivity and peacebuilding into education sector reform and other policies; building institutional capacities of UNICEF, governments and implementing partners for conflict sensitive programming and peacebuilding; building individual and community capacities to mitigate causes of conflict; and increasing access to conflict sensitive education. More results are expected in generating learning and evidence of what works in social services for peacebuilding. The evaluation made eight overarching conclusions.

UNICEF Evaluation Database: 2015 Global: Evaluation of UNICEF’s Peacebuilding, Education and Advocacy Programme (PBEA)