Repositório RCAAP

The present text provides a meta-evaluation of quota policies in Paraná state universities. The aim was to analyze the evaluation processes of these policies regarding similarities and differences, potential and limits, strategies and procedures used. We also conducted document analysis and interviews, systematized through content analysis. The policy cycle was also used for data analysis. We observed the need to qualify the evaluation processes, train a technical staff, and develop evaluation methods and strategies for quota policies appropriate to the different situations and production of knowledge about evaluation as an epistemological field. We concluded that the evaluation process did not actually occur because of the fear that the evaluation would be used as a step backward in the process of reserving vacancies. The study highlight the importance of more in-depth discussions about quotas. 

The paper analyzes the impact of the main program for early childhood education adopted by Rio de Janeiro public municipal system since 2010 on children’s development at preschool. It discusses the methodological design and results of international research and indicates the scarcity of studies with robust designs in the Brazilian context. A randomsampleof46schools(2.716children)collectedintwowaves:atthebeginningand end of 2017, from the study “Baseline Brazil (BLB)”, was used in the statistical treatment of data. The descriptive analysis of data suggests an association in the same direction between attendance to the program and development in language. However, analysis using hierarchical models including controlling variables do not indicate a statistically significant effect of attending the program for cognitive development in the shortrun. 

The present article aims  to  discuss  the  process  of  formulation  and  implementation of the Programa Institucional de Bolsas de Iniciação à Docência [Institutional Teacher Initiation Scholarship Program] (Pibid) using the theoretical-methodological framework of Theory-Driven Evaluation (TDE), which proposes to evaluate a program based on its defining theory. The PIBID is a Federal Government program that aims to improve initial teacher education by introducing teacher licensure students into public schools’ daily activities since their early stages in college. In order to outline the program’s action and change models as suggested by TDE, we used qualitative methodology and conducted     a discussion of data based on content analysis. The action model demonstrates the articulation between partner institutions and the program’s actors, who are mobilized by incentive instruments, which resulted in an effective change model. We found that PIBID acts on the right determinants, thus causing significant change in the initial teacher education process. Our analysis of the program’s model shows that PIBID affects positively the initial teacher education process. 

In times of educational policies guided by accountability, the increase of institutional evaluation systems is a striking aspect of the educational systems. This article presents the results of a study conducted in Portugal, based on the perceptions of educational actors in response to the problem: What impact and effects do the External Evaluation of Schools (AEE) produce, regarding school improvement, community involvement and implementation of accountability policies?. Despite the critical positioning of the educational actors concerning the AEE, results indicate acceptance of the framework model triggering the legitimation and the procedural effects that promote the ossification of curricular and pedagogical practices, highlighting the importance of the emphasis on formative institutional evaluation.

The aim of the present article is to analyze the influence of external assessment, an essential part of the current Sistema Nacional de Avaliação da Educação Superior [National System of Evaluation in Higher Education]. It was conducted in loco in two institutions of higher education, one public and one private, in the state of Paraná. It is an empirical study, and the data were collected through semi-structured interviews conducted with institutional directors and coordinators of graduate programs. The analysis permitted the authors to verify some limits of the current assessment system, related to: the participating subjects’ lack of knowledge of the assessment assumptions; the time allocated to the assessment process; the method of choice of evaluators at each stage; the lack of policies based on data generated by the system; and, the increasingly explicit conversion of assessment into a control mechanism of institutional practices, which makes the autonomy of the subjects, who work in higher education, impossible.  

This text discusses concepts associated with the notion of value and the action of valuing in program evaluation, considering the need to make judgments about the quality of a policy, program, project or social action that is inherent to it. It seeks to contribute to foment the discussion about valuation in the evaluation of social programs. To that end, it reviews the US and Brazilian literature in order to identify how valuation questions have been theoretically proposed and made explicit in evaluative research. Reports and articles on program evaluation with a focus on education are examined. It concludes, based on this bibliographical analysis, that the discussion about the attribution of value has seldom been conducted in the national literature in an explicit way, which reinforces the need for improving it. 

In the context of assessment policies, the present article approaches the planning and development of an instrument of institutional evaluation, carried out with the participation of teachers working in early childhood education, in a municipality of the state of Espírito Santo. Anchored in Bakhtinian theoretical-methodological references, the present study, following a qualitative and exploratory methodology, developed procedures and interviews for document analysis. The results show that the planning stage of the development of an instrument is essential for linking the other stages related to institutional evaluation. It is concluded that, although challenges remain regarding the conditions of participation of all involved, the perspective of a collective work in the preparation of this assessment action constitutes important training for the participants. 

The article presents the results of a study conducted into daily teaching activities, with student researchers in a Pedagogy course, in a thematic unit focused on institutional evaluation. Concepts of institutional evaluation, external and internal to the school in- stitution, were developed so that students could understand the pedagogical meaning of institutional evaluation and its political and social dimension, using methodology with ethnographic characteristics. In developing the thematic unit, the teacher simultaneously assumed a position favorable to the students’ learning development, from a conception of selective and classificatory evaluation to the understanding of its formative potential. This was based on the problematization of data collected in curricular stages, analyzed in the light of the theoretical references studied, with emphasis on the encompassing character of institutional evaluation and its connection with learning evaluation.

The aim of the study was to evaluate the efficiency of public and private Higher Education Institutions (HEI) regarding their potential to add academic knowledge to business students in 2012 and 2015. The study was divided in two stages: in the first one, the multiple regression technique was applied to control students’ personal factors. In the second, Data Envelopment Analysis decomposition was used in two components: one is related to the student’s performance and the other to HEIs efficiency. The results show higher performance of public HEIs, from both the students and institutions point of view. Nevertheless, private HEIs show potentiality to reduce the discrepancy. There was also productivity increase between the years evaluated for both public and private institutions.

This article aims to investigate the presence of socio-scientific aspects (SSA) in elements of the approach to chemistry questions in the evaluations of the New ENEM (2009-2014), providing a way to integrate the scientific content to be studied with elements of social relevance in the classroom. Its use would make it possible to observe what has been announced in official curricular documents, the National Curriculum Parameters (NCP), regarding the competences and skills related to the objectives of teaching chemistry. An analysis of the questions content showed that 29% of the items of the corpus had the elements necessary for the SSA approach in the classroom, based on the discussion of the issue. Despite the low result, the presence of these profile questions indicates the likelihood that teachers will adopt the teaching concept that involves this approach.

This paper analyzes the association between different variables of the teaching profession: professional affective engagement, job satisfaction, interactions with peers and school management, perceptions about working conditions and the desire to become a teacher. To that end, we use the answers of Portuguese (N = 1,346) and Mathematics (N = 816) teachers to the teacher questionnaire administered by the Program for International Student Assessment (Pisa 2015). The study reveals that interactions in school and teachers’ positive perception about the career are very important for job satisfaction and professional engagement. Results contribute to the discussion process about teacher recognition policies.

Brazil’s academic evaluation system is based on grades (concepts). The present paper is an evolutionary study of the stricto sensu programs of Engineering III. The methodology used demonstrated that 12 post-graduate programs, mostly from public institutions, obtained maximum efficiency throughout the entire evaluation cycle. The present study  also shows that the South and Southeast regions of Brazil have the most efficient programs. Results indicated a considerable increase in the number of certified programs and a low correlation of program concept and efficiency, corroborating the assumption that not all high concept programs will have a high rate of scientific output.

In this interview, Chris Coryn, Director of the Interdisciplinary PhD in Evaluation (IDPE) Program, Professor of Evaluation at Western Michigan University (WMU) and executive editor of the Journal of MultiDisciplinary Evaluation, explains key concepts and characteristics of program evaluation, a dimension of evaluation that is still unexplored in the educational area in Brazil. The researcher comments on some of the current challenges in the field of program evaluation, highlighting methodological tendencies and ethical issues in professional practice. He also discusses knowledge, competences and skills that should be considered in the training of the professional evaluator. Coryn criticizes current evaluative approaches that disconnect program evaluation from values and valuing, which, in his view, are distinctive elements of program evaluation.   

This study examines the perceptions of training participants in a context of textual production teaching and assessment; the participants were being trained to be Portuguese teacher trainers for a municipal education system in Brazil’s Southeast region. The data analysis shows that the participants’ perceptions (i) highlight collaboration as a structuring principle of training, through the sharing of knowledge and experiences between participants and the trainer; (ii) reflect the role of social interactionist theory in supporting reflection about practice; (iii) choose the transformation of practice through the theoretical-methodological assumption of assessment for learning as a training process, thus showing that the quality of assessment of students’ texts can be reached by making the criterial approach compatible with the experiential perspectives of subject-teachers. 

This paper analyzes data from Prova Brasil in order to answer two questions: in the ten- year period, have there been advances in the quality of education in terms of learning and student grade progression in primary and lower secondary education (1st to 9th grades)? Who are the students who have (or have not) improved, considering geographic and social characteristics? We present descriptive statistics on proficiency levels and on student self-declaration regarding grade repetition for students in the 5th and 9th grades from 2007 to 2017. Results show a continuous improvement for both quality indicators for all regions and social groups. However, according to the criteria we used, the differences between social groups and between the country’s regions are important to understand the obstacles to overall advancement in learning and to a decrease in grade repetition.

This paper aims to contribute to the research on inequality and school effectiveness by mapping the distribution of educational opportunities in Brazil based on data from the 2013 SAEB. To do so, we evaluated the opportunities of elementary school students to have access, according to their socioeconomic level (NSE), to more qualified teachers and schools with better physical, human and pedagogical resources. We have demonstrated that the student’s socioeconomic level is an important variable in the distribution of educational opportunities in Brazil, even in a context of expansion and universalization of access to elementary education.

The aim of this study was to verify if the learning and use of metacognitive strategies had a positive impact on writing. The theoretical framework adopted was that of Cognitive Psychology, guided by Flavell (1976). Two students of Pedagogy participated in the study, wich employed a qualitative method. The procedures consisted of seven meetings, aiming to: (a) introduce how to write a review and how to use cognitive strategies to do so; (b) write  three  reviews;  (c)  collect  two  self-assessments  from  the  participants;  and, (d) interview each student to learn about their writing process. In order to analyze the results, three categories were created (knowledge of the Person, of the Task,  and of       the Metacognitive Strategies). The results indicated that there was an evolution in the writing, suggesting that metacognitive strategies should be taught during basic education.

This article analyzes the relationships between student performance and factors that characterize classroom processes and environment by focusing on the direct and indirect effects of teachers' attitudes (perceived teacher-student relationship and teacher expectations) on primary students’ proficiency in mathematics. The empirical analysis involved the estimation of an adjusted structural equations model using data from the Estudo Longitudinal da Geração Escolar [Longitudinal Study of School Generation] (Geres) conducted in the cities of Rio de Janeiro, Belo Horizonte, Campinas, Campo Grande and Salvador from 2005 to 2008. Results indicated that i) teacher expectations have a direct effect on student performance; ii) factors related to the composition of classes affect expectations; iii) and the teacher-student relationship directly affects learning gains and is inf luenced by sex, age/grade lag and disciplinary climate.  

This article presents a study that aimed to assess the possibility of using public data from the social network Facebook to identify the academic and professional paths of graduates of an integrated high school. A questionnaire was also used to compare the scope of two data collection methods. The study was carried out with 244 graduates from a federal institute. Of these, 195 were found on the social network and only 21 responded to the questionnaire. The results showed that Facebook is very interesting for monitoring graduates, 61% of whom provided information on their education itinerary and 20% on professional performance. However, the use of a questionnaire is still necessary to obtain the graduates’ opinion.