Subido por 88-8

reina-et-al-2024-plata-design-of-an-online-platform-for-chemistry-undergraduate-fully-automated-assignments

Anuncio
This article is licensed under CC-BY 4.0
pubs.acs.org/jchemeduc
Article
PLATA: Design of an Online Platform for Chemistry Undergraduate
Fully Automated Assignments
Downloaded via 189.203.105.232 on April 30, 2024 at 17:09:23 (UTC).
See https://pubs.acs.org/sharingguidelines for options on how to legitimately share published articles.
Miguel Reina,* Eduardo Gabriel Guzmán-López,* César Guzmán-López,
Carlos Hernández-Garciadiego, María de los Á ngeles Olvera-León, Mario Alfredo Garcia-Carrillo,
Marco Antonio Tafoya-Rodríguez, Victor Manuel Ugalde-Saldívar, Itzel Guerrero-Ríos, Laura Gasque,
Jorge M. del Campo, Daniela Franco-Bodek, Rolando Bernal-Pérez, Milton Medeiros,
Armando Marín-Becerra, Héctor García-Ortega, Jesús Gracia-Mora, and Antonio Reina*
Cite This: J. Chem. Educ. 2024, 101, 1024−1035
ACCESS
Metrics & More
Read Online
Article Recommendations
sı Supporting Information
*
ABSTRACT: In the Digital Era, the development of new
educational instruments is crucial for supporting students in their
academic journey. While there is a significant correlation between
homework and learning, the effectiveness of assignments is often
constrained by the large number of students and the extensive
grading required by teachers. In this context, open educational
resources (OER), particularly those built on the free and opensource Moodle platform, have shown increased learning among
students, becoming valuable instruments for educators. Automated
chemistry assignments are challenging, in contrast to physics or
mathematics. This is due to the necessity of accounting for the vast
yet finite universe of existing molecules, compounds, and reactions
́
along with the inherent constraints imposed within the field. In this article we present PLATA (Programa en Linea
de Apoyo a las
́
Tareas Académicas), a Moodle based OER for automated chemistry homework implemented at Facultad de Quimica
at UNAM.
PLATA is an online platform with more than 132 million open answer exercises (not multiple choice) automatically graded with
specific feedback for each exercise attempt. The design and characteristics of the program, some examples showing its versatility, and
the outstanding students’ outcomes of the OER are presented. PLATA has been used by more than 15,500 students over the past 4
years. The results displayed correspond to the 2022 academic year, with more than 3,200 students, from which 500 undergraduates
answered an exit survey, and we monitored the outcomes of 400 students. As a result, we can state that PLATA is a versatile, useful,
and robust program for chemistry assignments with a positive impact on students’ learning.
KEYWORDS: General Public, Inorganic Chemistry, Computer-Based Learning, Internet/Web-Based Learning,
Student-Centered Learning, Professional Development, Testing/Assessment
1. INTRODUCTION
heterogeneity of the school enrollment, are among the major
obstacles faced by first-year undergraduates.12
Academics have to overcome enormous challenges to reduce
students’ misconceptions and subsequently scholar dropoff.13−16 In order to transfer knowledge, teachers usually
need to provide rigorous methodologies, conceptual maps,
mental images, exercises, and examples related to industry or
basic research. Fostering a sense of group spirit that nurtures
community among university students is also essential, all
One of the most challenging aspects of learning sciences is its
inherent abstract nature, which compels students to transcribe
real world problems into modeled representations.1,2 Chemistry is not alien to this issue. In fact, there is a constant need to
relate macroscopic observations, submicroscopic or molecular
models and symbolic language that enables a simple, clear,
universal and synthetic way to communicate among chemists.3−9 The linkage between the three aspects of chemistry has
been already examined by Johnstone, who provided a
schematic representation known as Johnstone’s triangle,
broadly employed by several authors.5−11 Furthermore,
mathematical problems, including numerical and algebraic
determinations, the increased amount of work and work
rhythm going from high school to university courses, and the
© 2024 The Authors. Published by
American Chemical Society and Division
of Chemical Education, Inc.
Received: September 20, 2023
Revised: January 31, 2024
Accepted: February 2, 2024
Published: February 23, 2024
1024
https://doi.org/10.1021/acs.jchemed.3c00962
J. Chem. Educ. 2024, 101, 1024−1035
Journal of Chemical Education
pubs.acs.org/jchemeduc
while simultaneously assessing the degree of learning.13,16 In
addition, teachers should be at the forefront of cutting-edge
didactic technologies and approaches. These aspects contribute
to the stress, fatigue and emotional exhaustion experienced by
teachers, which are relevant factors in the development of
burn-out syndrome among faculty members.16−20
The significance of homework for learning chemistry has
been established in both traditional and flipped classrooms,
emphasizing the importance of practice in the learning
́
process.21−25 At Facultad de Quimica
at Universidad Nacional
Autónoma de México, UNAM, student enrollment has largely
increased in the past semesters, welcoming more than 1,650
students per year. Even though students are enrolled in one of
́
the 6 college majors offered by the Facultad de Quimica
(Chemistry, Chemical Engineering, Biological Pharmaceutical
Chemistry, Food Chemistry, Metallurgical Chemical Engineering, and Materials and Chemical Engineering), first-year
students have several common courses, such as General
Chemistry I and II. Indeed, teachers often contend with class
sizes of at least 70 students. Consequently, assigning,
evaluating, and grading assignments becomes an impossible
task. In practical terms, if an average teacher, typically handling
two to four groups, aimed to assign homework each week
throughout the semester, they would find themselves grading
more than five thousand classwork papers. If revising a single
classwork paper takes a minimum of 15 min, a teacher would
require 60 consecutive days, nonstop, to grade and evaluate all
of them. Clearly, this is an unattainable goal. Consequently,
teachers often resort to alternative methods such as handing
back corrected assignments and requesting students to selfgrade, minimizing homework by selecting the most illustrative
problems or seeking support from teaching assistants for the
grading process. In the worst-case scenarios, teachers do not
evaluate homework, depriving students from feedback or, even
worse, not leaving any assignments at all (Figure 1).
intricate, especially when teachers aim to avoid multiple-choice
questions.33,35−38 While mathematics or physics homework
can be programmed by varying only numerical values, resulting
in a practically infinite database in a short time, chemistry
needs to consider the vast yet finite universe of existing
molecules, compounds, and reactions along with the imposed
restrictions. Several factors must be considered, such as
solubility issues, the nonexistence of impossible molecules or
compounds, and the equilibrium constants governing reactions, among others. Herein, we present PLATA (“Programa
́
en Linea
de Apoyo a las Tareas Académicas”, www.
proyectoplata.com), an online platform for automated
chemistry homework hosted on Moodle. Noteworthy, Moodle
was selected as the OER platform primarily for its user-friendly
interface, visually ergonomic navigation, and the versatility
offered by its free open-source software, allowing a wide range
of mathematical functions and code writing.39 PLATA owes its
name to the Spanish acronym: Online Program for Academic
Homework Support, and also from the association with silver
(Plata in Spanish, Ag), a chemical element. This choice is
symbolic, reflecting Mexico’s prominent role as one of the
leading global silver producers. Over the past four years,
PLATA has been used by more than 15,500 students, proving
to be a robust, versatile, compatible, universal, easyimplemented, novel and efficient tool. PLATA places the
student in the center of their own learning, allowing
undergraduates to progress at different paces, in an
asynchronous manner, and independently from the teacher’s
grading and evaluation. Each of the 132 million free automated
exercises in PLATA provides unique and specific feedback,
including step-by-step procedures to solve the problem and
embedded external links to peer-reviewed videos,13 as well as
book chapters. Through this OER, undergraduates can
complete homework as many times as they need or want,
encountering similar exercises with different numerical values,
chemical compounds, and reactions.
Article
2. DESIGN OF PLATA
́́
At Facultad de Quimica
at UNAM, there are approximately
1,200 faculty members and more than 9,000 students enrolled
in one of the six college majors offered. Notably, the
Department of Inorganic and Nuclear Chemistry comprises
more than 46 permanent faculty members, including Full
Professors, Associate Professors, Technicians, and 52 part-time
Professors. The Department offers a variety of courses,
throughout the four-and-a-half-year program, serving over
4,000 students each semester, with the mission of contributing
to the development of chemists and responsible citizens.
Indeed, the Department offers seven theoretical and seven
experimental courses. To fulfill this crucial mission, the
́
Facultad de Quimica
strives to provide high-quality theoretical
classes and laboratories. Additionally, the institution maintains
competitive research groups dedicated to the development of
undergraduate, master’s, and Ph.D. students, along with
postdoctoral fellows. Among the various courses offered,
General Chemistry II, designed for first-year students, stands
out as one of the most challenging. In fact, it is among the top
́
five most frequently failed courses at Facultad de Quimica,
with an average failure rate of approximately 45% over the last
10 years out of more than 150 courses.
The project started in the fall of 2019, with the aim of
equipping students with tools to enhance their learning while
simultaneously alleviating teachers’ workload. In this context,
Figure 1. Challenges for general chemistry teachers at the Facultad de
́
Quimica.
In this context, the implementation of new technologies
represents an appealing alternative for educators. Novel
educational processes incorporating online learning have
been flourishing in the past decades, including collaborative,
mobile, cloud and game learning, among others.26,27
In science courses, the use of open educational resources
(OER) and virtual learning environments (VLE), particularly
those based on Moodle, has already proven to be an interesting
and valuable instrument for educators. In general, the
implementation of OER and VLE has been shown to enhance
students’ performance in final term exams, reduce the number
of drop-off students, foster great awareness on their learning
process, and promote self-sustained learning.16,22−38 Importantly, open educational resources, especially those on
chemistry topics, are not readily available in Spanish. The
development of automated chemistry assignments in contrast
to mathematics or physics homework, is substantially more
1025
https://doi.org/10.1021/acs.jchemed.3c00962
J. Chem. Educ. 2024, 101, 1024−1035
Journal of Chemical Education
pubs.acs.org/jchemeduc
Article
Figure 2. General Chemistry II curricula and the partition into 13 homeworks (HW).
we design PLATA as an online platform of automated
chemistry assignments, specifically tailored for first-year
general chemistry courses, where approximately 3,200 students
are enrolled each semester. In particular, General Chemistry II
is an intricate course due the extensive curriculum and limited
teaching hours (2 h per week), together with a large student
enrollment. Consequently, this course was selected as the
initial course for automated assignments. The syllabus
comprises six blocks covering stoichiometry, chemical
equilibria, acid−base equilibria, solubility, and redox reactions.
These topics are covered in 32 lecture hours over 16 weeks,
divided into 16 two-hour sessions or 32 one-hour classes. With
three evaluations per semester, we prepared 13 assignments
corresponding to the topics illustrated in Figure 2.
Each educational program block is addressed by a minimum
of two assignments, with the difficulty level gradually
increasing. Every assignment consists of 10 questions and
can be attempted repeatedly based on the student’s preference
or necessity. Notably, the questions are not exclusively
multiple-choice; in fact, multiple-choice questions are rare in
PLATA, with the majority being formula-type questions.
Formula-type questions allow for variation of numeric values,
chemical compounds, and reactions. For example, in a question
related to acid−base equilibria, where students need to
determine the concentration of all species at equilibrium,
formula-type questions enable the modification of the acid’s
nature, its conjugated base, the associated acid dissociation
constant (Ka), and the initial concentration of the acid (Figure
3).
As shown in Figure 3, students have the option to repeat
their assignment with equivalent but distinct exercises. This
proves to be highly effective for practice, allowing students to
reinforce problem-solving methodologies without encountering identical exercises. It is important to notice that PLATA
does not consider any answer correct without its proper units,
emphasizing a fundamental pedagogical aspect. Every numerical value representing a physical or chemical quantity must be
accompanied by its corresponding unit.40 Noteworthy, PLATA
provides specific feedback for each attempt, enabling students
to identify the source of their mistakes in their particular case
(Figure 4). In addition, PLATA offers students supplementary
content for reviewing the course, including book chapters and
links to peer-reviewed videos.13
Afterward, the design of exercises can be as complex as
desired, allowing for the integration of different resolution
steps within a single problem. For example, a problem may
involve balancing chemical equations, determining the limiting
reactant, and addressing various questions about the system
(Figure 5.).
Taking advantage of the versatility of PLATA, we designed
assignments for other courses on the platform, including
Figure 3. Example of a formula-type question in PLATA. (a, b) Two
different essays. Automated modifications are highlighted in red. The
exercise is presented in English, but its original version is in Spanish
(see Supporting Information Figure S1).
General Chemistry I and Organometallic Chemistry. General
Chemistry I is the initial chemistry course imparted at Facultad
́
de Quimica
at UNAM, attracting more than 1,600 students
enrolled per semester. Unlike General Chemistry II, which
covers several algebraic and numeric concepts throughout the
semester, General Chemistry I is more focus on conceptual,
historical, and descriptive aspects. Despite this, PLATA
enabled the generation of 13 assignments, each containing
10 questions. These assignments encompass a variety of
exercises, including multiple-choice, true/false, numerical,
short answer, matching, and formula-type exercises. Once
again, each exercise created was accompanied by specific
feedback and linked to academic material for reviewing the
topic. The primary aim of coding this introductory course is to
standardize the knowledge base among students who come
1026
https://doi.org/10.1021/acs.jchemed.3c00962
J. Chem. Educ. 2024, 101, 1024−1035
Journal of Chemical Education
pubs.acs.org/jchemeduc
Article
Figure 5. Example of an integral question in PLATA. Units, necessary
for answering correctly, are highlighted in red. The exercise is
presented in English, but its original version is in Spanish (see
Supporting Information Figure S3).
platform. PLATA was utilized as a training tool but was not
incorporated into the formal evaluation process.
We analyzed the outcomes of 408 students from five
different classes during the semester spanning from February
to June 2022, comparing their final exam results to their
engagement using PLATA. To accomplish this, we defined a
PLATA user as a student who completed a minimum of 8 out
of 13 assignments and successfully passed at least 4 of them.
Passing an assignment corresponds to a minimum grade of 6
out of 10. In fact, 74% of the students in these groups
completed at least 8 assignments, while 60% achieved favorable
grades in at least 4 of them. However, only 30% of the students
met both requirements. Applying these criteria, we observed
that 76% of users were successful in the final exam, while 79%
of nonusers failed the same examination (Figure 6). These
results clearly indicate that using PLATA as a training ground
and formative assessment is beneficial for the students,
enhancing their learning abilities and complementing the
didactic tools employed by each professor in the classroom.
We also monitored the frequency of access and use of
PLATA during the academic year 2022 for over 1,500 students.
As the semester progresses, the number of students using the
OER gradually decreases, while the average number of
attempts per quiz remains consistent (ca. 1.99 ± 0.18 attempts
per student). Indeed, the number of students using the
platform remained above 70% (out of 1551 students) during
the first two-thirds of the semester and then dropped to 35%
(Figure 7). The decrease in students’ involvement at this
particular point of the semester correlates with the timing of
the second evaluation. Students who have already failed one or
two partial evaluations may be compelled to take final exams,
and as a result they often drop the course. At Facultad de
́
Quimica,
it is common to have three partial evaluations during
Figure 4. Example of specific feedback in PLATA. Values and
compounds are highlighted in red in both the exercise enunciation
and the specific feedback. The exercise is presented in English, but its
original version is in Spanish (see Supporting Information Figure S2).
from diverse high schools across the country. In the context of
Organometallic Chemistry, our goal was to showcase the
versatility of PLATA by targeting upper-division students. For
this course, we had 26 students enrolled, and we generated 7
homework assignments, each with 5 questions. With these
three courses, we programmed 3,000 seed questions, resulting
in over 132 million displayed exercises over the last 4 years
(see Supporting Information).
3. STUDENTS’ OUTCOMES IN PLATA
In this section we will discuss some of the results gathered over
the last years during which PLATA has been fully operational
́
at the Facultad de Quimica.
We gained insight into the impact
of this virtual learning environment on student results by
comparing their scores in PLATA with their final course grades
within the academic year 2022. In that year, 3,232 students
were enrolled in the General Chemistry II course, with only
48% utilizing PLATA at least once. All students were
subscribed to the freely available Moodle uploaded OER.
The low participation rate may be attributed to various factors,
including limited student engagement or the fact that, in our
university, faculty members have academic autonomy, leading
to variations in the use of academic tools among different
teachers. To accurately assess students’ performance, we
selected five General Chemistry II classes taught by the
authors of this paper, resulting in a sample of ca. 400 students,
which represents 12% of the total student enrollment. In these
classes, teachers actively encouraged students to use the
1027
https://doi.org/10.1021/acs.jchemed.3c00962
J. Chem. Educ. 2024, 101, 1024−1035
Journal of Chemical Education
pubs.acs.org/jchemeduc
Article
Figure 6. Academic outcomes of PLATA users and nonusers during the first semester of 2022 (February to June) in the General Chemistry II
course. A user is defined as a student who completed at least 8 out of 13 assignments and passed at least 4 assignments.
Figure 7. Frequency of PLATA use and students’ results over 2022. Semester 1: August 2021−January 2022. Semester 2: February 2022−June
2022. Grades are on a 0 to 10 scale. HW stands for homework.
Figure 8. Advantages of PLATA for different types of users: students, teachers, and the Faculty Department.
the semester. Depending on the results of those evaluations,
students may be exempt from final examinations. However, the
evaluation criteria depend on the professor teaching the class.
As shown in Figure 7, the average grades per homework are
satisfactory or good, except for assignments 8 and 10, which
correspond to the topics of buffer solutions and selective
1028
https://doi.org/10.1021/acs.jchemed.3c00962
J. Chem. Educ. 2024, 101, 1024−1035
Journal of Chemical Education
pubs.acs.org/jchemeduc
Article
Figure 9. Students’ outcomes on the exit survey were evaluated on a scale from 1 to 10, where 1 represents “very poor” and 10 represents “very
high”.
precipitation, respectively. These two topics are challenging as
they require mastery of acid−base or precipitation equilibria
and the application of this knowledge to solve practical
problems. Identifying challenging subjects in the syllabus is a
key feature of PLATA.
As a matter of fact, we alerted the Department to explore
potential solutions, including reviewing the difficulty of these
specific exercises, reinforcing the aforementioned topics during
lectures, creating additional support content for the students,
and emphasizing the importance of solving these assignments
(Figure 8). Indeed, the results gathered through the use of
PLATA enabled internal discussion with the Department
regarding the development of a new curriculum for the General
Chemistry II course. Based on the platform’s results we
proposed an increase in lecture hours to enable teachers to
delve deeper into explanations on certain topics, particularly
the application of buffer solutions and selective precipitation.
Moreover, the proposal includes the development of
interactive teaching tools to assist students in understanding
these topics.
An exit survey was conducted with nearly 500 PLATA users
to evaluate their perception of the proposed tool (the quiz and
all results are available in the Supporting Information). In
general, students expressed high satisfaction with PLATA,
highlighting its usefulness, variety of exercises, and overall
difficulty (Figure 9). We observed that 87% of students found
PLATA to be a useful learning tool, rating it higher than 7 out
of 10 for the variety of exercises and indicating that the level of
difficulty was moderate. In addition, over 70% of students
considered it accessible, expressed a willingness to recommend
it to fellow undergraduates, and expressed a desire to have this
instrument available in other courses.
We collected comments from students at the end of the
semester (Figure 10). Overall, students expressed satisfaction
with their experience using PLATA. Many found the Open
Educational Resource to be highly beneficial for studying
throughout the semester and emphasized the importance of
specific feedback for each exercise. Nevertheless, a significant
number of students raised concerns about the narrow range for
Figure 10. Students’ outcomes on the exit survey.
correct answers and the lack of respect for significant figures in
the calculated numbers. PLATA users expressed frustration
with these issues. To address this feedback, we have adjusted
the correct answer’s interval to allow for numeric values within
a 5% margin of error. Additionally, we have introduced a
contact email address to receive and address comments and/or
complaints from students. Representative comments have been
translated and are provided below:
• I found the idea of PLATA very good; I like that the
number of attempts is not limited, and that feedback shows
the precise procedure to solve the problem immediately.
However, it is very strict with notation, allowing one correct
unit for each exercise. I think it is great for studying.
• The interval of correct answers should be more f lexible;
sometimes I consider one decimal and it marked me wrong. I
also spent a lot of time learning how to write numbers with
powers of ten.
• Honestly, I was delighted with PLATA; it helps me a lot for
understanding topics that we covered quickly in lectures. I
appreciate that the procedure is always very detailed and
that I could try as much as I wanted until I felt comfortable
with the topics.
• I like the project and I think is very usef ul. However, I felt
f rustrated many times because the platform penalizes
rounding up numeric values. I also think that it would be
great to have isolated exercises and not have to complete all
the homework to get feedback.
1029
https://doi.org/10.1021/acs.jchemed.3c00962
J. Chem. Educ. 2024, 101, 1024−1035
Journal of Chemical Education
pubs.acs.org/jchemeduc
Article
engage in 480 h of work over a period of six to 12 months.
According to Mexico’s Ministry of Public Education
(Secretariá de Educación Pública, SEP) approximately
780,000 higher education students complete more than 375
million hours of Social Service every year.44 Recently, PLATA
has been incorporated as a Social Service program for last-year
undergraduate students interested in the production of
educational material. At present, PLATA has two students
involved in the program, each of them in charge of creating
complementary material for the General Chemistry II course
focused on titration experiments and determination of
concentrations at equilibrium. This means that, in addition
to the 132 million exercises already available, the database can
continue to expand and cover topics that are equally important
and interesting for students, especially in the laboratory area
where manual skills can be complemented with numerical
exercises. This demonstrates that PLATA still has a lot to offer,
and as will be seen below, it can be useful for more courses.
PLATA can also be seen as a means to bolster team building
and facilitate the development and nurturing of a sense of
community among students. Indeed, the platform will evolve
to be by the students, for the students. This way, undergraduates may feel like an important part of the project.
• The project is great. I feel that my ability to solve problems
has increase, and that makes me very happy.
• I was very pleased with the platform. Will it be available in
other courses soon? Sometimes I found small errors, how can
I contact you?
4. OTHER IMPORTANT FEATURES OF PLATA
PLATA during the COVID-19 Pandemic
The SARS-COV-2 global pandemic, which started at the end
of 2019, compelled each one of us to adopt to a new lifestyle.41
The government’s strategy to control this pandemic has
required the population to maintain a mutual healthy distance
and stay at home. This has had evident negative effects on
education, in particular, the teaching of chemistry, as
laboratories constitute an essential source of knowledge. At
́
the Facultad de Quimica
at UNAM, the suspension of face-toface classes began on March 2020 and ended in March 2022.
During this two year period, a large number of students were
required to attend virtual classes. In this context, PLATA,
which was already installed and fully functional at the Facultad
́
de Quimica,
served as an important tool for both teachers and
students. It allowed all members of our community to access a
free, asynchronous, and personalized problem-solving platform
with supporting content for their courses. It is important to
notice that several students were assigned supplementary tasks
at home during this period, leading them to focus on their
studies late at night. In this sense, the implementation of
asynchronous instruments was fundamental.
During the COVID-19 global health crisis, a major concern
among teachers was the need to prevent students from
cheating on examinations. To address this issue, a group of
professors planned exams on PLATA taking advantage of the
program-based questions. Indeed, a typical exam uploaded to
the platform consisted of 15 questions, each with at least 4
variable parameters. In addition, each quiz is presented with
sequential navigation; i.e., students cannot go back to previous
questions. The questions are also shuffled, so the order in
which they appear to the student is randomized. Taking this
into account, the probability of two students having the same
question is less than 0.000017%. As a result, PLATA proved to
be an incorruptible tool for examinations and was used for this
purpose. The main difficulties encountered by the students
were technical issues with their Internet network providers
during examinations, which, in some rare cases, resulted in
disconnection and thus truncated evaluations. Nevertheless,
while PLATA proved valuable as an assessment platform, we
maintain that its most potent use remains as a tool for
assignments, primarily due to the invaluable feedback it offers.
The Future of PLATA
The undeniable success of PLATA has motivated the authors
of this contribution to explore different directions and harness
its full potential. First, we will continue the ongoing work to
correct and improve the current platform. Students, who are
starting to get involved, along with teachers, will continuously
make efforts to enhance the existing database of exercises as
well as address technical and aesthetical issues. Additionally,
we will expand the scope of the OER platform to other
courses, particularly those in which first-year students struggle
the most: Introduction to Algebra, Calculus, Physics,
Thermodynamics, and Analytical Chemistry. Considering the
experience already gathered, we believe that these new courses
could be prepared in a short time. In fact, members of the
Physics and Theoretical Chemistry Department, Physical
Chemistry Department and Analytical Chemistry Department
́
at Facultad de Quimica
have recently started implementing
PLATA for Physics I, Thermodynamics and Analytical
Chemistry I courses, respectively.
Another interesting feature will involve the creation of
courses designed for high school students interested in
pursuing one of the six chemistry bachelor’s programs at the
́
Facultad de Quimica.
These courses aim to assist high school
students in preparing for the often challenging first year of
college. In reality, incoming freshmen often require some
adjustment time when transitioning to college life, primarily
due to advanced content and increased workload.
By utilizing PLATA prior to their enrollment, prospective
university students can identify their weaknesses and address
them before embarking on their college journey. At the
́
Facultad de Quimica,
approximately 50% of first-semester
students typically encounter difficulties in at least one course.
We firmly believe that implementing PLATA for preundergraduate students can play a crucial role in mitigating this high
failure rate.
Indeed, the Analytical Chemistry I course is taught in the
second term of the second academic year, creating almost a six
month gap after General Chemistry II. This gap is often
considered, among students and staff, a likely cause of lower
PLATA as a Social Service
The Universidad Nacional Autónoma de México (UNAM) is a
public institution dedicated to contributing to the common
good by educating socially responsible citizens.42,43 In this
context, Mexico is one of the few countries that requires
students enrolled in higher education programs to participate
in a mandatory Social Service program.40 Social Service is
similar to the Community Service required in some American
schools; however, in Mexico, social service activities must be
directly related to the student’s field of study. In Mexico, Social
Service programs play a critical role, benefiting marginalized
segments of society and fostering students’ awareness, making
them more aware and socially responsible. Typically, students
1030
https://doi.org/10.1021/acs.jchemed.3c00962
J. Chem. Educ. 2024, 101, 1024−1035
Journal of Chemical Education
pubs.acs.org/jchemeduc
Article
Figure 11. continued
1031
https://doi.org/10.1021/acs.jchemed.3c00962
J. Chem. Educ. 2024, 101, 1024−1035
Journal of Chemical Education
pubs.acs.org/jchemeduc
Article
Figure 11. Example of the generation of a formula-type question.
Computational Details and Areas for Improvement
grades in Analytical Chemistry I, as many of the relevant
concepts and skills taught in General Chemistry II are essential
for understanding this subsequent course. During a pilot trial, a
class of 58 Analytical Chemistry I students were given access to
a smaller subset of PLATA problems selected to help them
review key concepts and skills. Students were required to
provide evidence of visiting the platform, but the scores on the
problems were not factored into the overall grade. This
allowed students the flexibility to engage with the content to
the extent they personally preferred. The results of this trial
show that PLATA can serve as a predictive tool for student
performance. The final grade of each student was compared
with the grade obtained in the PLATA problem set. As
expected, students with good performances in PLATA
obtained high grades in their final exams, whereas those who
failed the assignments also failed the course (see Figure S4 in
the Supporting Information). A second trial is currently being
conducted to assess whether these results hold up with
different sets of students. Before long, a thorough statistical
analysis will be conducted to clearly demonstrate the
correlation between the use of PLATA and students’
performance, which will be an interesting avenue for future
research.
A typical formula-type question is built with four main
components: random variables, global variables, the question
itself, and feedback. The random variable allows the generation
of random values, such as pressure, temperature, or
concentration, as well as random numbers used within the
global variables. The global variables are strings of text or
values corresponding to different compounds and their
associated equilibrium constants. The randomly generated
value n allows the selection of the n object from the string in
the global variables. This permits variation among substances
or chemical equations and their related equilibrium constants
or molar masses, for example. The question section calls
objects from the strings, generating a new question each time a
student attempts it. Finally, the feedback section uses the
values and strings from the random and global variables to
provide a detailed explanation of the exercise resolution. We
present an example of the generation of a formula-type
question in Figure 11.
As a result, the screen in Figure 12 is presented to the
student.
The PLATA task group is currently in the process of
transitioning to Python programming to unlock various
capabilities and reduce server time usage. Through this
1032
https://doi.org/10.1021/acs.jchemed.3c00962
J. Chem. Educ. 2024, 101, 1024−1035
Journal of Chemical Education
pubs.acs.org/jchemeduc
Article
They can learn both from the specific feedback provided by the
exercises and from books and videos embedded in the
assignments. Contrary to other platforms, PLATA is
programmed to randomly modify not only numeric values
but also chemical substances, chemical reactions, and
equilibrium constants that are related with one another and
cannot vary independently. This has generated more than 132
million exercises. PLATA provides students with assignments
for general chemistry and upper-division courses. Its versatility
and robustness have empowered students to practice, study,
improve and learn independently. In academic terms, results
clearly showed that students who used PLATA regularly had
better performance in the final examinations compared to
those who did not (76% users passed the final examination,
while only 21% of nonusers passed). Moreover, our OER could
be used for examinations, even for a large number of students;
however, we believe that it is more powerful as a training tool
and for formative assessment. In an exit survey, students
expressed that PLATA is an easy-to-access, valuable, and useful
instrument for undergraduates and educators. Furthermore,
they expressed a desire to see it implemented in other courses.
The future of PLATA is secured and exciting, with many
opportunities for platform development now available. We
strongly believe that PLATA is a versatile, robust, compatible,
universal, and efficient open educational resource, an instrument that will have a significant impact on the education of the
next generations of chemists in our university.
■
ASSOCIATED CONTENT
sı Supporting Information
*
The Supporting Information is available at https://pubs.acs.org/doi/10.1021/acs.jchemed.3c00962.
Different questions and results on the survey (PDF)
(DOCX)
■
AUTHOR INFORMATION
Corresponding Authors
Miguel Reina − Departamento de Química Inorgánica y
Nuclear, Facultad de Química, Universidad Nacional
Autónoma de México, 04510 Ciudad de México, México;
orcid.org/0000-0003-4959-4105; Email: mreina.2404@
quimica.unam.mx
Eduardo Gabriel Guzmán-López − Departamento de
Química, Universidad Autónoma Metropolitana Unidad
Iztapalapa, 09340 Ciudad de México, México; orcid.org/
0000-0003-1443-4136; Email: [email protected]
Antonio Reina − Departamento de Química Inorgánica y
Nuclear, Facultad de Química, Universidad Nacional
Autónoma de México, 04510 Ciudad de México, México;
orcid.org/0000-0001-7527-7176;
Email: [email protected]
Figure 12. Students view of a programmed formula-type question.
approach, there will no longer be a need for strings as Python
can access existing and more comprehensive databases, thereby
expanding the range of substances and reactions accessible
within PLATA. Additionally, this shift will enable the inclusion
of embedded chemical structure drawing tools, making it easier
to create more intricate problem-solving exercises.
Authors
César Guzmán-López − Departamento de Química,
Universidad Autónoma Metropolitana Unidad Iztapalapa,
09340 Ciudad de México, México
Carlos Hernández-Garciadiego − Instituto de Matemáticas,
Universidad Nacional Autónoma de México, 04510 Ciudad
de México, México
María de los Á ngeles Olvera-León − Departamento de
Química Inorgánica y Nuclear, Facultad de Química,
5. CONCLUSIONS
PLATA is a novel open educational resource uploaded on
Moodle that enables students to practice by problem-solving.
1033
https://doi.org/10.1021/acs.jchemed.3c00962
J. Chem. Educ. 2024, 101, 1024−1035
Journal of Chemical Education
pubs.acs.org/jchemeduc
■
Universidad Nacional Autónoma de México, 04510 Ciudad
de México, México
Mario Alfredo Garcia-Carrillo − Departamento de Química
Orgánica, Facultad de Química, Universidad Nacional
Autónoma de México, 04510 Ciudad de México, México
Marco Antonio Tafoya-Rodríguez − Departamento de
Química Inorgánica y Nuclear, Facultad de Química,
Universidad Nacional Autónoma de México, 04510 Ciudad
de México, México
Victor Manuel Ugalde-Saldívar − Departamento de Química
Inorgánica y Nuclear, Facultad de Química, Universidad
Nacional Autónoma de México, 04510 Ciudad de México,
México; orcid.org/0000-0002-9625-8713
Itzel Guerrero-Ríos − Departamento de Química Inorgánica y
Nuclear, Facultad de Química, Universidad Nacional
Autónoma de México, 04510 Ciudad de México, México;
orcid.org/0000-0003-1741-9425
Laura Gasque − Departamento de Química Inorgánica y
Nuclear, Facultad de Química, Universidad Nacional
Autónoma de México, 04510 Ciudad de México, México;
orcid.org/0000-0001-9013-4771
Jorge M. del Campo − Departamento de Física y Química
Teórica, Facultad de Química, Universidad Nacional
Autónoma de México, 04510 Ciudad de México, México;
orcid.org/0000-0002-4195-3487
Daniela Franco-Bodek − Departamento de Química
Analítica, Facultad de Química, Universidad Nacional
Autónoma de México, 04510 Ciudad de México, México;
orcid.org/0000-0003-4841-3819
Rolando Bernal-Pérez − Secretaría Académica de Docencia,
Facultad de Química, Universidad Nacional Autónoma de
México, 04510 Ciudad de México, México
Milton Medeiros − Departamento de Fisicoquímica, Facultad
de Química, Universidad Nacional Autónoma de México,
04510 Ciudad de México, México; orcid.org/0000-00019317-9270
Armando Marín-Becerra − Departamento de Química
Inorgánica y Nuclear, Facultad de Química, Universidad
Nacional Autónoma de México, 04510 Ciudad de México,
México
Héctor García-Ortega − Departamento de Química Orgánica,
Facultad de Química, Universidad Nacional Autónoma de
México, 04510 Ciudad de México, México
Jesús Gracia-Mora − Departamento de Química Inorgánica y
Nuclear, Facultad de Química, Universidad Nacional
Autónoma de México, 04510 Ciudad de México, México
REFERENCES
(1) Wu, H.; Shah, P. Exploring visuospatial thinking in chemistry
learning. Sci. Educ. 2004, 88 (3), 465−492.
(2) Brown, T. L.; LeMay, H. E.; Bursten, B. E.; Brunauer, L. S.
Chemistry: The Central Science; Prentice Hall: Englewood Cliffs, NJ,
1997; Vol. 13.
(3) Talanquer, V. Macro, submicro, and symbolic: The many faces
of the chemistry “triplet. Int. J. Sci. Educ. 2011, 33 (2), 179−195.
(4) Reina, A.; Reina, M. Seguridad en el laboratorio: una
́ 2021, 32 (5), 45−58.
aproximación práctica. Educ. Quim.
(5) Johnstone, A. H. Why is science difficult to learn? Things are
seldom what they seem. J. Comput. Assist. Learn. 1991, 7, 75−83.
(6) Petillion, R. J.; McNeil, W. S. Johnstone’s triangle as a
pedagogical framework for flipped-class instructional videos in
introductory chemistry. J. Chem. Educ. 2020, 97 (6), 1536−1542.
(7) Philipp, S. B.; Johnson, D. K.; Yezierski, E. J. Development of a
protocol to evaluate the use of representations in secondary chemistry
instruction. Chem. Educ. Res. Pract. 2014, 15, 777−786.
(8) Reina, M.; This, H.; Reina, A. Improving the understanding of
chemistry by using the right words: A clear-cut strategy to avoid
misconceptions when talking about elements, chemical species,
compounds, molecules and substances. J. Chem. Educ. 2022, 99 (8),
2999−3006.
(9) Reina, M.; This, H.; Reina, A. Reply to “Using the right words in
the right way: atom, molecule, element, and compound. J. Chem. Educ.
2023, 100 (1), 7−9.
(10) Mahaffy, P. The future shape of chemistry education. Chem.
Edu. Res. Pract. 2004, 5 (3), 229−245.
(11) Sjostrom, J.; Talanquer, V. Humanizing chemistry education:
From simple contextualization to multifaceted problematization. J.
Chem. Educ. 2014, 91 (8), 1125−1131.
(12) Finkelstein-Fox, L.; Park, C. L.; Riley, K. E. Mindfulness and
emotion regulation: promoting well-being during the transition to
college. Anxiety Stress Coping 2018, 31 (6), 639−653.
(13) Reina, A.; García-Ortega, H.; Hernández-Ayala, L. F.;
Guerrero-Ríos, I.; Gracia-Mora, J.; Reina, M. CADMIO: creating
and curating an educational youtube channel with chemistry videos. J.
Chem. Educ. 2021, 98 (11), 3593−3599.
(14) Garnett, P. J.; Garnett, P. J.; Hackling, M. W. Students’
alternative conceptions in Chemistry: A review research and
implications for teaching and learning, Stud. Sci. Educ. 1995, 25 (1),
69−96.
(15) Novak, J. D. Learning science and the science of learning. Stud.
Sci. Educ. 1988, 15 (1), 77−101.
(16) Sáiz-Manzanares, M. C.; Rodríguez-Díez, J. J.; Díez-Pastor, J.
F.; Rodriguez-Arribas, S.; Marticorena-Sánchez, R.; Ji, Y.-P.
Monitoring of student learning in learning management systems: an
application of educational data mining techniques. Appl. Sci. 2021, 11,
2677.
(17) Arvidsson, I.; Hakansson, C.; Karlson, B.; Bjork, J.; Persson, R.
Burnout among Swedish school teachers − a cross-sectional analysis.
BMC Public Health 2016, 16, 823.
(18) Sowden, J. F.; Schonfeld, I. S.; Bianchi, R. Are Australian
teachers burned-out or depressed? A confirmatory factor analytic
study involving the Occupational Depression Inventory. J. Psychosom.
Res. 2022, 157, No. 110783.
(19) Gutentag, T.; Asterhan, C. S. C. Burned-out: middle school
teachers after one year of online remote teaching during COVID-19.
Front. Psychol. 2022, 13, No. 802520.
(20) Ozamiz-Etxebarria, N.; Idoiaga Mondragon, N.; Bueno-Notivol,
J.; Pérez-Moreno, M.; Santabárbara, J. Prevalence of anxiety,
depression, and stress among teachers during the COVID-19
pandemic: a rapid systematic review with meta-analysis. Brain Sci.
2021, 11, 1172.
(21) Ranga, J. S. Factors influencing student learning in semi-flipped
general chemistry courses. J. Chem. Educ. 2020, 97 (8), 2130−2139.
(22) Costa, A. M.; Escaja, N.; Fité, C.; González, M.; Madurga, S.;
Fuguet, E. Problem-based learning in graduate and undergraduate
Complete contact information is available at:
https://pubs.acs.org/10.1021/acs.jchemed.3c00962
Notes
The authors declare no competing financial interest.
■
Article
ACKNOWLEDGMENTS
This work has been carried out with the support of the
UNAM-DGAPA-PAPIME Program-PE203123. The authors
thank the meaningful discussions with all the faculty members
and students, especially to Dra. Karla Salas-Martin (FQ,
UNAM), M. en C. Adrián Espinoza-Guillén (Laboratorio de
Química Inorgánica Medicinal, FQ, UNAM), Dr. Bruno
Landeros Rivera (FQ, UNAM), and Dr. Mario RodríguezVarela (Laboratorio Universitario de Nanotecnología Ambiental, ICAT, UNAM).
1034
https://doi.org/10.1021/acs.jchemed.3c00962
J. Chem. Educ. 2024, 101, 1024−1035
Journal of Chemical Education
pubs.acs.org/jchemeduc
chemistry courses: face-to-face and online experiences. J. Chem. Educ.
2023, 100 (2), 597−606.
(23) Blizak, D.; Blizak, S.; Bouchenak, O.; Yahiaoui, K. Students’
Perceptions regarding the abrupt transition to online learning during
the covid-19 pandemic: case of faculty of chemistry and hydrocarbons
at the University of Boumerdes-Algeria. J. Chem. Educ. 2020, 97 (9),
2466−2471.
(24) Houseknecht, J. B.; Bates, L. K. Transition to remote
instruction using hybrid just-in-time teaching, collaborative learning,
and specifications grading for organic chemistry 2. J. Chem. Educ.
2020, 97 (9), 3230−3234.
(25) Panzarella, G.; Gualtieri, G.; Romeo, I.; Alcaro, S.
MedChemBlog: an innovative distance learning experience for
teaching medicinal chemistry. J. Chem. Educ. 2023, 100 (1), 232−242.
(26) Dias, S. B.; Hadjileontiadou, S. J.; Diniz, J.; Hadjileontiadis, L. J.
DeepLMS: a deep learning predictive model for supporting online
learning in the COVID-19 era. Sci. Rep. 2020, 10, No. 19888.
(27) Reina, A.; García-Ortega, H.; Gracia-Mora, J.; Marín-Becerra,
A.; Reina, M. Compounds and molecules: learning how to distinguish
them through an educational game. J. Chem. Educ. 2022, 99 (3),
1266−1271.
(28) Lovatt, J.; Finlayson, O. E.; James, P. Evaluation of student
engagement with two learning supports in the the teaching of 1st year
undergraduate chemistry. Chem. Educ. Res. Pract. 2007, 8 (4), 390−
402.
(29) Jiménez-Valverde, G.; Núñez-Cruz, E. Cooperación on line en
́
entornos virtuales en la enseñanza de la quimica.
Educ. Quim. 2009,
20 (3), 314−319.
(30) Antonoglou, I. D.; Charistos, N. D.; Sigalas, M. P. Design,
development and implementation of a technology enhanced hybrid
course on molecular symmetry: student’s outcomes and attitudes.
Chem. Educ. Res. Pract. 2011, 12, 454−468.
(31) Lau-González, M.; Jaúregui-Haza, U.; Pérez-Gramagtes, A.;
Fariñas-León, G.; Le Bolay, N. Supporting students’ learning to learn
in general chemistry using Moodle. J. Chem. Educ. 2014, 91 (11),
1823−1829.
(32) Muzyka, J. L. ConfChem conference on flipped classroom: justin-time teaching in chemistry courses with Moodle. J. Chem. Educ.
2015, 92 (9), 1580−1581.
(33) López, G. A.; Sáenz, J.; Leonardo, A.; Gurtubay, I. G. Use of the
Moodle platform to promote an ongoing learning when lecturing
general physics in the physics, mathematics and electronic engineering
programmes at the University of the Basque Country UPV/EHU. J.
Sci. Educ. Technol. 2016, 25, 575−589.
(34) Sáiz-Manzanares, M. C.; Marticorena-Sánchez, R.; GarcíaOsorio, C. I. Monitoring students at the University: design and
application of a Moodle plug-in. Appl. Sci. 2020, 10, 3469.
(35) Alier, M.; Casany, M. J.; Llorens, A.; Alcober, J.; d’Arc Prat, J.
Atenea exams, an IMS LTI application to solve scalability problems: a
study case. Appl. Sci. 2021, 11, 80.
(36) Martín-Blas, T.; Serrano-Fernández, A. The role of new
technologies in the learning process: Moodle as a teaching tool in
Physics. Computers and Education 2009, 52 (1), 35−44.
(37) Lazakidou, G.; Retalis, S. Using computer supported
collaborative learning strategies for helping students acquire selfregulated problem-solving skills in mathematics. Computers and
Education 2010, 54 (1), 3−13.
(38) Gladwin, R. P.; Margerison, D.; Walker, S. M. Computerassisted learning in chemistry. Computers and Education 1992, 19 (1−
2), 17−25.
(39) Islam, A. K. M. N. Investigating e-learning system usage
outcomes in the university context. Computers and Education 2013,
69, 387−399.
(40) Lhardy, C.; García-Ortega, H.; Gracia-Mora, J.; Marín-Becerra,
A.; Reina, A.; Reina, M. Unit Kemps: a matching card game to learn
physical quantities, its units, and its symbols. J. Chem. Educ. 2022, 99
(9), 3170−3176.
(41) WHO. International Health Regulations, WHA58.3; World
Health Organization: Geneva, Switzerland, 2005.
(42) Hartley, M.; Hollander, E. L. The Elusive Ideal: Civic Learning
and Higher Education in Institutions of Democracy: The Public Schools;
Fuhrman, S., Lazerson, M., Eds.; Oxford University Press: Oxford,
2005.
(43) Kim, K. S.; Rackus, D. G.; Mabury, S. A.; Morra, B.; Dicks, A. P.
The chemistry teaching fellowship program: developing curricula and
graduate student professionalism. J. Chem. Educ. 2017, 94, 439−444.
(44) Asociación Nacional de Universidades e Instituciones de Educación
Superior, El Servicio Social de la Educación Superior: Punto de
Articulación con el Entorno; ANUIES: México, DF, 2010.
1035
Article
https://doi.org/10.1021/acs.jchemed.3c00962
J. Chem. Educ. 2024, 101, 1024−1035
Descargar