Peer Assessment of Webpage Design: Behavioral Sequential Analysis Based on Eye Tracking Evidence

  1. Peer_Assessment_of_Webpage_DesProvide the citation and attach a pdf of the article (10 pts) Pro Tip: You can use ZotZero, but check the output against the APA Style online guidelines

Hsu, T.-C., Chang, S.-C., & Liu, N.-C. (2018). Peer Assessment of Webpage Design: Behavioral Sequential Analysis Based on Eye Tracking Evidence. Educational Technology & Society, 21(2), 305+. https://link.gale.com/apps/doc/A537118920/AONE?u=klnb_fhsuniv&sid=AONE&xid=f94fc564

  1. What is the abstract of the article?  (10 pts) Tips: This is usually a 200 word or less article summary. The abstract is your only cut and paste answer.

This study employed an eye-tracking machine to record the process of peer assessment. Each web page was divided into several regions of interest (ROIs) based on the frame design and content. A total of 49 undergraduate students with a visual learning style participated in the experiment. This study investigated the peer assessment attitudes of the participants and found that they possessed highly positive attitudes towards and understanding of peer assessment. After comparing the results of the peer assessments and evaluation by experts, high consistency occurred when the design of the web page was concise; however, the consistency decreased when the web page content was too diverse. After comparing the peer assessment attitudes of the participants and their web page design scores, it was found that the web pages with concise designs attracted the visual-style students’ attention more and that there was a significant negative correlation for those students who possessed a more negative attitude toward peer assessment. In addition, the study further analyzed the visual-style students’ serial behaviors in the peer assessment process for each web page design. After comparing the evidence of each student’s eye movements and his/her evaluation results, it was found that the students who gave higher or lower scores had different eye movements. For the website scored as having the best design, the fixations and behaviors of the assessors giving higher scores were highly consistent with those of the experts, implying that the few assessors giving lower scores were relatively poor at peer assessment. On the contrary, for the website which was scored as having the worst design, the fixations and behaviors of the assessors giving lower scores were highly consistent with those of the experts. Consequently, from the eye fixation hotspot evidence, when the students were more concentrated on the peer assessment, their evaluated results were closer to those of the two experts. Finally, the study found that the eye fixation hotspots were the same as the key points planned by the student designers of the website which scored the highest, which provided the student designers with additional important eye-tracking feedback from the peer assessment activities.

  1. Was the study experimental or non-experimental? Explain, tell us what made that clear.  (10 pts)

The “Peer Assessment of Webpage Design” study was non-experimental. In this study, researchers measured the variable of eye movement occurring as participants viewed pages of websites. All participants were visual learners, and all participants viewed the same websites. The task required ranking the design of several websites, and researchers noted observations of eye movements.

  1. Was the research qualitative or quantitative? Again, explain. (10 pts)

The research was quantitative.  The researchers measured the levels of student concentration on the webpages they were viewing, using a Likert scale to assess numerically on a scale of 1 to 4, with 4 describing the most intense level of concentration.

  1. What was the population studied? (5 pts)

The population consisted of undergraduate students from a university in Taiwan. The participants were 20 to 21 years old. Only visual learners participated in the study.

  1. What sample was used for this study? (5 pts)

The sample consisted of 49 students, all of which had completed an e-learning course in web design. None of the students had experience with eye-tracking devices, and most students believe that peer reviews have a positive impact on learning and performance.

  1. What was the method of measurement? (10 pts)
    • If the research was quantitative, was the measurement scale used, Nominal, Ordinal, Interval, or Ratio?
    • If the research was qualitative, what data was collected?

The research used an ordinal measurement scale for the peer assessment and an interval measurement scale for the website rating.

  1. What was the method of analysis? (10 pts)
    • If the research was quantitative, what statistical tools were used to analyze the data?
    • If the research was qualitative, in what manner was the data analyzed?

The researchers instructed the participants to score each website for seven achievements on a numerical scale. Two professors created a scale for the peer assessment portion of the study. By comparing the scores for each student in both tests, they were able to determine the correlation between eye movement and the ratings assigned to each website.

  1. What was the conclusion of the study? (10 pts)

According to the results, the students who gave higher scores had different eye movements than those giving lower scores when viewing the web pages. Additionally, the results of the students who focused more intently on the peer review gave ratings that resembled the assessments of the experts. Furthermore, the students whose websites earned the highest ratings planned what the viewer would focus on and the eye tracking device registered that the eye movements of the viewers of those websites aligned with what the designers had planned.

  1. Why is this study useful to you? Explain in detail. (10 pts)

When designing a website, appealing design and graphics determine viewership and success. This study is valuable because it indicates that careful attention to font size and the attractive arrangement of text and graphics can radically change the effect of a webpage on users. Furthermore, details such as framework, placement of hyperlinks and logos, selection of colors and background, and simplicity have a powerful impact on the success of a website. As a future web designer, it is vital to understand what viewers think as they navigate through (or away from) a website. In addition, awareness of viewer reactions enables the designer to tailor websites for maximum viewer satisfaction. The importance of interesting text underscores the necessity of communicating with clarity, cogency, and humor. These factors all issue a challenge to the web designer and suggest that teamwork may be a critical factor in successful web design because few individuals could achieve all of these goals.

  1. What would be the next logical step in extending this study? (10 pts)

The next logical step would involve expanding the study to include more participants, and more websites to review. If participants included students who are not visual learners, as well as individuals who have not studied web design, the results could provide invaluable data, that would indicate facets of web design that appeal to diverse audiences. If members of various age groups and socioeconomic groups could participate in the study, the importance of the results would increase further. Finally, extending the study to eye motions reacting to websites on mobile phones and tablets would be a significant advance. Obviously, the possibilities for further research are vast, and the importance of the results is incalculable. Are there any websites that would not benefit from the knowledge of how to improve the design and increase viewership and viewer satisfaction?

0 thoughts on “Peer Assessment of Webpage Design: Behavioral Sequential Analysis Based on Eye Tracking Evidence

  1. Good day Rjbuck. I read through your article a few times. I think you did an understanding job with your chosen article peer review. I’ve played around with website design and would agree with your analysis that websites that posse multiple colors, wireframes and great content increase the viewers viewing pleasure. I can remember many years ago when websites began to become popular responsive websites were in great demand. Excellent review !

    1. Good day Rjbuck. I read through your article a few times. I think you did an understanding job with your chosen article peer review. I’ve played around with website design and would agree with your analysis that websites that posse multiple colors, wireframes and great content increase the viewers viewing pleasure. I can remember many years ago when websites began to become popular but no one was really designing responsive websites only because cell phone technology went from SMS, MMS to being able to replace having a computer for similar needs. These days responsive websites are the norm and are in great demand.

  2. Hey Rebecca,
    I honestly thought your article review was very interesting. Not being in the web design world, I had not thought through before in such detail how important placement and being concise could be. I see how the concept behind this study, tracking students eyes in order to find out what they are drawn too, is incredibly useful to future web designers like yourself. I also agree with your next logical step. Adding in more age groups, websites, and types of learners will give more data on what attracts the average person. Furthermore, conducting studies on those without any web design experience will also give more information that can be valuable to those trying to attract a different type of customer.

  3. Rebecca,
    I liked your article. I am fascinated by it and how they determined how good a website was or how high it scored by watching the persons eye movements. It’s different and I never would of thought that eye movements would be a final factor on how good a website was. I know that making sure you create good visuals, nice graphics and easy to read words are crucial when building a successful website. I remember the website I created in web design class, I had a great time building it. You did a great job on your article and think that if I don’t make it in Health Informatics, web design is my second choice!

Leave a Reply to Daryl Cancel reply

Your email address will not be published. Required fields are marked *