A preliminary study of peer assessment feedback within team software development projects

Tom Crick; Tom Prickett; Jill Bradnum

doi:10.1145/3478432.3499126

A preliminary study of peer assessment feedback within team software development projects

Tom Crick, Tom Prickett, Jill Bradnum

School of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Citations (Scopus)

35 Downloads (Pure)

Abstract

Team-based software development projects where teams of learners design and develop software artefacts are common in computing- related degree programmes in the UK and other jurisdictions. Peer assessment is a commonly used approach to ensure learners are fairly recognised and rewarded for their contributions to such projects. This poster presents a preliminary study analysing the relationship between peer marking using the Team-Q rubric and peer feedback from one cohort using open coding and sentiment analysis. The preliminary results from a UK institutional study (N=124) illustrate how learner behaviours within teams appear to impact upon peer scores and the sentiment and intensity of emotion expressed in peer feedback. Additionally, the results provide valuable insights into common behaviours within teams. Given the prominence of team projects in computing curricula, the insights offered from this UK institutional study can shape and inform future learning, teaching and assessment practice.

Original language	English
Title of host publication	SIGCSE 2022
Subtitle of host publication	Proceedings of the 53rd ACM Technical Symposium on Computer Science Education
Editors	Larry Merkle, Maureen Doyle, Kristin Stephens-Martinez , Judithe Sheard, Leen-Kiat Soh, Brian Dorn
Place of Publication	New York
Publisher	ACM
Pages	1169
Number of pages	1
Volume	2
ISBN (Print)	9781450390712
DOIs	https://doi.org/10.1145/3478432.3499126
Publication status	Published - 3 Mar 2022
Event	The 53rd Technical Sylmposium on Computer Science Education - Providence, Rhode Island, United States Duration: 2 Mar 2022 → 5 Mar 2022 Conference number: 53 https://sigcse2022.sigcse.org/

Conference

Conference	The 53rd Technical Sylmposium on Computer Science Education
Abbreviated title	SIGCSE TS 2022
Country/Territory	United States
City	Rhode Island
Period	2/03/22 → 5/03/22
Internet address	https://sigcse2022.sigcse.org/

Keywords

Peer assessment
team-based software projects
sentiment analysis

Access to Document

10.1145/3478432.3499126

teamSentimentPosterAccepted author manuscript, 406 KB

Cite this

Crick, T., Prickett, T., & Bradnum, J. (2022). A preliminary study of peer assessment feedback within team software development projects. In L. Merkle, M. Doyle, K. Stephens-Martinez , J. Sheard, L.-K. Soh, & B. Dorn (Eds.), SIGCSE 2022: Proceedings of the 53rd ACM Technical Symposium on Computer Science Education (Vol. 2, pp. 1169). ACM. https://doi.org/10.1145/3478432.3499126

Crick, Tom ; Prickett, Tom ; Bradnum, Jill. / A preliminary study of peer assessment feedback within team software development projects. SIGCSE 2022: Proceedings of the 53rd ACM Technical Symposium on Computer Science Education. editor / Larry Merkle ; Maureen Doyle ; Kristin Stephens-Martinez ; Judithe Sheard ; Leen-Kiat Soh ; Brian Dorn. Vol. 2 New York : ACM, 2022. pp. 1169

@inproceedings{797e9147777645d4a44c26591396cbb2,

title = "A preliminary study of peer assessment feedback within team software development projects",

abstract = "Team-based software development projects where teams of learners design and develop software artefacts are common in computing- related degree programmes in the UK and other jurisdictions. Peer assessment is a commonly used approach to ensure learners are fairly recognised and rewarded for their contributions to such projects. This poster presents a preliminary study analysing the relationship between peer marking using the Team-Q rubric and peer feedback from one cohort using open coding and sentiment analysis. The preliminary results from a UK institutional study (N=124) illustrate how learner behaviours within teams appear to impact upon peer scores and the sentiment and intensity of emotion expressed in peer feedback. Additionally, the results provide valuable insights into common behaviours within teams. Given the prominence of team projects in computing curricula, the insights offered from this UK institutional study can shape and inform future learning, teaching and assessment practice.",

keywords = "Peer assessment, team-based software projects, sentiment analysis",

author = "Tom Crick and Tom Prickett and Jill Bradnum",

year = "2022",

month = mar,

day = "3",

doi = "10.1145/3478432.3499126",

language = "English",

isbn = "9781450390712",

volume = "2",

pages = "1169",

editor = "Larry Merkle and Maureen Doyle and \{Stephens-Martinez \}, Kristin and Judithe Sheard and Leen-Kiat Soh and Brian Dorn",

booktitle = "SIGCSE 2022",

publisher = "ACM",

address = "United States",

note = "The 53rd Technical Sylmposium on Computer Science Education, SIGCSE TS 2022 ; Conference date: 02-03-2022 Through 05-03-2022",

url = "https://sigcse2022.sigcse.org/",

}

Crick, T, Prickett, T & Bradnum, J 2022, A preliminary study of peer assessment feedback within team software development projects. in L Merkle, M Doyle, K Stephens-Martinez , J Sheard, L-K Soh & B Dorn (eds), SIGCSE 2022: Proceedings of the 53rd ACM Technical Symposium on Computer Science Education. vol. 2, ACM, New York, pp. 1169, The 53rd Technical Sylmposium on Computer Science Education, Rhode Island, Rhode Island, United States, 2/03/22. https://doi.org/10.1145/3478432.3499126

A preliminary study of peer assessment feedback within team software development projects. / Crick, Tom; Prickett, Tom; Bradnum, Jill.
SIGCSE 2022: Proceedings of the 53rd ACM Technical Symposium on Computer Science Education. ed. / Larry Merkle; Maureen Doyle; Kristin Stephens-Martinez ; Judithe Sheard; Leen-Kiat Soh; Brian Dorn. Vol. 2 New York: ACM, 2022. p. 1169.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A preliminary study of peer assessment feedback within team software development projects

AU - Crick, Tom

AU - Prickett, Tom

AU - Bradnum, Jill

N1 - Conference code: 53

PY - 2022/3/3

Y1 - 2022/3/3

N2 - Team-based software development projects where teams of learners design and develop software artefacts are common in computing- related degree programmes in the UK and other jurisdictions. Peer assessment is a commonly used approach to ensure learners are fairly recognised and rewarded for their contributions to such projects. This poster presents a preliminary study analysing the relationship between peer marking using the Team-Q rubric and peer feedback from one cohort using open coding and sentiment analysis. The preliminary results from a UK institutional study (N=124) illustrate how learner behaviours within teams appear to impact upon peer scores and the sentiment and intensity of emotion expressed in peer feedback. Additionally, the results provide valuable insights into common behaviours within teams. Given the prominence of team projects in computing curricula, the insights offered from this UK institutional study can shape and inform future learning, teaching and assessment practice.

AB - Team-based software development projects where teams of learners design and develop software artefacts are common in computing- related degree programmes in the UK and other jurisdictions. Peer assessment is a commonly used approach to ensure learners are fairly recognised and rewarded for their contributions to such projects. This poster presents a preliminary study analysing the relationship between peer marking using the Team-Q rubric and peer feedback from one cohort using open coding and sentiment analysis. The preliminary results from a UK institutional study (N=124) illustrate how learner behaviours within teams appear to impact upon peer scores and the sentiment and intensity of emotion expressed in peer feedback. Additionally, the results provide valuable insights into common behaviours within teams. Given the prominence of team projects in computing curricula, the insights offered from this UK institutional study can shape and inform future learning, teaching and assessment practice.

KW - Peer assessment

KW - team-based software projects

KW - sentiment analysis

UR - https://www.scopus.com/pages/publications/85122610856

U2 - 10.1145/3478432.3499126

DO - 10.1145/3478432.3499126

M3 - Conference contribution

SN - 9781450390712

VL - 2

SP - 1169

BT - SIGCSE 2022

A2 - Merkle, Larry

A2 - Doyle, Maureen

A2 - Stephens-Martinez , Kristin

A2 - Sheard, Judithe

A2 - Soh, Leen-Kiat

A2 - Dorn, Brian

PB - ACM

CY - New York

T2 - The 53rd Technical Sylmposium on Computer Science Education

Y2 - 2 March 2022 through 5 March 2022

ER -

Crick T, Prickett T, Bradnum J. A preliminary study of peer assessment feedback within team software development projects. In Merkle L, Doyle M, Stephens-Martinez K, Sheard J, Soh LK, Dorn B, editors, SIGCSE 2022: Proceedings of the 53rd ACM Technical Symposium on Computer Science Education. Vol. 2. New York: ACM. 2022. p. 1169 Epub 2022 Mar 3. doi: 10.1145/3478432.3499126

A preliminary study of peer assessment feedback within team software development projects

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Embedding Dispositions in Peer Assessment for Software Teams: More than just a "Product'" Focus

Cite this