Microsoft Word – INFS7410-project-part-2-marking-sheet.docx
INFS 7410 Project Part 2 – Marking Sheet
Criterion % 7
100%
4
50%
FAIL 1
0%
IMPLEMENTATION
The ability to:
• Understand,
implement, and
execute
advanced IR
methods
• Perform text
processing
45 • Correct implementations
of all three of the methods
required by this project
specifications.
(80% for ANCE and
TILDEv2; 100% for ANCE,
TILDEv2, three-stage)
[9 marks]
• Correctly implements the ANCE
Dense Retriever of the methods
required by the project
specifications.
[5 marks]
• No implementation; OR
• Many errors in the implementation.
EVALUATION
The ability to:
• Empirically evaluate
and compare IR
methods
• Analyse the results of
empirical IR
evaluation
• Analyse the statistical
significance
difference between
IR methods’
effectiveness
45 • Correct empirical
evaluation has been
performed
• Uses all required
evaluation measures
• Reports all results for the
provided query sets into
appropriate tables
• Provides graphical analysis
of results on a query-by-
query basis using
appropriate gain-loss plots
• Provides correct statistical
significance analysis within
the result table; and
correctly describes the
statistical analysis
performed
• Provides a written
understanding and
discussion of the results
with respect to the
methods
[9 marks]
• Correct empirical evaluation has
been performed
• Uses all required evaluation
measures
• Reports all results for the provided
query sets into appropriate tables
• Provides graphical analysis of
results on a query-by-query basis
using appropriate gain-loss plots
• Does not perform statistical
significance analysis, or errors are
present in the analysis
[5 marks]
• No or only partial empirical evaluation
has been conducted, e.g. only on a
subset of topics
• Only report a partial set of evaluation
measures
WRITE UP
Binary score: 0/1
The ability to:
• Use fluent
language with
correct grammar,
spelling and
punctuation
• Use appropriate
paragraph,
sentence
structure
• Use appropriate
style and tone of
writing
• Produce a
professionally
presented
document,
according to the
provided
template
10 • Structure of the document
is appropriate and meets
expectations
• Clarity promoted by
consistent use of standard
grammar, spelling and
punctuation
• Sentences are coherent
• Paragraph structure
effectively developed
• Fluent, professional style
and tone of writing.
• No proof reading errors
• Polished professional
appearance
[2 marks]
• Written expression and
presentation are incoherent, with
little or no structure, well below
required standard
• Structure of the document is not
appropriate and does not meet
expectations
• Meaning unclear as grammar and/or
spelling contain frequent errors.
• Disorganised or incoherent writing.