New Productivity Assessment (PA) job

The project manager must fill out the Productivity Assessment job type form.

New PA job form fields

FIELD NAME	DESCRIPTION
Name	A unique and meaningful name for internal tracking.	Required
Min. evaluators	A job must have a minimum of one evaluator. More evaluators can be added later in the project, if necessary.	Required
End Date	Deadline for the evaluators. The end date can be modified later on.	Required
Randomize MT	When this box is ticked, the segments are shown to the evaluators out of order to avoid any bias in the evaluation.	Optional
Edit From Scratch	When this box is ticked, the translation (even if present in the source CSV file) will be hidden from the evaluator. This can be used for transcription purposes where the evaluator enters text that is then compared with the original target in the translation field of the source CSV using the Automated Evaluation feature.	Optional
Allow Showing Additional Info	When this box is ticked, Additional info can be displayed on Evaluation screen. For more information about the Additional Info format and supported tags, see Additional Info Format.	Optional
Allow Automated Evaluation	When this box is ticked, the automated evaluation is enabled for this job. Companion’s functionality of automated evaluation is used, where original translation from the source CSV file is compared to the final edited version of text provided by the evaluator.	Optional
Description	This optional field allows the project manager to add some additional meta data about the project.	Optional

PA input data format

The input data format requirements for Productivity Assessment jobs are as follows:

PA job input data

File format	CSV
Separator	Semicolon (;)
Number of MTPE segments	200
Number of HT segments	30
Number of control segments	5
Column 1: Source	The source text
Column 2: MT1	The MT output or human translation (in case of control segment)
Column 3: MT1_model_name	Name of the MT model, ‘HT’ (human translation) or ‘control’ (control segment)
Column 4: metadata	Internal metadata for tracking and data analysis
Column 5: Additional_information	Internal metadata for tracking and data analysis
Optional Column(at any position): Original_Id	Internal metadata for tracking Original data Id. Maximal length 64 characters
Optional Column(at any position): Domain	Internal metadata for tracking domain category. Maximal length 64 characters

Due to the nature of productivity assessments, they require a very specific data set. This includes MT segments, Human Translated (HT) segments and Control segments. The evaluator will be asked to post-edit the MT segments and translate the HT segments from scratch. The data has to reflect these activities; therefore the segment types must be populated in a single data set as follows:

MT segments

{{Source}};{{MT1}};{{MT1_model_name}};{{metadata}};{{Additional_information}}

HT segments

{{Source}};;HT;{{metadata}};{{Additional_information}}

Control segments

{{Source}};{{Human_translation}};control;{{metadata}};{{Additional_information}}