There are the main characteristics of a translation task according to the FEMTI report:
The Framework for Machine Translation Evaluation in ISLE is a resource that helps MT evaluators define contextual evaluation plans. FEMTI consists of two interrelated classifications or taxonomies: the first one lists possible characteristics of the contexts of use that are applicable to MT systems. The second one lists the possible characteristics of an MT system, along with the metrics that were proposed to measure them.
Evaluators using FEMTI specify the intended context of use for an MT system using the first classification, and submit it to FEMTI. In return, FEMTI proposes a set of quality characteristics that are relevant to that context, using its embedded knowledge base. Evaluators can modify this set of quality characteristics and select evaluation metrics for each of them, by browsing the second classification. Evaluators can then print the evaluation plan and execute the evaluation. To start using FEMTI, click on RUN FEMTI.
FEMTI is an evolving resource that is improved by its users: please send us your feedback using the comment links, either above or in any pop-up window that you might open. FEMTI helps people who want to compare several MT systems intended for a specific use, or who want to evaluate the suitability of a given system with respect to a given task, or who develop an MT system, or who want to learn about the needs of users to find niche applications for new MT systems.