Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Excerpt

Table of Contents
absoluteUrltrue

Div
IDline-seperator


2. EVAL Evaluations

2.1 Find and Access an Evaluation

EVAL Contractors have access to their Evaluations (once the corresponding Evaluation Contract is signed) in statuses/steps "CONTRACTED" (if the Specific Contract is linked to the Evaluation), "INCEPTION", "INTERIM", "SYNTHESIS" and "COMPLETED".

EVAL Experts have access to Evaluations (once the corresponding Evaluation Contract is signed) for which they have been selected and in Evaluation statuses/steps "CONTRACTED" (if the Specific Contract is linked to the Evaluation), "INCEPTION", "INTERIM", "SYNTHESIS" and "COMPLETED".

EVAL Reference Group Members (external) have access to Evaluations for which they have been added as evaluation stakeholders, and in all Evaluation statuses/steps.

...

The Evaluation Planning Phase consists of three statuses/steps in the system ("PLANNED", "TOR" and "CONTRACTED"), which correspond to the status of the Evaluation in the workflow. Each step is managed by the Evaluation actor(s) responsible for the specific step in the workflow, and is detailed for the phase in the sub-sections below.

Div
IDline-seperator


2.2.1 Evaluation Planned

The Evaluation Manager will create the Evaluation in OPSYS EVAL, and assign it to an Intervention. The Evaluation Manager enters the minimum required information to the Evaluation, and adds the evaluation stakeholders (Evaluation backup, M&E Focal Point, Reference Group Members, etc).

Note

Please note that Reference Group Members must have an active EU Login account prior to being added as an evaluation stakeholder to the Evaluation. For more information on how to create and/or manage your EU Login account, please view the EU Login Guide.

The Evaluation Manager adds the Evaluation to the Operational Evaluation Plan (OEP), and the Evaluation Contract is planned.

There is no action required in OPSYS EVAL from external actors for the Evaluation in status "PLANNED".

Once the creation of the Evaluation is completed and the Evaluation Contract is planned, the Evaluation Manager will submit the Evaluation in OPSYS EVAL to the next status/step "TOR".

Div
IDline-seperator


...

  1. Framework Contractors can respond to an invitation to participate by acknowledging the invitation and expressing willingness to participate.
  2. Framework Contractors complete their submissions and submit their offers.
  3. Once the Specific Contract is awarded to the EVAL Contractor, the Contract is prepared using the Terms of Reference (TOR) templates of the Framework Contract, and with the support of the methodological guidance. The approval of the TORs is requested from the external Reference Group Members of the Evaluation by the Contracting Authority.
  4. The EVAL Contractor confirms that the EVAL Expert(s) are available, and that they have their EU Login details.
  5. Once the Specific Contract is prepared and approved by the Contracting Authority, the EVAL Contractor signs the Contract, followed by the final signature of the Contract by the Contracting Authority.

There is no action required in OPSYS EVAL from external actors for the Evaluation in status "TOR".

...

After the signing of the Specific Contract by both parties, the EVAL Contractor can access and download the signed Specific Contract from the Funding and Tenders Portal.

If requested, the bank guarantee is provided by the EVAL Contractor.

If applicable, Pre-financing Payment process is initiated automatically by the Contracting Authority.

The Evaluation Manager will verify the stakeholders' information (including the EVAL Reference Group Members) for the Evaluation, and update if needed.

...

If defined in the Specific Contract, the EVAL Contractor and EVAL Expert(s) are automatically retrieved from the Specific Contract to the Evaluation.

When the Specific Contract is linked to the Evaluation, the Evaluation Manager will link the required Contractual deliverables to their associated Evaluation "INCEPTION", "INTERIM" and "SYNTHESIS" statuses/steps.

There is no action required in OPSYS EVAL from external actors for the Evaluation in status "CONTRACTED".

...

The Evaluation is now accessible to the EVAL Contractor and EVAL Expert(s) from OPSYS EVAL (via Results > Monitoring & Evaluation > Evaluations section of the Funding and Tenders Portal).

The management of Contract deliverables by the EVAL Contractor is performed from the Specific Contract. During the "INCEPTION" status/step of the Evaluation, the EVAL Contractor uploads and submits an Inception Report deliverable before the set deadline. Once the deliverables are submitted by the EVAL Contractor, a notification is sent to the Contracting Authority to review the deliverables. The Contracting Authority can add comments to the deliverable, and either send the deliverable back to the EVAL Contractor for revision, or approve the deliverable. When the deliverable is approved, the Evaluation Manager selects the relevant deliverable for the Evaluation to indicate that the deliverable has been correctly submitted, and the Evaluation can proceed to the next step.

There is no action required in OPSYS EVAL from external actors for the Evaluation in status "INCEPTION".

...

The management of Contract deliverables by the EVAL Contractor is performed from the Specific Contract. During the "INTERIM" status/step of the Evaluation, the EVAL Contractor uploads and submits an Interim Report deliverable (and any other required deliverable for this Evaluation status/step) before the set deadline. Once the deliverables are submitted by the EVAL Contractor, a notification is sent to the Contracting Authority to review the deliverables. The Contracting Authority can add comments to the deliverable, and either send the deliverable back to the EVAL Contractor for revision, or approve the deliverable. When the deliverable is approved, the Evaluation Manager selects the relevant deliverable for the Evaluation to indicate that the deliverable has been correctly submitted, and the Evaluation can proceed to the next step.

There is no action required in OPSYS EVAL from external actors for the Evaluation in status "INCEPTION".

...

The management of Contract deliverables by the EVAL Contractor is performed from the Specific Contract. During the "Synthesis" status/step of the Evaluation, the EVAL Contractor uploads and submits a Final Report deliverable (and any other required deliverable for this Evaluation status/step) before the set deadline. Once the deliverables are submitted by the EVAL Contractor, a notification is sent to the Contracting Authority to review the deliverablesThe Contracting Authority can add comments to the deliverable, and either send the deliverable back to the EVAL Contractor for revision, or approve the deliverable. When the deliverable is approved, the Evaluation Manager selects the relevant deliverable for the Evaluation to indicate that the deliverable has been correctly submitted.

For the Evaluation in OPSYS EVAL,a draft Conclusion, lessons learned and recommendations template becomes downloadable and must be completed by the EVAL Contractor or EVAL Expert(s). Alternatively, the Draft conclusion, lessons learned and recommendations form can be completed online (see below for details). For both the template and online form, conclusions, lessons learned and recommendations can be grouped and prioritised. The EVAL Contractor confirms that the Conclusion, lessons learned and recommendations template or form is set as final for the Evaluation.  

After successfully selecting the Final Report (and other(s) if applicable) deliverable in the Evaluation, and the Conclusions, lessons learned and recommendations are submitted by the  EVAL Contractor or EVAL Expert(s) and reviewed by the Evaluation Manager, the Evaluation Manager will submit the Evaluation in OPSYS EVAL to the next status/step "COMPLETED". The Contracting Authority manages the final payment and clearing of the pre-financing (if applicable).

...

To fill-in the Conclusions, lessons learned and recommendations, as EVAL Contractor or EVAL Expert(s), first find and access the Evaluation in OPSYS EVAL.

On the Evaluation page:

  • (Recommended) If you want to Fill Conclusions, lessons learned and recommendations via the online form, choose theFill Conclusions, lessons learned and recommendationsoption (1) and complete the online form; or
  • If you want to complete the Conclusions, lessons learned and recommendations via the downloadable template (editable PDF file), choose theDownload Conclusions. lessons learned and recommendations template” option (2) to download the PDF file to your computer and complete the file.


Image Modified


Via the online form

On the Evaluation Online Form page, select the Evaluation forms typeWith Clusters”, andthe form displays specific text boxes for the cluster(s):


Image Modified


For the Cluster 1 text box, enter the required information. If you wish to add more clusters, click on the add icon located on the right side of the box, and then at the bottom of the pagethe Cluster 2 panel is displayed.

Click on the down arrow of the Cluster 2 panel to expand the panel and enter the required information. If you wish to delete a cluster, click on the delete icon of the cluster to delete.


Image Modified


If you delete a cluster, click on the "Yes" button in the Confirmaton pop-up message to confirm that the chosen cluster can be deleted from the form. This action cannot be undone!


Image Modified


Alternatively, click on the “No” button to cancel the deletion.

How to enter the Conclusions, Lessons Learned and Recommendations

For each required cluster panel, click on the down arrow of the cluster panel to expand the panel and enter the description, conclusions, lessons learned and recommendations in the corresponding tabs and text boxes.

Note

Please note that all the fields are required, so if there there is no information or comment to be entered, you will need to enter"N/A" for the field. Otherwise, you will be blocked at the submission of the step.

In the Conclusions tab, enter the conclusions, and if needed, use the addImage Modified and deleteImage Modified icons to add or remove conclusions.


Image Modified


In the Lessons Learned tab, enter the lessons learned, and if needed, use the addImage Modified and deleteImage Modified icons to add or remove lessons learned.


Image Modified


In the Recommendations tab, enter the recommendations, and if needed, use the addImage Modified and deleteImage Modified icons to add or remove recommendations.


Image Modified


For each recommendation:

  • Select the Main implantation responsibility of the recommendation, and add a description;
  • Select the Main associated actors of the recommendation, and add a description;
  • For Linked Conclusion(s),link the recommandation to the corresponding conclusion(s) by indicating to which conclusion(s) the recommentation should be assigned (e.g. "C1" corresponds to Conclusion 1, ...). A recommendation can be linked to one or multiple conclusions;
  • Select the Priotity of the recommendation;
  • Select the Importance of the recommendation.

...

At any moment while completing the form, you can click on the "Save" button at the top right of the Evaluation Online Form page to save the form.


Anchor
SET-EVALUATION-FORM-FINAL
SET-EVALUATION-FORM-FINAL
How to set the status of the Conclusions, Lessons Learned and Recommendations as Final

When the required conclusions, lessons learned and recommendations are all completed and reviewed, click on the "Set as Final" button at the top right of the Evaluation Online Form pageto confirm the completion of the form.


Image Modified


Click on the "Yes" button in the Confirmaton pop-up message to confirm the completion of the Conclusions, lessons learned and recommendations form.


Image Modified


Alternatively, click on the “No” button to cancel the confirmed completion of the form.

If the Conclusions, lessons learned and recommendations form is successfully confirmed as completed, a green Success! message is displayed at the bottom right of the page, and:


Image Modified


  • The status of the Evaluation Online Form is updated to "Final".
  • The Conclusions, lessons learned and recommendations are registered and set to read-only.


Image Modified

Note

Please note that that if modifications are required to the Conclusions, lessons learned and recommendations form and the status of the form is "Final", you can revert back to the "Draft" status and apply the changes (by clicking on the "Set as Draft" button at the top right of the Evaluation Online Form page), as long as the Evaluation is still in status/step "SYNTHESIS".

Image Modified

Click on the “Back to Evaluation” button at the top of the Evaluation Online Form page to be re-directed back to Evaluation page.

Image Modified

Via the downloadable PDF template

Select the "With Clusters" option in the pop-up message when downloading the Conclusions, lessons learned and recommendations template.

Image Modified


1. Open the downloaded PDF template file.

...

4. Once the template file is saved, return to the Evaluation page in the system, click on the “Actions” button at the top right of the page and choose the “Upload Conclusions, lessons learned and recommendations template” option to upload the completed PDF file template from your computer to the system.


Image Modified


5. Once to have uploaded the completed template file, click on the "Submit" button to submit the template file.


Image Modified


6. Confirm the submission by clicking on the "Continue" button. Warning: The submission of the template file will overide the information on the online form!


Image Modified


If the Conclusions, lessons learned and recommendations template file was successfully uploaded, a green confirmation message will be displayed at the bottom right of the page.


Image Modified

Note

IMPORTANT NOTE: If you use the template file option, you still need to update the status of the Evaluation Online Form to "Final":

1. On the Evaluation page, select the "Fill Conclusions, lessons learned and recommendations" option to access the Evaluation Online Form.

Image Modified

2. Review the completed form and set the status of the Evaluation Online Form to "Final".

Div
IDline-seperator


2.4 Evaluation Completed

Following the submission and approval of the Final Report, the Conclusions, lessons learned and recommendations are submitted, and all the required deliverables are submitted, the Evaluation Manager sets the Evaluation in OPSYS EVAL to status/step “COMPLETED”. The Contracting Authority then manages the final payment and clearing of the pre-financing (if applicable).

Div
IDline-seperator


2.5 Response of Service and Follow-up Phases

For the Response of Service Phase, inputs provided in the Evaluation are disseminated to policy makers, concerned services and partners for future reference. The Evaluation Manager fills in the online template Response of the services Report with the resposes/feedback of the services involved.

...

The Response of Service and Follow-up phases are managed internally, so no action is required from external actors for these phases.

...