Project Activity #11014

Project WP #665: WP7 - Supporting Blue Environment: VREs Development [Months: 7-30]

Project Task #666: T7.1 Aquaculture Atlas Generation VRE [Months: 7-30]

Project Task #8830: developments of the online viewing and editing tools

Project Task #8831: Data Publication in two environments

add third study case

Added by Nicolas Longépé almost 2 years ago. Updated over 1 year ago.

Status:ClosedStart date:Jan 23, 2018
Priority:NormalDue date:
Assignee:Nicolas Longépé% Done:

100%

Sprint:WP07
Participants:1 - CNR, 12 - CLS, 5 - FAO
Milestones:
Duration:

Description

For the AAPS Shapefiles publisher to staging and public workspace, there is currently 2 proposed contries "Indonesia and Greece".
We need to implement a third study case Malta with the same typology than Greece with farm/cages stuffs.

How can we process for the DataMiner to work ? note the data for Malta is available in the appropriate directory (under data/)


Related issues

Blocked by BlueBRIDGE - Project Activity #11058: Issue with R package installation in Dataminer RProtoLab Closed Jan 26, 2018

History

#1 Updated by Emmanuel Blondel almost 2 years ago

  • Status changed from New to In Progress

#2 Updated by Emmanuel Blondel almost 2 years ago

#3 Updated by Emmanuel Blondel almost 2 years ago

  • % Done changed from 0 to 80

@nlongepe@cls.fr I've updated the business process to allow you work with Malta use case. However at that time it's not yet published. For this I need to pass through the RPrototyingLab as "staging area", and proceed in 3 steps requiring CNR intervention:
1/ Publish the updated process into RPrototypingLab (pending issue on that)
2/ Push the updated process into AAPS VRE (to be done by CNR)
3/ Hide the updated process into RPrototyingLab (to be done by CNR), as this data management process must not be available in this RPrototypingLab VRE

FYI, and AFAIK, this workflow is temporary. With the new SAI, we should be able to define visibility of a process, starting with the VRE visibility while keeping the RprototypingLab as "staging area" to push algorithms into a target VRE. @pasquale.pagano@isti.cnr.it please correct me if i'm wrong

#4 Updated by Pasquale Pagano almost 2 years ago

Yes, it is correct. With the new version, the algorithm may be private to a single user. It will still remain the need to pass for a staging VRE where to perform the test but the algorithm will not be visible to the other users of the staging VRE.

#5 Updated by Emmanuel Blondel almost 2 years ago

but this visibility policy starts with VRE right? at now I have to tell the SAI admin in CNR where to push, and in case (in most of cases) ask to hide the algorithm in RPrototypingLab, so the algorithm go through RPrototyingLab only for publication purpose, but it's not executable in RPrototypingLab, it's executable in its target VRE. Do you confirm this will be made easier?

#6 Updated by Pasquale Pagano almost 2 years ago

Emmanuel Blondel wrote:

but this visibility policy starts with VRE right? at now I have to tell the SAI admin in CNR where to push, and in case (in most of cases) ask to hide the algorithm in RPrototypingLab, so the algorithm go through RPrototyingLab only for publication purpose,

Not only for publication. A proto environment is used to validate the deployment and execution before deploying it in the production cluster.

but it's not executable in RPrototypingLab,

It remains executable in the RPrototypingLab.

it's executable in its target VRE. Do you confirm this will be made easier?

The workflow should be
a) a user exploits RProto to validate its implementation and to test its deployment in the proto environment.
b) when satisfied, the same user asks to publish the algorithm in one of the VREs where his/her is authorized through SAI.

The algorithm may remain in RProto as a private algorithm.
The publication in a production VRE is done through SAI and not anymore via a ticket.

#7 Updated by Emmanuel Blondel almost 2 years ago

As long the algorithm main remain private in RPrototypingLab, it's perfect. Thanks again for your clarifications

#8 Updated by Emmanuel Blondel almost 2 years ago

  • Assignee changed from Emmanuel Blondel to Giancarlo Panichi

@g.panichi@isti.cnr.it could you please do the following?

  • push AAPS_STAGING_PUBLISHER (updated in RPrototyping Lab) to AquacultureAtlasGeneration (AAPS) VRE, and replace existing one there
  • hide the following algorithms from RPrototypingLab (they should be only executable from AAPS):

AAPS_STAGING_PUBLISHER
AAPS_PUBLIC_PUBLISHER
AAPS_NASO_PUBLISHER

Thanks in advance

#9 Updated by Giancarlo Panichi almost 2 years ago

  • % Done changed from 80 to 90
  • Assignee changed from Giancarlo Panichi to Emmanuel Blondel

The algorithm is published in Production and the Proto Environment has been updated for the reported algorithms.

#10 Updated by Emmanuel Blondel almost 2 years ago

  • Assignee changed from Emmanuel Blondel to Nicolas Longépé
  • Participants 1 - CNR, 12 - CLS added

#11 Updated by Nicolas Longépé almost 2 years ago

thanks

what about the public publisher ? it seems to be not updated with Malta ?

#12 Updated by Nicolas Longépé almost 2 years ago

  • Assignee changed from Nicolas Longépé to Emmanuel Blondel

#13 Updated by Emmanuel Blondel almost 2 years ago

  • Assignee changed from Emmanuel Blondel to Giancarlo Panichi

Apologies, i've now pushed the AAPS_PUBLIC_PUBLISHER updated to RPrototypingLab. You can use it from there, and wait for @g.panichi@isti.cnr.it to move it to AAPS VRE.

#14 Updated by Nicolas Longépé almost 2 years ago

  • Priority changed from Normal to Urgent

@g.panichi@isti.cnr.it can you please do it asap ? as we would like to check this process from the webapp, and push the next version of the webapp today around 4 pm ?

Thanks

#15 Updated by Giancarlo Panichi almost 2 years ago

  • Assignee changed from Giancarlo Panichi to Nicolas Longépé

I have updated the algorithm AAPS_PUBLIC_PUBLISHER for the AquacultureAtlasGeneration VRE. The DataMiner services will be updated at 3:00 pm CET.
You can try the algorithm from 3:10 pm CET.

#16 Updated by Nicolas Longépé almost 2 years ago

Thanks for your reactivity.
I will test that at 3:11 pm :-)

#17 Updated by Nicolas Longépé almost 2 years ago

  • Assignee changed from Nicolas Longépé to Massimiliano Assante

Thanks its works

The new version of the webapp including Malta has been pushed.
It is working nominaly here:
https://aquacultureatlas.d4science.org/aquacultureatlas/

@massimiliano.assante@isti.cnr.it why the updated version do not appear from here https://i-marine.d4science.org/group/aquacultureatlasgeneration/aaps ?

#18 Updated by Emmanuel Blondel almost 2 years ago

@nlongepe@cls.fr The Statistical Algorithm Importer (SAI) tool now supports management of Python scripts among other scripting & programming languages, and not only R anymore. Since your routine upstream the AAPS staging publisher is based on Python language, it would deserve trying to plug it through SAI to produce the zipped shapefile. That would be a great test case for SAI Python.

I invite you to have a look to the online documentation:
https://gcube.wiki.gcube-system.org/gcube/Statistical_Algorithms_Importer:_Python_Project
https://gcube.wiki.gcube-system.org/gcube/Statistical_Algorithms_Importer:_Python_Project_FAQ

Let me know!

#19 Updated by Nicolas Longépé almost 2 years ago

  • Priority changed from Urgent to Normal
  • Assignee changed from Massimiliano Assante to Nicolas Longépé

Nicolas Longépé wrote:

Thanks its works

The new version of the webapp including Malta has been pushed.
It is working nominaly here:
https://aquacultureatlas.d4science.org/aquacultureatlas/

@massimiliano.assante@isti.cnr.it why the updated version do not appear from here https://i-marine.d4science.org/group/aquacultureatlasgeneration/aaps ?

The two versions are now aligned ...

#20 Updated by Nicolas Longépé almost 2 years ago

  • % Done changed from 90 to 100

#21 Updated by Pasquale Pagano almost 2 years ago

  • Tracker changed from Project Task to Project Activity

#22 Updated by Nicolas Longépé over 1 year ago

  • Status changed from In Progress to Closed

Also available in: Atom PDF