WP6 M2 Monthly Progress Report (Oct 2015)

Links: WP Issue: [#654]. Previous month: WP6-M01-MonthlyProgressReport. Next month: WP6-M03-MonthlyProgressReport

Note: Use bullets in sections

WP Summary

During October 2015 (M02) partners performed the following activities:

  • Elicitation of preliminary requirements for the VREs and internal services of the Blue Economy Pillar. Requirements raised try to cover both WP6 VRE's specific needs but also WP8 (Blue Skills needs) and will extend to other VREs.
  • Confronting significant challenges of the VRE implementation and adoption, such as the confidentiality issue for commercial-interest data sets and the computational complexity of its services. As a result initial concepts have been formed for anonymization (in general removal of information), parallelization etc
  • Surveying data providers and data sets and applicability w.r.t. technology, quality and licensing characteristics. The survey will continue in the upcoming period.
  • Deployment of infrastructure resources, mainly for experimentation on the feasibility of the various design concepts.
  • Partial conceptualization of solutions' design

Furthermore WP6 partners:

  • organized one internal formal meeting and several followup discussions on analyzing initial requirements and agreeing on process and a detailed short term plan
  • participated the Blue Commons meeting with the intention of understanding the core technology and facilitating its adoption
  • Submitted ideas on potential WP6 offerings to WP8 skills' building courses

T6.1 Performance evaluation, benchmarking and decision making in aquaculture VRE

During the reporting period partners proceeded with working on the following areas:

  • Elicitation of requirements for the services of the VRE
  • Building initial responses to challenges of the VRE, such as the selection of appropriate data sets and protection of data confidentiality.
  • Building familiarity of new partners with the gCube platform so that the VRE can effectively integrate into infrastructure operation.

Progress of Work

  • Launch the requirements elicitation process
  • Support of I2S in conceptualization and design of tools for the Task
  • Launch and coordination of the survey for candidate data sets
  • Gathering and testing candidate datasets
  • Testing of calling R code from Java application
  • Testing anonymization options for data contributors
  • Conceptualization of the design of solutions
  • Evaluation of known aquaculture sector KPIs and modeling methods for each one

UOA

  • Participation in requirement's elicitation in bilateral meetings with I2S.
  • Support of I2S in conceptualization and design of tools for the Task
  • Launch and coordination of the survey for candidate data sets

I2S

  • Testing of calling R code from Java application
  • Gathering and testing candidate datasets
  • Evaluation of known aquaculture sector KPIs and modeling methods for each one
  • Launch of the requirements elicitation process
  • Testing anonymization options for data contributors
  • Conceptualization of the design of solutions

Deviations from plans and corrective actions

Note: if any. Use bullets. Any references to partners should be in a parenthesis at the end of the bullet

UOA

none

I2S

none

Plans for next month

Note: add any short term plans for the activity

UOA

  • Finish the first round of requirements elicitation
  • Completed the first round of candidate dataset survey
  • Support partners in technology update
  • Evaluate the parallelization and scalability requirements/opportunities of algorithms

I2S

  • Finish first round the elicitation process with all stakeholders
  • Working proof of concept on Java - R connectivity
  • First Draft of Design Document

Risks

Note: identify any new, rising or diminishing risks

T6.2 Strategic Investment analysis and Scientific Planning/Alerting VRE

During M2 period partners work continued in the following areas:

  • Elicitation of preliminary requirements for the services of the VRE
  • Identification of platform integration needs
  • Conceptualization of the operation of the VRE and early design of the services that will meet the computational challenges of the VRE
  • Analysis of areas of intersection with the infrastructure so that the VRE can effectively consume infrastructure resources and possibly contribute to its core enhancement.
  • Deployment of initial resources for VRE development experimentation.

Progress of work

UOA

  • Launch of implementation of a generic layer for Spark for offering a generic platform for executing task models that carry complex algorithms. NOTE: The activity might be moved into WP9 if the implementation is found to be generic enough.
  • Launch of the deployment of a larger capabilities Apache Spark cluster (in progress)
  • Launch of the deployment of a larger hbase cluster (in progress)
  • Launch and completion of the deployment of a new HDFS cluster

CITE

  • Completion of the prototype implementation of a generic anonymization algorithm, as a result of bilateral discussions on data confidentiality in WP6.
  • Hosting and participation of the f2f meeting of WP6
  • Participation to sessions of Blue Commons meeting for harmonizing WP6 tools with platforms policies and technologies
  • Launching of a preliminary gap analysis for Geopolis porting to the gCube. The activity shows that initial Geopolis mandatory modifications will be in the areas of authentication / authorization and access to the GeoServer's backend. Other requirements will be further evaluated as their need and relevance becomes more prominent.

I2S

  • Finding and evaluating public data sources valuable for aquaculture sector
  • Designing a metadata layer to user contributed data in order to become useful for T6.2 #### FAO

Deviations from plans and corrective actions

Note: if any. Use bullets. Any references to partners should be in a parenthesis at the end of the bullet

UOA

none

CITE

none

I2S

none

FAO

none

Plans for next month

Note: add any short term plans for the activity

UOA

  • Continue work in bridging Apache Spark with infrastructure abstractions.
  • Consult partners in the parallelization of algorithms and conceptualization of technologies required.
  • Complete the deployment of analytics infrastructure elements.

CITE

  • Design elements of the solution.
  • Evaluate datasets as they are located

I2S

  • Define Metadata needed from users
  • Define aggregation of contributed Data in 6.1 VRE in order to be consumable from 6.2 VRE
  • Evaluate most usable public datasets

FAO

Risks

Note: identify any new, rising or diminishing risks

Meetings