Task #1419

Project WP #654: WP6 - Supporting Blue Economy: VREs Development [Months: 1-30]

Project Task #656: T6.2 Strategic Investment analysis and Scientific Planning/Alerting VRE [Months: 1-30]

Project Activity #1633: Blue Economy VRE#2 Software Implementation, Integration and Deployment (Stage 2)

Task #6101: Geospatial Analytics & Alerting Platform Implementation (Stage 2)

Task #7991: Distributed execution of investment opportunity evaluation algorithms

Implement Apache Spark abstractions for execution of customer code

Added by George Kakaletris almost 4 years ago. Updated over 1 year ago.

Status:ClosedStart date:Oct 01, 2015
Priority:NormalDue date:Feb 28, 2016
Assignee:Nikolas Laskaris% Done:

30%

Category:-
Sprint:WP06
Infrastructure:Development
Milestones:
Duration: 107

Description

A mechanism that allows WP6 VREs to execute their models on Apache Spark is required. The mechanism should:

  • Abstract access to infrastructure resources (storage, spark endpoints etc)
  • Abstract access to algorithm configuration
  • Facilitate the development of models
  • Facilitate the generation of provenance metadata

History

#1 Updated by George Kakaletris almost 4 years ago

  • Parent task changed from #654 to #656

#2 Updated by Leonardo Candela almost 4 years ago

It seems to me beneficial if this activity is performed by liaising with #688 T9.2 Data Analytics Facilities

#3 Updated by George Kakaletris over 3 years ago

  • Parent task changed from #656 to #1623

#4 Updated by George Kakaletris over 3 years ago

  • % Done changed from 0 to 30

#5 Updated by Dimitris Katris over 2 years ago

  • Parent task changed from #1623 to #6101

#6 Updated by Dimitris Katris over 2 years ago

  • Parent task changed from #6101 to #7991

#7 Updated by Leonardo Candela over 2 years ago

Please, see my request / comment at #1946#note-7

This activity might be of interest beyond WP6 domain, these abstractions can be exploited by DataMiner to execute tasks by relying on Spark ... is there any documentation to have a look at?

#8 Updated by Dimitris Katris over 1 year ago

  • Status changed from In Progress to Closed
  • Infrastructure Development added

Also available in: Atom PDF