Project Task #630

Project WP #629: WP4 - VREs Deployment and Operation [Months: 1-30]

T4.1 BlueBRIDGE Infrastructure Operation [Months: 1-30]

Added by Franco Zoppi about 4 years ago. Updated about 1 year ago.

Status:ClosedStart date:Aug 03, 2015
Priority:UrgentDue date:Sep 22, 2016
Assignee:Daniele Pavia% Done:

100%

Sprint:WP04
Lead beneficiary:3 - ENG Participants:1 - CNR, 11 - CITE, 4 - UOA
Milestones:
Duration: 299

Description

Task Leader: ENG; Participants: CNR, UOA, CITE;
This task delivers and operates the D4Science infrastructure by maintaining its federative mechanisms guaranteeing interoperability with (a) a set of selected external infrastructures providing biological, ecological and environmental resources, (b) authoritative repositories, and (c) the communities' tools, data and services. This activity also leverages on other supported initiatives, e.g. integration of D4Science with EGI federation planned in the EGI-ENGAGE initiative.
This task includes the deployment and operation of a comprehensive set of monitoring, alerting, and accounting services for all federated resources to guarantee the required SLAs. The infrastructure is operated according to a policy-based federation approach. This task also takes care of the configuration, operation and upgrade of sites contributing to BlueBRIDGE.


Subtasks

D4Science Infrastructure - Task #3181: Update RStudio on rstudio.d4science.orgClosed_InfraScience Systems Engineer

gCube - Feature #1405: Enable Federated login on services and iMarine GatewaysClosedMassimiliano Assante

Project Activity #1441: Integrate .Net algorithms on the BlueBRIDGE computing pla...RejectedPaolo Fabriani

Task #1461: Design the interface between the Statistical Manager and EwEClosedJeroen Steenbeek

Task #4924: Connect EwE desktop software to the BB cloud for running ...RejectedPaolo Fabriani

Task #4939: The authorization service has to return the email of the ...RejectedLucio Lelii

Task #1367: Pre-production infrastructure creationRejectedPaolo Fabriani

D4Science Infrastructure - Task #451: New VO creation for preproductionRejectedRoberto Cirillo

D4Science Infrastructure - Task #450: Dismiss Ecosystem VO and related servicesClosedRoberto Cirillo

D4Science Infrastructure - Task #449: New root VO creation for pre productionClosedDaniele Pavia

D4Science Infrastructure - Task #1795: new test portal @ENGClosedDaniele Pavia


Related issues

Related to D4Science Infrastructure - Task #896: Please create a testing cluster for couchdb Closed Oct 06, 2015 Oct 16, 2015
Related to D4Science Infrastructure - Task #898: Dedicate two hosts to the dev/preprod cluster Closed Oct 06, 2015 Oct 16, 2015
Related to D4Science Infrastructure - Task #899: New VM for the couchdb dev cluster haproxy frontend Closed Oct 06, 2015 Oct 16, 2015
Related to D4Science Infrastructure - Task #110: Create 3 Virtual Machine for developement to host new noS... Closed Jun 19, 2015
Related to D4Science Infrastructure - Task #324: Install haproxy as couchdb frontend Closed Jun 30, 2015 Oct 16, 2015
Related to D4Science Infrastructure - Task #1218: Ganglia monitoring for the couchdb cluster Closed Oct 22, 2015
Related to D4Science Infrastructure - Task #1219: Configure couchdb on the production nodes Closed Oct 22, 2015 Oct 30, 2015
Related to D4Science Infrastructure - Task #1226: Migrate databases from accounting-d4s.d4science.org to co... Closed Oct 23, 2015 Oct 23, 2015
Related to D4Science Infrastructure - Task #1227: Replicate couchdb01-d-d4s.d4science.org databases with co... Closed Oct 23, 2015
Related to D4Science Infrastructure - Task #1273: Check CA hierachy of GARR certificates issued by TERENA t... Closed Oct 29, 2015 Oct 30, 2015
Related to D4Science Infrastructure - Task #4670: Endow database with PostGis functions Closed Jul 07, 2016

History

#1 Updated by Franco Zoppi about 4 years ago

  • Parent task set to #629

#2 Updated by Franco Zoppi about 4 years ago

  • Status changed from New to In Progress

#3 Updated by Franco Zoppi about 4 years ago

  • Subject changed from T4.1 BlueBRIDGE Infrastructure Operation to T4.1 BlueBRIDGE Infrastructure Operation [Months: 1-30]

#4 Updated by Franco Zoppi about 4 years ago

  • Start date changed from Sep 11, 2015 to Sep 01, 2015

#5 Updated by Massimiliano Assante about 4 years ago

Please @paolo.fabriani , assign this task to the T4.1 Task Leader

#6 Updated by Paolo Fabriani about 4 years ago

  • Assignee set to Daniele Pavia

#7 Updated by Gabriele Giammatteo about 4 years ago

September 2015 Activities
* milestone MS2 "BlueBridge Gateway" has been achieved (CNR) by deploying an instance of gCube portal to host the VREs of the project.

Next six months planned activities
* set-up of a separate infrastructure to host testing and preproduction environments

#8 Updated by Pasquale Pagano about 4 years ago

  • % Done changed from 0 to 10

The infrastructure and its services are fully-operational starting from the kick-off event. The exploitation of it in the community is considerably growing.

#9 Updated by Gabriele Giammatteo about 4 years ago

October 2015 Activities
ENG and CNR collaborated to design the new preproduction infrastructure. ENG started to deploy the enabling services and an instance of the portal at the ENG side

#10 Updated by Luca Frosini about 4 years ago

October 2015 Activities
CNR deployed CouchDB clusters (production, preproduction, development) to support HA (High Availability) for such a technology. This clusters are used by Accounting, Authorization, SmartExecutor.
Referenced taks: #896 #898 #899 #110 #324 #1218 #1219 #1226 #1227 #1273

#11 Updated by Luca Frosini about 4 years ago

  • Related to Task #896: Please create a testing cluster for couchdb added

#12 Updated by Luca Frosini about 4 years ago

  • Related to Task #898: Dedicate two hosts to the dev/preprod cluster added

#13 Updated by Luca Frosini about 4 years ago

  • Related to Task #899: New VM for the couchdb dev cluster haproxy frontend added

#14 Updated by Luca Frosini about 4 years ago

  • Related to Task #110: Create 3 Virtual Machine for developement to host new noSQL Db cluster added

#15 Updated by Luca Frosini about 4 years ago

  • Related to Task #324: Install haproxy as couchdb frontend added

#16 Updated by Luca Frosini about 4 years ago

  • Related to Task #1218: Ganglia monitoring for the couchdb cluster added

#17 Updated by Luca Frosini about 4 years ago

  • Related to Task #1219: Configure couchdb on the production nodes added

#18 Updated by Luca Frosini about 4 years ago

  • Related to Task #1226: Migrate databases from accounting-d4s.d4science.org to couchdb01-d-d4s.d4science.org added

#19 Updated by Luca Frosini about 4 years ago

  • Related to Task #1227: Replicate couchdb01-d-d4s.d4science.org databases with couchdb02-d-d4s.d4science.org added

#20 Updated by Luca Frosini about 4 years ago

  • Related to Task #1273: Check CA hierachy of GARR certificates issued by TERENA to create a truststore to add to production nodes added

#21 Updated by Luca Frosini about 4 years ago

  • Related to Task #1225: Add ServiceEndpoint for accounting system in pre production environment added

#22 Updated by Luca Frosini about 4 years ago

  • Related to deleted (Task #1225: Add ServiceEndpoint for accounting system in pre production environment)

#23 Updated by Gianpaolo Coro about 4 years ago

#24 Updated by Massimiliano Assante about 4 years ago

  • Related to Feature #1405: Enable Federated login on services and iMarine Gateways added

#25 Updated by Massimiliano Assante almost 4 years ago

  • Related to Task #450: Dismiss Ecosystem VO and related services added

#26 Updated by Massimiliano Assante almost 4 years ago

  • Related to Task #451: New VO creation for preproduction added

#27 Updated by Gabriele Giammatteo almost 4 years ago

November 2015 Activities

  • gCube 3.9.0 has deployed in pre-production and production infrastructures
  • the root VO of the pre-production infrastructure has been deployed accordingly with the decisions taken at Athens f2f meeting. This activity is still in progress and will be completed during the next month

#28 Updated by Gabriele Giammatteo almost 4 years ago

December 2015 Activities

  • the configuration of pre-production infrastructure continued. The activity could not be finished in December because of network issues ENG-side that needs to be solved in order to make the infrastructure available to the consortium

#29 Updated by Gabriele Giammatteo almost 4 years ago

January 2016 Activities

  • no major or new updates to be reported in this task

#30 Updated by Gabriele Giammatteo almost 4 years ago

Feb 2016 Activities

  • problems with the ROOT VO of the new pre-production infrastructure have been fixed

#31 Updated by Gabriele Giammatteo over 3 years ago

Mar 2016 Activities

  • no relevant activities have been performed during this period on the testing infrastructure other than maintenance activities.

#32 Updated by Gabriele Giammatteo over 3 years ago

  • Related to deleted (Feature #1405: Enable Federated login on services and iMarine Gateways)

#33 Updated by Gabriele Giammatteo over 3 years ago

#34 Updated by Gabriele Giammatteo over 3 years ago

  • Related to deleted (Task #450: Dismiss Ecosystem VO and related services)

#35 Updated by Gabriele Giammatteo over 3 years ago

  • Related to deleted (Task #451: New VO creation for preproduction)

#36 Updated by Gabriele Giammatteo over 3 years ago

May 2016 Activities

  • upgrade of preproduction infrastructures started to allow testing of gCube 3.11.0
  • deployment plan for gCube 3.11.0 in the production infrastructure has been produced. The upgrade of the production is planned for June the 1st

#37 Updated by Gabriele Giammatteo over 3 years ago

June 2016 Activities

  • gCube 3.11 release has been deployed on D4Scienece production infrastructure
  • prepartion of development and preproduction infrastructures started. This activity will continue during next month during the integration of gCube 4 release

#38 Updated by Massimiliano Assante over 3 years ago

  • Related to Task #4670: Endow database with PostGis functions added

#39 Updated by Pasquale Pagano over 3 years ago

  • Due date changed from Sep 30, 2016 to Sep 22, 2016

due to changes in a related task

#40 Updated by Gabriele Giammatteo over 3 years ago

July/August 2016 Activity

  • preproduction infrastructure has been upgraded to gCube 4.0.0 during the integration of the release to carry out the deployment and functional tests
  • production infrastructure has been upgraded to gCube 4.0.0 after the release was closed

#41 Updated by Gabriele Giammatteo about 3 years ago

September 2016 Activity

  • ENG worked to update its testing infrastructure to keep it aligned with gCube releases to be able to support functional testing of some portlets in future releases.

#42 Updated by Gabriele Giammatteo about 3 years ago

October 2016 Activity

  • preprod infrastructure upgraded with gCube 4.1 at the beginning of the month to let testers carry out functional portlet tests;
  • production infrastructure upgraded to gCube 4.1 release at the end of the month;

#43 Updated by Gabriele Giammatteo about 3 years ago

November 2016 Activity

  • executed upgrade of components released with gCube 4.1.1;
  • preparation for gCube 4.2.0 testing;
  • started development on Ansible roles to automate testing infrastructure deployment. Begun testing these new roles by the end of the month;

#44 Updated by Gabriele Giammatteo almost 3 years ago

December 2016 and January 2017 Activity

  • migration of development infrastructure to Java 8 started. Status and issues are being traced in #6306
  • upgrade of the preprod and production infrastructures to gCube 4.2

#45 Updated by Gabriele Giammatteo almost 3 years ago

February 2017 Activities

  • upgrade of production with gCube 4.2.1
  • upgrade of pre-production with gCube 4.3.0
  • Java 8 Migration
  • further work on gCube enabling infrastructure automated deployment with ansible for our gCube testing infrastructure @ENG

#46 Updated by Gabriele Giammatteo over 2 years ago

March 2017 Activity

  • gCube 4.3.0 deployed on production
  • gcore ansible roles: our gcore ansible roles have been further developed. We're finally able to deploy a whole working gcore infrastructure (GHN and enabling services) plus a root VO and a portal instance from scratch in a matter of minute
    • next step will be to integrate this in the gCUbe build and testing pipeline
  • working on smartgears containerization: developed a basic ansible role that creates and instances a smartgears docker container

#47 Updated by Gabriele Giammatteo over 2 years ago

April 2017 Activity

  • migration to Java 8 of Development infrastructure completed (excepting for few nodes that cannot be migrated due to incompatibility of old libraries used by some old gCore services)
  • preprod and production infrastructures upgraded with gCube 4.4.0
  • Ansible roles for gCore and Smartgears Container
    • updated to ansible 1.12 (required some changes to the scripts)
    • all ENG roles have been published in the CNR Gitorious repository in order to make them available also in the CNR infrastructure (some integration/adaptation work is needed and being done during next month)

#48 Updated by Gabriele Giammatteo over 2 years ago

May 2017 Activity

  • JVM on dev and preprod nodes has been upgraded to version 1.8
  • deployment of gCube 4.5.0 started on preprod for testing

#49 Updated by Roberto Cirillo over 2 years ago

June 2017 Activity

  • JVM on production nodes has been upgraded to version 1.8
  • preproduction and production infrastructures upgraded with gCube 4.5.0
  • Refactored the gcube enabling services ansible roles and the orchestrator a bit to make it easier to keep working on integrating other roles. (#8394)

#50 Updated by Roberto Cirillo over 2 years ago

July & August 2017 Activity

  • preproduction and production infrastructures upgraded with gCube 4.6.0

#51 Updated by Gabriele Giammatteo about 2 years ago

September 2017 Activity

  • Pre-production and production infrastructures have been updated to the latest gCube release 4.6.1. #9366
  • deployment of gCube 4.7.0 started on Pre-production infrastructure #9824

#52 Updated by Gabriele Giammatteo about 2 years ago

October 2017 Activity

  • release gCube 4.7.0 has been deployed in production
  • pre-production and production infrastructures have been upgraded with gCube 4.7.1

#53 Updated by Roberto Cirillo about 2 years ago

November 2017 Activity

  • Pre-production and production infrastructures have been upgraded to the latest gCube release 4.8.0. #10073

#54 Updated by Roberto Cirillo almost 2 years ago

December 2017 Activity

  • Pre-production and production infrastructures have been upgraded to the latest gCube release 4.9.0. #10585

#55 Updated by Gabriele Giammatteo almost 2 years ago

January 2018 Activity

  • Pre-production infrastructure have been upgraded with gCube release 4.10.0 to start the functional testing of the release

#56 Updated by Pasquale Pagano over 1 year ago

  • Status changed from In Progress to Closed

Also available in: Atom PDF