BlueBRIDGE

September 2015 Activity

During the KickOff meeting in Pisa, FORTH introduced the main objectives of the Task 9.1.
As regards Data Access and Data Storage facilities FORTH plans to re-use already existing solutions provided from the gCube infrastructures and enhance them according to the needs.
As regards Data Discovery FORTH presented, a possible architecture for assisting the discovery of datasets (in particular for the biodiversity domain). Apart from that FORTH presented a proposed plan with deadlines for the T9.1 activities. The involved partners agreed to discuss the details and the actual plan of the task in a forth-coming face-2-face meeting (On November in Athens).

Short-term Plan / Task Milestones
- Inventory of already existing solutions from the gCube infrastructure that could/should be reused in BlueBRIDGE [Oct'2015]
- Specify the requirements (also identify if current solutions are not enough for the problem at hand) [Oct-Nov'2015]
- Design new functionalities [Nov-Dec'2015]
- Start the implementation of the new functionalities [Dec'2015-Feb'2015]

October 2015 Activity¶

During this period FORTH started working on 2 parallel activities. The first was an inventory of the solutions that already exist in the gCube as regards Data Storage, Discovery and Access. The second was an analysis of the requirements as regards the aforementioned functionalities.
The results have been performed in the set of slides that have been presented in the F2F meeting in Athens (http://goo.gl/nNWL58).
NKUA concentrated on fixing some dependencies with some gCube components
CNR worked on some issues on the performance of Thredds and several bugs with the HomeLibrary. Furthermore some new features of the HomeLibrary have been developed (as regards searching in specific folders, locking facilities, history enhancements, performance improvements).

November 2015 Activities

During this period the activities were focused on:

• the facets identification and their description. A first draft of the facets has already been identified and can be found at https://support.d4science.org/projects/bluebridge/wiki/On_Resources_Facets_Catalogues_and_the_Forthcoming_Information_System (#1310). The activities for the definition of the facets will continue also in December 2015.
• Several enhancements, bugs and new features of the Home Library have been carried out (#894, #710, #519, #724, #725, #739, #1059, #1118),
• Activities for correcting various issues with GisViewer has been initiated (#1283)
• Activities for assessing the differences in the performance of Thredds using different configurations (#1221)
• Fixed some issues occurred when building certain libraries (#921)
• Announced the release of the following components
  • org.gcube.data-transfer.uri-resolver.1-4-0 (#743)

December 2015 Activities¶

During this period the activities were focused on:
* Inspecting new functionalities as regards the transformation of the workspace as a widget and using it through various applications. (#1742)
* Working on the new resource model/description of resources using facets (#1827)
* Resolving several technical issues (#1440)

January 2016 Activities¶

During this period the activities revolved around:

• Inspecting new functionalities as regards the transformation of the workspace as a widget and using it through various applications (#1742)
• Working on the new resource model. More specifically several modifications to the model have been reported (#1827)
• Supporting data formats related to the Ecopath (EwE models) (#1777)
• Provision of full-text search over posts and comments (#2091)

February 2016 Activities¶

During this period the activities revolved around:

• Supporting of a full-text search mechanism over posts and comments (#2091)
• Defining the requirements for supporting data discovery services by exploiting semantic knowledge bases (#2246)
• Implementing new functionalities of the Home Library; support for zipping folder and excluding specific subfolders from the ZIP file (#2020, #2059)
• Fixing several issues of the Home Library:
  • prevent copying files into shared folders when the particular privileges are missing (#453)
  • properly removing a selection of multiple files or folders (#2021)
  • moved the functionality of messages retrieval to the Home Library webApp to improve the overall performance (#1786)

March 2016 Activities¶

During this period the activities revolved around:

• Investigation on the requirements for supporting data discovery services by exploiting semantic knowledge bases (#2246)
• Started the activities for enhancing the functionalities of Workspace Resources Explorer (#2546)

April 2016 Activities¶

During this period the activities revolved around:

• Developing new features for the Workspace Resources Explorer (#2546)
• Continued the discussions towards the exploitation of semantic knowledge bases for supporting data discovery (#2246)

Dear @marketak@ics.forth.gr as agreed during the last #PEC https://support.d4science.org/issues/2549 the activities we report in wp9 tasks as related tickets should be migrated to sub-tasks.

I am going to transform the current related activities that are not closed as sub-tasks. Please keep this change in mind for the future and upcoming activities reported under wp9 tasks T9.1

May 2016 Activities¶

During this period the activities revolved around:

• Development of Matware plugins for supporting the transformation of data for the construction of GRSF (#3926)
• Development of new facilities and portlets for the gCube seach framework (#3914)
• Update the functionality of Workspace Resources Explorer with new features (i.e. sorting, filtering) (#2546) and new functionalities (i.e. search) (#4124)

June 2016 Activities¶

During this period the activities revolved around:

• Development of MatWare plugins for supporting the construction of the GRSF KB (update plugins for FIRMS #3927, new plugins for RAM #3928, started developing plugins for FishSource #4284) (#3926)
• Finalized the new functionalities of Workspace Resources Explorer (#2546)
• A summary of the activities has been presented in the latest TCom. Furthermore the short-term plans (for the next 6 months) have been discussed in the latest TCom.

July and August 2016 Activities¶

During this period the activities revolved around:

• Development of MatWare plugins for supporting the construction of the GRSF KB (#3926); finalized development for some plugins (#3927) and continued working on others (#3928, #4284).
• Implementation of a new OAI-PMH harvester that will allow new sources to be harvested and made available through the infrastructure (#1442). Moreover a first version of a portlet for managing OAI-PMH sources has been developed (#3914).

September 2016 Activities¶

During this period the activities revolved around:

• Finalizing the development and testing of MatWare plugins for supporting the construction of the GRSF KB (#3928, #4284)
• Enhancements on Index and search facilities. More specifically: support harvesting data sources though OAI-PMH harvesting services and developing the corresponding portlet(#1440, #3914), support index fields groupings into semantically equal groups (#5129), support the provision of faceted searching (#1444), removed Resource Registry dependencies from Search, Index and DTS (#1438)
• Enhancing workspace explorer with new functionalities; in particular search facilities and loading resources from certain folders (#4124)
• Designing a front-end for MatWare (#4994)
• The storage manager was ported to the new Authorization 2 Framework (#4945) and a new feature allowing to temporary store files in a volatile area was implemented and released (#4839)
• On the HomeLibrary, a feature allowing Guest Access to Workspace Folders has been developed and released (read-only mode). The Workspace history keeps track of the information about these public access. (Feature #3782). HomeLibrary provides now support for the infrastructure Data Catalogue, methods to copy workspace files/folders in an ".catalogue" area before publishing such files on gCube Data Catalogue were developed and released. In addition, Home Library allows users to get a workspace item by catalogue ID and to get a list of catalogue items by workspace item ID.

October 2016 Activities¶

During this period the activities revolved around:

• Finalized with the development activities of MatWare plugins (in particular FishSource plugin (#4284)). After that some new requirements have emerged and the FishSource services started exposing more data (i.e. more fields) so the corresponding plugin should be updated respectively to reflect those changes(#5524)
• extending the StorageManager for objects stored in the volatile area (#5186)

November 2016 activities¶

During this month the activities revolved around

• updated home library with various new functionalities. More specifically for supporting conversation attachments (#5406), supporting downloading an entire folder in zip format(#5623) and uploading a zip file (#5716), retrieving the publicly available URL of a file (#5723), copying files of a VRE folder in a specific catalogue before publishing (#6041). Finally various fixes for retrieving the proper list of VRE folders (#5831).
• performing various refactorings in the search system and the index mechanism (#5661). The main rationale of this activity is to improve and facilities and the portability of the index/search.

December 2016 & January 2017 Activities¶

During this period the activities revolved around:

• Finalized the work on MatWare plugins for fetching data from remote sources, so that they can be transformed and ingested into the GRSF KB (#3926).
• Performing various refactorings in the search system and the index mechanism (#5661). The main rationale of this activity is to improve and facilities and the portability of the index/search.
• Worked on fixing several incidents with the workspace portlet (#6536, #6130, #6168, #6214)
• Enhancements of the Home library for supporting files versioning (#5165)
• Preparation for the 1st periodic review.

February 2017 activities¶

During this period the activities revolved around:

• Carrying out several enhancements in the Home Library for offering additional functionalities (i.e. versioning information and more informative versioning history) (#7236, #7237, #7238) and the Home Library API. (#7007, #7008, #7150)
• Preparation for the 4th TCom. In particular FORTH has prepared a proposal for the semantic enrichment of gCube Data Catalogue that will be presented and discussed in the forthcoming TCom.

March 2017 activities¶

During this period the activities revolved around:

• Updating the search portlet for offering more functionalities and enhanced preview of results (#5772, #6134)
• Performing various refactorings in the search system and the index mechanism. The main rationale of this activity is to improve and facilities and the portability of the index/search. This included modifying the cluster mechanism (#5665), customizing the title and snippet for data sources (#7888), using title and snippets in the index so that they can be exploited during search (#7889), exploiting external resources (i.e. opensearch compliant) (#7890, #7891)
• preparing a draft design and requirements for the semantic enhancement of gCube Data Catalogue. FORTH presented and discussed it in the 4th TCom (https://goo.gl/0OX5hH)

April 2017 Activities¶

During this period the activities revolved around:

• Performing various refactorings in the search system and the index mechanism (#5661) for improving the search facilities and the portability of the index/search. More specifically various updates have been carried out for exploiting the titles and snippets in the index (#7888, #7889), for adding external sources (#7890, #7891) and for the search portlet (#5772, #7954, #7956).
• Updating Matware plugins for fetching data from FishSource (for the purposes of GRSF) with respect to the new JSON contents of the data source (#8278).

May 2017 Activities¶

During this period the activities revolved around:

• Refactoring the search system and the index mechanism (#5661) for improving the search facilities and the portability of the index/search. More specifically the activities focused on the new clients for search and index (#5662). Furthermore an OAI-PMH publisher service has been implemented that expose the indexed data sources records with respect to the OAI-PMH specification (#8528).
• Implementing a harvester for the RDF contents of the Data catalog (#8365).
• Identifying the datasets - the ones that are already indexed - that could be published in the data catalogue (#8715).
• Updating the functionality of several MatWare plugins, based on the new requirements/recommendations and the updated data sources (#8278, #8786).

June 2017 Activities¶

During this period the activities revolved around:

• defining the process for publishing the indexed data sources into the D4Science Resource Catalog (#8715).
• a new proposal for enhancing the data discovery facilities of the resource catalogue through the semantic enrichment and exploitation of the catalogue entries. The proposal has been presented and discussed in the 5th Tcom (https://goo.gl/cUYmMP).

July - August 2017 activities¶

N/A

M25 - September 2017 activities¶

During this period the activities revolved around:

• Integrating a THREDDS synchronization feature with workspace (#9760)
• Implementing a data transfer geotk plugin (#8772)
• Updating the MatWare plugin for fetching data from FishSource (#9859)

M26 - October 2017 activities¶

During this period the activities revolve around:

• Updating the MatWare plugin for fetching data from the second version of the FishSource API (#9859)
• Tested the new THREDDS synchronization feature with workspace (#9760)

M27 - November 2017 activities¶

During this period the activities revolved around:

• Publishing the resources from the gcube search index to the resources catalog (#8715)
• proposal for enhancing the mappings between CKAN and RDF DCAT for exporting enriched RDF descriptions for the resource catalog (#10347)

M28 - December 2017 activities¶

During this period the activities revolved around:

• Carrying out the required changes in the resource catalog and the index API for enabling the retrieval and publishing of the index data in the resource catalog (related tickets: #8715, #10596, #10725, #10735)
• Proposal for enhancing the mappings between CKAN and RDF DCAT for exporting enriched RDF descriptions for the resource catalog (#10347)

M29-M30 - January-February 2018 activities¶

During this period the activities revolved around:

• Carrying out the required changes in the resource catalog and the index API for enabling the retrieval and publishing of the index data in the resource catalog (related tickets: #8715, #10735)