Project Task #687

Project WP #686: WP9 - VRE Commons Development [Months: 1-30]

T9.1 Data Storage, Discovery and Access [Months: 1-29]

Added by Franco Zoppi about 4 years ago. Updated 3 months ago.

Status:ClosedStart date:Oct 19, 2015
Priority:HighDue date:Oct 13, 2017
Assignee:Yannis Marketakis% Done:

97%

Sprint:WP09
Lead beneficiary:8 - FORTH Participants:1 - CNR, 4 - UOA
Milestones:
Duration: 520

Description

Task leader: FORTH; Participants: CNR, UOA;
This task will develop a set of facilities to be used by VRE implementations for storing, discovering and accessing data of various typologies in a uniform way. These facilities will be implemented by extending the facilities offered by the gCube technology. For data storage, BlueBRIDGE will develop facilities enabling to seamlessly and efficiently store any file-based information by relying on the distributed storage infrastructure resulting from WP10 activities. Any file-based information will be stored by transparently equipping it with rich metadata and thus to guarantee current and future availability, e.g. store multiple copies. For data discovery, BlueBRIDGE will extend the gCube facilities to offer unified views over an heterogeneous and evolving information space by relying on semantic-based methodologies.
Specifically, top level ontologies (like MarineTLO) will be used for describing in a semantically rich way the available datasets to assist their discovery. Novel methods for summarisation of search results that are applicable over existing search systems will be developed (e.g. stochastic methods for results summarisation). For data access, BlueBRIDGE will consolidate and extend the gCube array of data-type specific services for accessing species data, geospatial data and tabular data. In particular, it will reinforce the mechanisms for data citation, provenance, and sharing.


Subtasks

Project Activity #1061: Requirements collection for Data Storage, Access and Disc...ClosedYannis Marketakis

Project Activity #1062: Inventory of currently existing solutions for T9.1ClosedYannis Marketakis

Task #2246: Defining the requirements a draft design for supporting D...ClosedYannis Marketakis

gCube - Feature #1442: Integrate OAI-PMH directly to harvesting/indexing mechanismClosedPanagiota Koltsida

gCube - Feature #3914: Develop a portlet for managing oai-pmh sourcesClosedPanagiota Koltsida

gCube - Feature #2546: Endow Workspace Resources Explorer with filtering and dis...ClosedFrancesco Mangiacrapa

Task #1806: Integrate X3ML engine with MatWareClosedYannis Marketakis

Task #3926: MatWare plugins development for GRSF sourcesClosedYannis Marketakis

Task #3927: Matware plugins development for FIRMS data sourceClosedYannis Marketakis

Task #3928: Matware plugins development for RAM data sourceClosedYannis Marketakis

Task #4284: Matware plugins development for FishSource data sourceClosedYannis Marketakis

Task #5524: Update MatWare plugin for FishSourceClosedYannis Marketakis

gCube - Feature #4595: Migrate Jackrabbit from Derby to PostgreSQLClosedValentina Marioli

gCube - Bug #4060: Bug saving AccountingItemClosedValentina Marioli

gCube - Bug #4586: HL cannot create ReportTemplateClosedValentina Marioli

gCube - Bug #4779: HL: short links are not generated from getPublicLink methodClosedValentina Marioli

gCube - Bug #4781: HL: application folders are not set as hidden when createdClosedValentina Marioli

gCube - Bug #4780: HL: Error unsharing foldersClosedValentina Marioli

gCube - Feature #2616: Adding examples to HL 2.0 API wikiClosedValentina Marioli

Project Activity #4994: MatWare web application designRejectedYannis Marketakis

gCube - Feature #5661: Refactoring of index and search mechanismClosedNikolas Laskaris

gCube - Feature #5662: Index and Search clientClosedNikolas Laskaris

gCube - Feature #1445: Enhance search results visualization ClosedNikolas Laskaris

gCube - Feature #5129: Enhance index field groupingsClosedNikolas Laskaris

gCube - Feature #6250: Modify search query submission on index to return also th...ClosedEfthymios Theodorakopoulos

gCube - Feature #1440: Remove index ingestion dependency to TreeManager ClosedNikolas Laskaris

gCube - Feature #1444: Provided faceted search capabilities at the backendClosedNikolas Laskaris

gCube - Feature #1438: Remove Resource Registry dependencyClosedNikolas Laskaris

gCube - Feature #5663: Integrate external sources into gcube index searchClosedNikolas Laskaris

gCube - Feature #5664: Datafusion on search resultsClosedNikolas Laskaris

gCube - Feature #5665: Modify index cluster mechanism to run cluster on VOsClosedNikolas Laskaris

gCube - Feature #5667: Implement a datasource/index management PortletClosedEfthymios Theodorakopoulos

gCube - Feature #6159: Extend service's search capabilities of querying individu...ClosedEfthymios Theodorakopoulos

gCube - Feature #5772: Enhance search portletClosedEfthymios Theodorakopoulos

gCube - Feature #6134: Search portlet enhancements / new featuresClosedNikolas Laskaris

gCube - Feature #6136: Search Portlet Enhancement - Enable searching on individu...ClosedEfthymios Theodorakopoulos

gCube - Feature #6137: Search portlet enhancement - Expose faceted search result...ClosedEfthymios Theodorakopoulos

gCube - Task #7888: Configure title and snippet for each datasource from inde...ClosedEfthymios Theodorakopoulos

gCube - Task #7889: Modify index and search backend to take into consideratio...ClosedEfthymios Theodorakopoulos

gCube - Task #7890: Introduce external sources logic on the index/search modulesClosedEfthymios Theodorakopoulos

gCube - Task #7891: Allow adding an external source from index-configurator a...ClosedEfthymios Theodorakopoulos

gCube - Task #7954: Search Portlet: Display the available data sources and al...ClosedEfthymios Theodorakopoulos

gCube - Task #7955: Search Portlet: Display the number of records per data so...ClosedEfthymios Theodorakopoulos

gCube - Task #7956: enhance results display in search portletClosedEfthymios Theodorakopoulos

Task #8278: Update MatWare (fetch) plugins for FishSourceClosedYannis Marketakis

Task #8365: Create a client that harvests the data catalog contents i...ClosedYannis Marketakis

Task #8366: Update components to build on Java 1.8RejectedYannis Marketakis

gCube - Task #8528: Implement an OAI-PMH publisher on top of the Index - Sear...ClosedEfthymios Theodorakopoulos

Task #8715: Publish the indexed Data Sources to the D4Science catalogueRejectedNikolas Laskaris

Task #8786: Enhance MatWare plugin for FIRMS to extract also Observat...ClosedYannis Marketakis

Task #9859: Update MatWare plugin for FishSourceClosedYannis Marketakis


Related issues

Related to gCube - Bug #549: Issue in Data Transfer usage of the StorageManager Closed Sep 07, 2015
Related to D4Science Infrastructure - Task #1221: Assess the difference in the performance of Thredds with ... Closed Oct 22, 2015
Related to D4Science Infrastructure - Task #1283: Thredds layers colors not visualised on GisViewer Closed Nov 23, 2015
Related to gCube - Support #921: BUILD-ISSUE: org.gcube.accounting.common-accounting-lib h... Closed Oct 08, 2015
Related to gCube - Feature #1118: Improving performance of Empty and Move to Trash methods Closed Oct 19, 2015
Related to gCube - Bug #1059: Do not show files of a trashed folder Closed Oct 16, 2015
Related to gCube - Feature #894: Home Library: WorkspaceMessageManager#sendMessageToPortal... Closed Oct 06, 2015 Oct 09, 2015
Related to gCube - Bug #710: Workspace error on file rename Closed Sep 15, 2015 Sep 29, 2015
Related to gCube - Bug #519: Cannot delete shared folder (even if I'm owner) Closed Sep 01, 2015
Related to gCube - Feature #724: HL Locking Closed Sep 18, 2015
Related to gCube - Feature #725: Enhancement to HL history Closed Sep 18, 2015
Related to gCube - Feature #739: Workspace search; limit to folder Closed Sep 23, 2015
Related to BlueBRIDGE - Task #1310: FORTH Facets Identification Closed Nov 06, 2015 Nov 20, 2015
Related to BlueBRIDGE - Task #1827: Description of a Dataset using Facets Closed Dec 15, 2015 Jan 15, 2016
Related to BlueBRIDGE - Task #1777: Ecopath taxonomy dataformats Rejected Dec 10, 2015 Oct 01, 2016
Related to gCube - Feature #2091: Provide Full-Text search capability over posts and comments Closed
Related to gCube - Feature #2020: Zip the contents of a folder without including the folder... Closed Jan 20, 2016
Related to gCube - Feature #2059: Zip a folder excluding specific subfolders Closed Jan 25, 2016
Related to gCube - Bug #453: Home Library: copying a read-only file to a shared folder Closed Aug 03, 2015
Related to gCube - Bug #2021: Bug removing multiple files Closed Jan 20, 2016
Related to gCube - Feature #1786: HomeLIbrary: Enhance Messages performance Closed Dec 10, 2015 Dec 23, 2015
Related to gCube - Feature #2234: HomeLibrary: Enhance Upload File operation performance Closed Feb 11, 2016
Related to gCube - Feature #2458: HL: add mime type to MimeTypeUtil Closed Mar 01, 2016
Related to gCube - Feature #2646: HL: Remove portalLogin in UserManager methods Closed Mar 15, 2016
Related to gCube - Feature #2505: Home Library Enhancement: getting zip file for list of Wo... Closed Mar 08, 2016
Related to gCube - Feature #2765: HL: add multiple properties to WorkspaceItem constructor Closed Mar 18, 2016
Related to gCube - Bug #2446: HL: renaming a file with an already existing name Closed Feb 29, 2016
Related to gCube - Support #2109: Investigating delays retrieving items in light tree Closed Feb 02, 2016
Related to gCube - Bug #2453: HL: Storage Exception not correctly propagated Closed Mar 01, 2016
Related to gCube - Bug #2457: HL: wrong path for subfolders of shared folders Closed Mar 01, 2016
Related to gCube - Bug #2650: HL: bug setting properties on workspaceItem Closed Mar 15, 2016
Related to D4Science Infrastructure - Incident #4182: Upload to workspace from Share Updates storage download p... Closed Jun 07, 2016 Jun 07, 2016
Related to D4Science Infrastructure - Incident #4179: Workspace URL items not working Closed Jun 07, 2016 Jun 10, 2016
Related to gCube - Bug #4139: Cannot obtain public URL for shared folders Closed May 30, 2016
Related to gCube - Feature #4219: Use storage ID to download files from storage Closed Jun 09, 2016
Related to gCube - Feature #4186: HL: Add time to live to cache Closed Jun 07, 2016
Related to gCube - Feature #4216: Set a folder as System Folder Closed Jun 09, 2016
Related to gCube - Bug #3425: Uploading a big file, size is not correctly calculated Closed Apr 15, 2016
Related to gCube - Bug #3195: HL: Move operation does not update parent id immediately Closed Apr 11, 2016
Related to gCube - Bug #2529: HomeLibrary: wrong mimetype in uploaded file Closed Mar 10, 2016
Related to gCube - Bug #2718: HL: cannot delete multiple gCubeItems Closed Mar 17, 2016
Related to gCube - Bug #2697: HL: moving a private folder containing shared folders Closed Mar 16, 2016
Related to D4Science Infrastructure - Task #2660: Workspace does not delete folders with subfolders Closed Mar 15, 2016
Related to BlueBRIDGE - Incident #2443: BlueBRIDGE EAB VRE - Recently updated files is not working Closed
Related to BlueBRIDGE - Incident #2528: Workspace: Multiple upload does not suggest what to do wi... Closed Mar 10, 2016
Related to D4Science Infrastructure - Incident #2747: Messages Portlet: message status is always unread, for ev... Closed Mar 18, 2016 Mar 18, 2016
Related to gCube - Feature #4945: Pass StorageManager to Authorization 2.0 Closed Sep 06, 2016
Related to gCube - Feature #4839: Storage-manager: volatile area in a different backend Closed Aug 02, 2016
Related to gCube - Feature #5186: StorageManager: extend volatile suffix to smp and https p... Closed Sep 28, 2016
Related to gCube - Feature #3782: Access workspace using a guest user in read-only mode Closed Apr 21, 2016
Related to gCube - Feature #5093: Show public folders in a special folder Closed Sep 21, 2016
Related to gCube - Feature #5092: Adding Public Access to history Closed Sep 21, 2016
Related to gCube - Feature #5406: HomeLibrary: add support for conversation attachments Closed Oct 04, 2016 Oct 28, 2016
Related to BlueBRIDGE - Task #5623: HL Rest API: add a method to download a folder in zip format Closed Nov 02, 2016
Related to BlueBRIDGE - Task #5716: HL Rest API: add a method to upload a zip file Closed Nov 10, 2016
Related to BlueBRIDGE - Task #5723: HL Rest API: add a method to get the public URL of a file Closed Nov 10, 2016
Related to BlueBRIDGE - Task #5831: HL Rest API: add MySpecialFolder (VRE Folders) to list se... Closed Nov 21, 2016
Related to BlueBRIDGE - Task #6041: Home Library: add a "catalogue" area for VRE folder Closed Nov 25, 2016
Related to D4Science Infrastructure - Incident #6536: Workspace portlet: changing shared folder permissions res... Closed Jan 23, 2017 Jan 27, 2017
Related to BlueBRIDGE - Task #5165: Home Library should support versioning Closed Sep 27, 2016
Related to D4Science Infrastructure - Incident #6130: Workspace is broken in production Closed Dec 05, 2016 Dec 05, 2016
Related to D4Science Infrastructure - Incident #6168: Workspace portlet: search any term always return empty re... Closed Dec 11, 2016 Dec 17, 2016
Related to D4Science Infrastructure - Incident #6214: Workspace: Payload of Test Accounts 4 Portlet Testing Pla... Closed Dec 14, 2016 Dec 15, 2016
Related to D4Science Infrastructure - Task #6475: Undeploy gCubeApps/PGFA-UFMT VRE and deploy under D4Resea... Closed Jan 18, 2017 Jan 18, 2017
Related to BlueBRIDGE - Support #6851: Need further information to exploit Home Library REST API Closed Feb 02, 2017
Related to BlueBRIDGE - Task #7007: Add features to HL versioning Closed Feb 08, 2017
Related to BlueBRIDGE - Task #7008: Add versioning features to HL 2.0 API wiki Closed Feb 08, 2017
Related to D4Science Infrastructure - Task #7100: Assistance in using HomeLibrary REST Interface Closed Feb 17, 2017
Related to D4Science Infrastructure - Task #7150: Add cURL examples to HL Rest API wiki Closed Feb 17, 2017
Related to BlueBRIDGE - Task #7238: Convert not versionable nodes Closed Feb 24, 2017
Related to BlueBRIDGE - Task #7237: Get a single version Closed Feb 24, 2017
Related to BlueBRIDGE - Task #7236: Version history should return more information Closed Feb 24, 2017
Related to gCube - Feature #9760: WS-Thredds synch folder integration Closed Sep 22, 2017
Related to gCube - Release #8772: org.gcube.data-transfer.sis-geotk-plugin.1-0-0 Released May 26, 2017

History

#1 Updated by Franco Zoppi about 4 years ago

  • Start date changed from Sep 12, 2015 to Sep 01, 2015

#2 Updated by Franco Zoppi about 4 years ago

  • Subject changed from T9.1 Data Storage, Discovery and Access to T9.1 Data Storage, Discovery and Access [Months: 1-29]
  • Due date changed from Feb 28, 2018 to Jan 31, 2018

#3 Updated by Franco Zoppi about 4 years ago

  • Status changed from New to In Progress

#4 Updated by Massimiliano Assante about 4 years ago

  • Assignee set to Yannis Marketakis

#5 Updated by Gianpaolo Coro about 4 years ago

  • Related to Bug #549: Issue in Data Transfer usage of the StorageManager added

#6 Updated by Massimiliano Assante about 4 years ago

  • Start date set to Sep 01, 2015

due to changes in a related task

#7 Updated by Yannis Marketakis about 4 years ago

September 2015 Activity

During the KickOff meeting in Pisa, FORTH introduced the main objectives of the Task 9.1.
As regards Data Access and Data Storage facilities FORTH plans to re-use already existing solutions provided from the gCube infrastructures and enhance them according to the needs.
As regards Data Discovery FORTH presented, a possible architecture for assisting the discovery of datasets (in particular for the biodiversity domain). Apart from that FORTH presented a proposed plan with deadlines for the T9.1 activities. The involved partners agreed to discuss the details and the actual plan of the task in a forth-coming face-2-face meeting (On November in Athens).

Short-term Plan / Task Milestones
- Inventory of already existing solutions from the gCube infrastructure that could/should be reused in BlueBRIDGE [Oct'2015]
- Specify the requirements (also identify if current solutions are not enough for the problem at hand) [Oct-Nov'2015]
- Design new functionalities [Nov-Dec'2015]
- Start the implementation of the new functionalities [Dec'2015-Feb'2015]

#8 Updated by Gianpaolo Coro about 4 years ago

  • Related to Task #1221: Assess the difference in the performance of Thredds with and without nginx added

#9 Updated by Gianpaolo Coro about 4 years ago

  • Related to Task #1283: Thredds layers colors not visualised on GisViewer added

#10 Updated by Nikolas Laskaris about 4 years ago

  • Related to Support #921: BUILD-ISSUE: org.gcube.accounting.common-accounting-lib has been dismissed added

#11 Updated by Valentina Marioli about 4 years ago

  • Related to Feature #1118: Improving performance of Empty and Move to Trash methods added

#12 Updated by Valentina Marioli about 4 years ago

  • Related to Bug #1059: Do not show files of a trashed folder added

#13 Updated by Valentina Marioli about 4 years ago

  • Related to Feature #894: Home Library: WorkspaceMessageManager#sendMessageToPortalLogins method to return messageId and not Void added

#14 Updated by Valentina Marioli about 4 years ago

  • Related to Bug #710: Workspace error on file rename added

#15 Updated by Valentina Marioli about 4 years ago

  • Related to Bug #519: Cannot delete shared folder (even if I'm owner) added

#16 Updated by Valentina Marioli about 4 years ago

#17 Updated by Valentina Marioli about 4 years ago

#18 Updated by Valentina Marioli about 4 years ago

  • Related to Feature #739: Workspace search; limit to folder added

#19 Updated by Yannis Marketakis about 4 years ago

October 2015 Activity

During this period FORTH started working on 2 parallel activities. The first was an inventory of the solutions that already exist in the gCube as regards Data Storage, Discovery and Access. The second was an analysis of the requirements as regards the aforementioned functionalities.
The results have been performed in the set of slides that have been presented in the F2F meeting in Athens (http://goo.gl/nNWL58).
NKUA concentrated on fixing some dependencies with some gCube components
CNR worked on some issues on the performance of Thredds and several bugs with the HomeLibrary. Furthermore some new features of the HomeLibrary have been developed (as regards searching in specific folders, locking facilities, history enhancements, performance improvements).

#20 Updated by Yannis Marketakis about 4 years ago

  • Related to Task #1310: FORTH Facets Identification added

#21 Updated by Francesco Mangiacrapa about 4 years ago

  • Related to Release #743: org.gcube.data-transfer.uri-resolver.1-4-0 added

#23 Updated by Yannis Marketakis about 4 years ago

November 2015 Activities

During this period the activities were focused on:

#24 Updated by Luca Frosini almost 4 years ago

  • Related to Feature #1440: Remove index ingestion dependency to TreeManager added

#25 Updated by Yannis Marketakis almost 4 years ago

  • Related to Task #1827: Description of a Dataset using Facets added

#26 Updated by Yannis Marketakis almost 4 years ago

December 2015 Activities

During this period the activities were focused on:
* Inspecting new functionalities as regards the transformation of the workspace as a widget and using it through various applications. (#1742)
* Working on the new resource model/description of resources using facets (#1827)
* Resolving several technical issues (#1440)

#27 Updated by Gianpaolo Coro almost 4 years ago

  • Related to Task #1899: Host the Sardara DB within the e-Infrastructure added

#28 Updated by Gianpaolo Coro almost 4 years ago

  • Related to Task #1777: Ecopath taxonomy dataformats added

#29 Updated by Massimiliano Assante almost 4 years ago

  • Related to Feature #2091: Provide Full-Text search capability over posts and comments added

#30 Updated by Yannis Marketakis almost 4 years ago

January 2016 Activities

During this period the activities revolved around:

  • Inspecting new functionalities as regards the transformation of the workspace as a widget and using it through various applications (#1742)
  • Working on the new resource model. More specifically several modifications to the model have been reported (#1827)
  • Supporting data formats related to the Ecopath (EwE models) (#1777)
  • Provision of full-text search over posts and comments (#2091)

#31 Updated by Massimiliano Assante almost 4 years ago

  • Related to Feature #1445: Enhance search results visualization added

#32 Updated by Massimiliano Assante almost 4 years ago

  • Related to Feature #1444: Provided faceted search capabilities at the backend added

#34 Updated by Massimiliano Assante almost 4 years ago

  • Related to Feature #1438: Remove Resource Registry dependency added

#35 Updated by Massimiliano Assante almost 4 years ago

  • Related to deleted (Task #1899: Host the Sardara DB within the e-Infrastructure)

#36 Updated by Yannis Marketakis almost 4 years ago

  • Related to Task #2246: Defining the requirements a draft design for supporting Data(set) Discovery added

#37 Updated by Valentina Marioli almost 4 years ago

  • Related to Feature #2020: Zip the contents of a folder without including the folder itself added

#38 Updated by Valentina Marioli almost 4 years ago

  • Related to Feature #2059: Zip a folder excluding specific subfolders added

#39 Updated by Valentina Marioli almost 4 years ago

  • Related to Bug #453: Home Library: copying a read-only file to a shared folder added

#40 Updated by Valentina Marioli almost 4 years ago

  • Related to Bug #2021: Bug removing multiple files added

#41 Updated by Valentina Marioli almost 4 years ago

  • Related to Feature #1786: HomeLIbrary: Enhance Messages performance added

#42 Updated by Yannis Marketakis almost 4 years ago

February 2016 Activities

During this period the activities revolved around:

  • Supporting of a full-text search mechanism over posts and comments (#2091)
  • Defining the requirements for supporting data discovery services by exploiting semantic knowledge bases (#2246)
  • Implementing new functionalities of the Home Library; support for zipping folder and excluding specific subfolders from the ZIP file (#2020, #2059)
  • Fixing several issues of the Home Library:
    • prevent copying files into shared folders when the particular privileges are missing (#453)
    • properly removing a selection of multiple files or folders (#2021)
    • moved the functionality of messages retrieval to the Home Library webApp to improve the overall performance (#1786)

#43 Updated by Yannis Marketakis over 3 years ago

March 2016 Activities

During this period the activities revolved around:

  • Investigation on the requirements for supporting data discovery services by exploiting semantic knowledge bases (#2246)
  • Started the activities for enhancing the functionalities of Workspace Resources Explorer (#2546)

#44 Updated by Massimiliano Assante over 3 years ago

  • Related to Feature #2546: Endow Workspace Resources Explorer with filtering and display features added

#45 Updated by Yannis Marketakis over 3 years ago

April 2016 Activities

During this period the activities revolved around:

  • Developing new features for the Workspace Resources Explorer (#2546)
  • Continued the discussions towards the exploitation of semantic knowledge bases for supporting data discovery (#2246)

#46 Updated by Panagiota Koltsida over 3 years ago

  • Related to Feature #3914: Develop a portlet for managing oai-pmh sources added

#47 Updated by Panagiota Koltsida over 3 years ago

  • Related to Feature #1442: Integrate OAI-PMH directly to harvesting/indexing mechanism added

#48 Updated by Massimiliano Assante over 3 years ago

Dear @marketak@ics.forth.gr as agreed during the last #PEC https://support.d4science.org/issues/2549 the activities we report in wp9 tasks as related tickets should be migrated to sub-tasks.

I am going to transform the current related activities that are not closed as sub-tasks. Please keep this change in mind for the future and upcoming activities reported under wp9 tasks T9.1

#49 Updated by Massimiliano Assante over 3 years ago

  • Related to deleted (Task #2246: Defining the requirements a draft design for supporting Data(set) Discovery)

#51 Updated by Massimiliano Assante over 3 years ago

  • Related to deleted (Feature #1440: Remove index ingestion dependency to TreeManager )

#52 Updated by Massimiliano Assante over 3 years ago

  • Related to deleted (Feature #1442: Integrate OAI-PMH directly to harvesting/indexing mechanism)

#53 Updated by Massimiliano Assante over 3 years ago

  • Related to deleted (Feature #1445: Enhance search results visualization )

#54 Updated by Massimiliano Assante over 3 years ago

  • Related to deleted (Feature #1444: Provided faceted search capabilities at the backend)

#56 Updated by Massimiliano Assante over 3 years ago

  • Related to deleted (Feature #1438: Remove Resource Registry dependency)

#57 Updated by Massimiliano Assante over 3 years ago

  • Related to deleted (Feature #3914: Develop a portlet for managing oai-pmh sources)

#58 Updated by Massimiliano Assante over 3 years ago

  • Related to deleted (Feature #2546: Endow Workspace Resources Explorer with filtering and display features)

#59 Updated by Massimiliano Assante over 3 years ago

  • Related to deleted (Release #743: org.gcube.data-transfer.uri-resolver.1-4-0)

#60 Updated by Valentina Marioli over 3 years ago

  • Related to Feature #2234: HomeLibrary: Enhance Upload File operation performance added

#61 Updated by Valentina Marioli over 3 years ago

  • Related to Feature #2458: HL: add mime type to MimeTypeUtil added

#62 Updated by Valentina Marioli over 3 years ago

  • Related to Feature #2646: HL: Remove portalLogin in UserManager methods added

#63 Updated by Valentina Marioli over 3 years ago

  • Related to Feature #2505: Home Library Enhancement: getting zip file for list of WorkspaceItem added

#64 Updated by Valentina Marioli over 3 years ago

  • Related to Feature #2765: HL: add multiple properties to WorkspaceItem constructor added

#65 Updated by Valentina Marioli over 3 years ago

  • Related to Bug #2446: HL: renaming a file with an already existing name added

#66 Updated by Valentina Marioli over 3 years ago

  • Related to Support #2109: Investigating delays retrieving items in light tree added

#67 Updated by Valentina Marioli over 3 years ago

  • Related to Bug #2453: HL: Storage Exception not correctly propagated added

#68 Updated by Valentina Marioli over 3 years ago

  • Related to Bug #2457: HL: wrong path for subfolders of shared folders added

#69 Updated by Valentina Marioli over 3 years ago

  • Related to Bug #2650: HL: bug setting properties on workspaceItem added

#70 Updated by Yannis Marketakis over 3 years ago

May 2016 Activities

During this period the activities revolved around:

  • Development of Matware plugins for supporting the transformation of data for the construction of GRSF (#3926)
  • Development of new facilities and portlets for the gCube seach framework (#3914)
  • Update the functionality of Workspace Resources Explorer with new features (i.e. sorting, filtering) (#2546) and new functionalities (i.e. search) (#4124)

#71 Updated by Yannis Marketakis over 3 years ago

  • Due date changed from Jun 17, 2016 to Jul 15, 2016

due to changes in a related task

#72 Updated by Yannis Marketakis over 3 years ago

June 2016 Activities

During this period the activities revolved around:

  • Development of MatWare plugins for supporting the construction of the GRSF KB (update plugins for FIRMS #3927, new plugins for RAM #3928, started developing plugins for FishSource #4284) (#3926)
  • Finalized the new functionalities of Workspace Resources Explorer (#2546)
  • A summary of the activities has been presented in the latest TCom. Furthermore the short-term plans (for the next 6 months) have been discussed in the latest TCom.

#73 Updated by Valentina Marioli over 3 years ago

  • Related to Incident #4182: Upload to workspace from Share Updates storage download problem added

#74 Updated by Valentina Marioli over 3 years ago

#75 Updated by Valentina Marioli over 3 years ago

  • Related to Bug #4139: Cannot obtain public URL for shared folders added

#76 Updated by Valentina Marioli over 3 years ago

  • Related to Feature #4219: Use storage ID to download files from storage added

#77 Updated by Valentina Marioli over 3 years ago

#78 Updated by Valentina Marioli over 3 years ago

#79 Updated by Valentina Marioli over 3 years ago

  • Related to Bug #3425: Uploading a big file, size is not correctly calculated added

#80 Updated by Valentina Marioli over 3 years ago

  • Related to Bug #3195: HL: Move operation does not update parent id immediately added

#81 Updated by Valentina Marioli over 3 years ago

  • Related to Bug #2529: HomeLibrary: wrong mimetype in uploaded file added

#82 Updated by Valentina Marioli over 3 years ago

  • Related to Bug #2718: HL: cannot delete multiple gCubeItems added

#83 Updated by Valentina Marioli over 3 years ago

  • Related to Bug #2697: HL: moving a private folder containing shared folders added

#84 Updated by Valentina Marioli over 3 years ago

  • Related to Task #2660: Workspace does not delete folders with subfolders added

#85 Updated by Valentina Marioli over 3 years ago

  • Related to Incident #2443: BlueBRIDGE EAB VRE - Recently updated files is not working added

#86 Updated by Valentina Marioli over 3 years ago

  • Related to Incident #2528: Workspace: Multiple upload does not suggest what to do with duplicates added

#87 Updated by Valentina Marioli over 3 years ago

  • Related to Incident #2747: Messages Portlet: message status is always unread, for every message added

#88 Updated by Yannis Marketakis over 3 years ago

July and August 2016 Activities

During this period the activities revolved around:

  • Development of MatWare plugins for supporting the construction of the GRSF KB (#3926); finalized development for some plugins (#3927) and continued working on others (#3928, #4284).
  • Implementation of a new OAI-PMH harvester that will allow new sources to be harvested and made available through the infrastructure (#1442). Moreover a first version of a portlet for managing OAI-PMH sources has been developed (#3914).

#89 Updated by Nikolas Laskaris about 3 years ago

  • Due date changed from Sep 20, 2016 to Sep 23, 2016

due to changes in a related task

#90 Updated by Yannis Marketakis about 3 years ago

September 2016 Activities

During this period the activities revolved around:

  • Finalizing the development and testing of MatWare plugins for supporting the construction of the GRSF KB (#3928, #4284)
  • Enhancements on Index and search facilities. More specifically: support harvesting data sources though OAI-PMH harvesting services and developing the corresponding portlet(#1440, #3914), support index fields groupings into semantically equal groups (#5129), support the provision of faceted searching (#1444), removed Resource Registry dependencies from Search, Index and DTS (#1438)
  • Enhancing workspace explorer with new functionalities; in particular search facilities and loading resources from certain folders (#4124)
  • Designing a front-end for MatWare (#4994)
  • The storage manager was ported to the new Authorization 2 Framework (#4945) and a new feature allowing to temporary store files in a volatile area was implemented and released (#4839)
  • On the HomeLibrary, a feature allowing Guest Access to Workspace Folders has been developed and released (read-only mode). The Workspace history keeps track of the information about these public access. (Feature #3782). HomeLibrary provides now support for the infrastructure Data Catalogue, methods to copy workspace files/folders in an ".catalogue" area before publishing such files on gCube Data Catalogue were developed and released. In addition, Home Library allows users to get a workspace item by catalogue ID and to get a list of catalogue items by workspace item ID.

#91 Updated by Massimiliano Assante about 3 years ago

  • Related to Feature #4945: Pass StorageManager to Authorization 2.0 added

#92 Updated by Massimiliano Assante about 3 years ago

  • Related to Feature #4839: Storage-manager: volatile area in a different backend added

#93 Updated by Massimiliano Assante about 3 years ago

  • Related to Feature #5186: StorageManager: extend volatile suffix to smp and https protocols added

#94 Updated by Valentina Marioli about 3 years ago

  • Related to Feature #3782: Access workspace using a guest user in read-only mode added

#95 Updated by Valentina Marioli about 3 years ago

  • Related to Feature #5093: Show public folders in a special folder added

#96 Updated by Valentina Marioli about 3 years ago

  • Related to Feature #5092: Adding Public Access to history added

#97 Updated by Yannis Marketakis about 3 years ago

  • Due date changed from Sep 20, 2016 to Oct 28, 2016

due to changes in a related task

#98 Updated by Yannis Marketakis about 3 years ago

October 2016 Activities

During this period the activities revolved around:

  • Finalized with the development activities of MatWare plugins (in particular FishSource plugin (#4284)). After that some new requirements have emerged and the FishSource services started exposing more data (i.e. more fields) so the corresponding plugin should be updated respectively to reflect those changes(#5524)
  • extending the StorageManager for objects stored in the volatile area (#5186)

#99 Updated by Valentina Marioli about 3 years ago

  • Related to Feature #5406: HomeLibrary: add support for conversation attachments added

#100 Updated by Yannis Marketakis about 3 years ago

  • Due date changed from Oct 28, 2016 to Oct 31, 2016

due to changes in a related task

#101 Updated by Yannis Marketakis about 3 years ago

November 2016 activities

During this month the activities revolved around

  • updated home library with various new functionalities. More specifically for supporting conversation attachments (#5406), supporting downloading an entire folder in zip format(#5623) and uploading a zip file (#5716), retrieving the publicly available URL of a file (#5723), copying files of a VRE folder in a specific catalogue before publishing (#6041). Finally various fixes for retrieving the proper list of VRE folders (#5831).
  • performing various refactorings in the search system and the index mechanism (#5661). The main rationale of this activity is to improve and facilities and the portability of the index/search.

#102 Updated by Valentina Marioli about 3 years ago

  • Related to Task #5623: HL Rest API: add a method to download a folder in zip format added

#103 Updated by Valentina Marioli about 3 years ago

  • Related to Task #5716: HL Rest API: add a method to upload a zip file added

#104 Updated by Valentina Marioli about 3 years ago

  • Related to Task #5723: HL Rest API: add a method to get the public URL of a file added

#105 Updated by Valentina Marioli about 3 years ago

  • Related to Task #5831: HL Rest API: add MySpecialFolder (VRE Folders) to list servlet added

#106 Updated by Valentina Marioli about 3 years ago

  • Related to Task #6041: Home Library: add a "catalogue" area for VRE folder added

#107 Updated by Yannis Marketakis almost 3 years ago

December 2016 & January 2017 Activities

During this period the activities revolved around:

  • Finalized the work on MatWare plugins for fetching data from remote sources, so that they can be transformed and ingested into the GRSF KB (#3926).
  • Performing various refactorings in the search system and the index mechanism (#5661). The main rationale of this activity is to improve and facilities and the portability of the index/search.
  • Worked on fixing several incidents with the workspace portlet (#6536, #6130, #6168, #6214)
  • Enhancements of the Home library for supporting files versioning (#5165)
  • Preparation for the 1st periodic review.

#108 Updated by Valentina Marioli almost 3 years ago

  • Related to Incident #6536: Workspace portlet: changing shared folder permissions reset the Shared Folder administrators added

#109 Updated by Valentina Marioli almost 3 years ago

  • Related to Task #5165: Home Library should support versioning added

#110 Updated by Valentina Marioli almost 3 years ago

#111 Updated by Valentina Marioli almost 3 years ago

  • Related to Incident #6168: Workspace portlet: search any term always return empty results added

#112 Updated by Valentina Marioli almost 3 years ago

  • Related to Incident #6214: Workspace: Payload of Test Accounts 4 Portlet Testing Plans.txt in gCube VRE Folder not downloadable added

#113 Updated by Valentina Marioli almost 3 years ago

  • Related to Task #6475: Undeploy gCubeApps/PGFA-UFMT VRE and deploy under D4Research VO added

#114 Updated by Yannis Marketakis almost 3 years ago

February 2017 activities

During this period the activities revolved around:

  • Carrying out several enhancements in the Home Library for offering additional functionalities (i.e. versioning information and more informative versioning history) (#7236, #7237, #7238) and the Home Library API. (#7007, #7008, #7150)
  • Preparation for the 4th TCom. In particular FORTH has prepared a proposal for the semantic enrichment of gCube Data Catalogue that will be presented and discussed in the forthcoming TCom.

#115 Updated by Valentina Marioli almost 3 years ago

  • Related to Support #6851: Need further information to exploit Home Library REST API added

#116 Updated by Valentina Marioli almost 3 years ago

  • Related to Task #7007: Add features to HL versioning added

#117 Updated by Valentina Marioli almost 3 years ago

  • Related to Task #7008: Add versioning features to HL 2.0 API wiki added

#118 Updated by Valentina Marioli almost 3 years ago

  • Related to Task #7100: Assistance in using HomeLibrary REST Interface added

#119 Updated by Valentina Marioli almost 3 years ago

  • Related to Task #7150: Add cURL examples to HL Rest API wiki added

#120 Updated by Valentina Marioli almost 3 years ago

  • Related to Task #7238: Convert not versionable nodes added

#121 Updated by Valentina Marioli almost 3 years ago

  • Related to Task #7237: Get a single version added

#122 Updated by Valentina Marioli almost 3 years ago

  • Related to Task #7236: Version history should return more information added

#123 Updated by Yannis Marketakis over 2 years ago

March 2017 activities

During this period the activities revolved around:

  • Updating the search portlet for offering more functionalities and enhanced preview of results (#5772, #6134)
  • Performing various refactorings in the search system and the index mechanism. The main rationale of this activity is to improve and facilities and the portability of the index/search. This included modifying the cluster mechanism (#5665), customizing the title and snippet for data sources (#7888), using title and snippets in the index so that they can be exploited during search (#7889), exploiting external resources (i.e. opensearch compliant) (#7890, #7891)
  • preparing a draft design and requirements for the semantic enhancement of gCube Data Catalogue. FORTH presented and discussed it in the 4th TCom (https://goo.gl/0OX5hH)

#124 Updated by Yannis Marketakis over 2 years ago

April 2017 Activities

During this period the activities revolved around:

  • Performing various refactorings in the search system and the index mechanism (#5661) for improving the search facilities and the portability of the index/search. More specifically various updates have been carried out for exploiting the titles and snippets in the index (#7888, #7889), for adding external sources (#7890, #7891) and for the search portlet (#5772, #7954, #7956).
  • Updating Matware plugins for fetching data from FishSource (for the purposes of GRSF) with respect to the new JSON contents of the data source (#8278).

#125 Updated by Yannis Marketakis over 2 years ago

May 2017 Activities

During this period the activities revolved around:

  • Refactoring the search system and the index mechanism (#5661) for improving the search facilities and the portability of the index/search. More specifically the activities focused on the new clients for search and index (#5662). Furthermore an OAI-PMH publisher service has been implemented that expose the indexed data sources records with respect to the OAI-PMH specification (#8528).
  • Implementing a harvester for the RDF contents of the Data catalog (#8365).
  • Identifying the datasets - the ones that are already indexed - that could be published in the data catalogue (#8715).
  • Updating the functionality of several MatWare plugins, based on the new requirements/recommendations and the updated data sources (#8278, #8786).

#126 Updated by Yannis Marketakis over 2 years ago

June 2017 Activities

During this period the activities revolved around:

  • defining the process for publishing the indexed data sources into the D4Science Resource Catalog (#8715).
  • a new proposal for enhancing the data discovery facilities of the resource catalogue through the semantic enrichment and exploitation of the catalogue entries. The proposal has been presented and discussed in the 5th Tcom (https://goo.gl/cUYmMP).

#127 Updated by Yannis Marketakis over 2 years ago

July - August 2017 activities

N/A

#128 Updated by Fabio Sinibaldi about 2 years ago

  • Related to Feature #9760: WS-Thredds synch folder integration added

#129 Updated by Fabio Sinibaldi about 2 years ago

  • Related to Release #8772: org.gcube.data-transfer.sis-geotk-plugin.1-0-0 added

#130 Updated by Yannis Marketakis about 2 years ago

M25 - September 2017 activities

During this period the activities revolved around:

  • Integrating a THREDDS synchronization feature with workspace (#9760)
  • Implementing a data transfer geotk plugin (#8772)
  • Updating the MatWare plugin for fetching data from FishSource (#9859)

#131 Updated by Yannis Marketakis about 2 years ago

M26 - October 2017 activities

During this period the activities revolve around:

  • Updating the MatWare plugin for fetching data from the second version of the FishSource API (#9859)
  • Tested the new THREDDS synchronization feature with workspace (#9760)

#133 Updated by Yannis Marketakis about 2 years ago

M27 - November 2017 activities

During this period the activities revolved around:

  • Publishing the resources from the gcube search index to the resources catalog (#8715)
  • proposal for enhancing the mappings between CKAN and RDF DCAT for exporting enriched RDF descriptions for the resource catalog (#10347)

#134 Updated by Yannis Marketakis almost 2 years ago

M28 - December 2017 activities

During this period the activities revolved around:

  • Carrying out the required changes in the resource catalog and the index API for enabling the retrieval and publishing of the index data in the resource catalog (related tickets: #8715, #10596, #10725, #10735)
  • Proposal for enhancing the mappings between CKAN and RDF DCAT for exporting enriched RDF descriptions for the resource catalog (#10347)

#135 Updated by Yannis Marketakis almost 2 years ago

M29-M30 - January-February 2018 activities

During this period the activities revolved around:

  • Carrying out the required changes in the resource catalog and the index API for enabling the retrieval and publishing of the index data in the resource catalog (related tickets: #8715, #10735)

#136 Updated by Pasquale Pagano over 1 year ago

  • Status changed from In Progress to Closed

Also available in: Atom PDF