Project Task #687
Project WP #686: WP9 - VRE Commons Development [Months: 1-30]
T9.1 Data Storage, Discovery and Access [Months: 1-29]
Status: | Closed | Start date: | Oct 19, 2015 | ||
---|---|---|---|---|---|
Priority: | High | Due date: | Oct 13, 2017 | ||
Assignee: | % Done: | 97% | |||
Sprint: | WP09 | ||||
Lead beneficiary: | 8 - FORTH | Participants: | 1 - CNR, 4 - UOA | ||
Milestones: | |||||
Duration: | 520 |
Description
Task leader: FORTH; Participants: CNR, UOA;
This task will develop a set of facilities to be used by VRE implementations for storing, discovering and accessing data of various typologies in a uniform way. These facilities will be implemented by extending the facilities offered by the gCube technology. For data storage, BlueBRIDGE will develop facilities enabling to seamlessly and efficiently store any file-based information by relying on the distributed storage infrastructure resulting from WP10 activities. Any file-based information will be stored by transparently equipping it with rich metadata and thus to guarantee current and future availability, e.g. store multiple copies. For data discovery, BlueBRIDGE will extend the gCube facilities to offer unified views over an heterogeneous and evolving information space by relying on semantic-based methodologies.
Specifically, top level ontologies (like MarineTLO) will be used for describing in a semantically rich way the available datasets to assist their discovery. Novel methods for summarisation of search results that are applicable over existing search systems will be developed (e.g. stochastic methods for results summarisation). For data access, BlueBRIDGE will consolidate and extend the gCube array of data-type specific services for accessing species data, geospatial data and tabular data. In particular, it will reinforce the mechanisms for data citation, provenance, and sharing.
Subtasks
Related issues
History
#1
Updated by Franco Zoppi about 4 years ago
- Start date changed from Sep 12, 2015 to Sep 01, 2015
#2
Updated by Franco Zoppi about 4 years ago
- Subject changed from T9.1 Data Storage, Discovery and Access to T9.1 Data Storage, Discovery and Access [Months: 1-29]
- Due date changed from Feb 28, 2018 to Jan 31, 2018
#3
Updated by Franco Zoppi about 4 years ago
- Status changed from New to In Progress
#4
Updated by Massimiliano Assante about 4 years ago
- Assignee set to Yannis Marketakis
#5
Updated by Gianpaolo Coro about 4 years ago
- Related to Bug #549: Issue in Data Transfer usage of the StorageManager added
#6
Updated by Massimiliano Assante about 4 years ago
- Start date set to Sep 01, 2015
due to changes in a related task
#7
Updated by Yannis Marketakis about 4 years ago
September 2015 Activity
During the KickOff meeting in Pisa, FORTH introduced the main objectives of the Task 9.1.
As regards Data Access and Data Storage facilities FORTH plans to re-use already existing solutions provided from the gCube infrastructures and enhance them according to the needs.
As regards Data Discovery FORTH presented, a possible architecture for assisting the discovery of datasets (in particular for the biodiversity domain). Apart from that FORTH presented a proposed plan with deadlines for the T9.1 activities. The involved partners agreed to discuss the details and the actual plan of the task in a forth-coming face-2-face meeting (On November in Athens).
Short-term Plan / Task Milestones
- Inventory of already existing solutions from the gCube infrastructure that could/should be reused in BlueBRIDGE [Oct'2015]
- Specify the requirements (also identify if current solutions are not enough for the problem at hand) [Oct-Nov'2015]
- Design new functionalities [Nov-Dec'2015]
- Start the implementation of the new functionalities [Dec'2015-Feb'2015]
#8
Updated by Gianpaolo Coro about 4 years ago
- Related to Task #1221: Assess the difference in the performance of Thredds with and without nginx added
#9
Updated by Gianpaolo Coro about 4 years ago
- Related to Task #1283: Thredds layers colors not visualised on GisViewer added
#10
Updated by Nikolas Laskaris about 4 years ago
- Related to Support #921: BUILD-ISSUE: org.gcube.accounting.common-accounting-lib has been dismissed added
#11
Updated by Valentina Marioli about 4 years ago
- Related to Feature #1118: Improving performance of Empty and Move to Trash methods added
#12
Updated by Valentina Marioli about 4 years ago
- Related to Bug #1059: Do not show files of a trashed folder added
#13
Updated by Valentina Marioli about 4 years ago
- Related to Feature #894: Home Library: WorkspaceMessageManager#sendMessageToPortalLogins method to return messageId and not Void added
#14
Updated by Valentina Marioli about 4 years ago
- Related to Bug #710: Workspace error on file rename added
#15
Updated by Valentina Marioli about 4 years ago
- Related to Bug #519: Cannot delete shared folder (even if I'm owner) added
#16
Updated by Valentina Marioli about 4 years ago
- Related to Feature #724: HL Locking added
#17
Updated by Valentina Marioli about 4 years ago
- Related to Feature #725: Enhancement to HL history added
#18
Updated by Valentina Marioli about 4 years ago
- Related to Feature #739: Workspace search; limit to folder added
#19
Updated by Yannis Marketakis about 4 years ago
October 2015 Activity¶
During this period FORTH started working on 2 parallel activities. The first was an inventory of the solutions that already exist in the gCube as regards Data Storage, Discovery and Access. The second was an analysis of the requirements as regards the aforementioned functionalities.
The results have been performed in the set of slides that have been presented in the F2F meeting in Athens (http://goo.gl/nNWL58).
NKUA concentrated on fixing some dependencies with some gCube components
CNR worked on some issues on the performance of Thredds and several bugs with the HomeLibrary. Furthermore some new features of the HomeLibrary have been developed (as regards searching in specific folders, locking facilities, history enhancements, performance improvements).
#20
Updated by Yannis Marketakis about 4 years ago
- Related to Task #1310: FORTH Facets Identification added
#21
Updated by Francesco Mangiacrapa about 4 years ago
- Related to Release #743: org.gcube.data-transfer.uri-resolver.1-4-0 added
#23
Updated by Yannis Marketakis about 4 years ago
November 2015 Activities
During this period the activities were focused on:
- the facets identification and their description. A first draft of the facets has already been identified and can be found at https://support.d4science.org/projects/bluebridge/wiki/On_Resources_Facets_Catalogues_and_the_Forthcoming_Information_System (#1310). The activities for the definition of the facets will continue also in December 2015.
- Several enhancements, bugs and new features of the Home Library have been carried out (#894, #710, #519, #724, #725, #739, #1059, #1118),
- Activities for correcting various issues with GisViewer has been initiated (#1283)
- Activities for assessing the differences in the performance of Thredds using different configurations (#1221)
- Fixed some issues occurred when building certain libraries (#921)
- Announced the release of the following components
- org.gcube.data-transfer.uri-resolver.1-4-0 (#743)
#24
Updated by Luca Frosini almost 4 years ago
- Related to Feature #1440: Remove index ingestion dependency to TreeManager added
#25
Updated by Yannis Marketakis almost 4 years ago
- Related to Task #1827: Description of a Dataset using Facets added
#26
Updated by Yannis Marketakis almost 4 years ago
December 2015 Activities¶
During this period the activities were focused on:
* Inspecting new functionalities as regards the transformation of the workspace as a widget and using it through various applications. (#1742)
* Working on the new resource model/description of resources using facets (#1827)
* Resolving several technical issues (#1440)
#27
Updated by Gianpaolo Coro almost 4 years ago
- Related to Task #1899: Host the Sardara DB within the e-Infrastructure added
#28
Updated by Gianpaolo Coro almost 4 years ago
- Related to Task #1777: Ecopath taxonomy dataformats added
#29
Updated by Massimiliano Assante almost 4 years ago
- Related to Feature #2091: Provide Full-Text search capability over posts and comments added
#30
Updated by Yannis Marketakis almost 4 years ago
January 2016 Activities¶
During this period the activities revolved around:
- Inspecting new functionalities as regards the transformation of the workspace as a widget and using it through various applications (#1742)
- Working on the new resource model. More specifically several modifications to the model have been reported (#1827)
- Supporting data formats related to the Ecopath (EwE models) (#1777)
- Provision of full-text search over posts and comments (#2091)
#31
Updated by Massimiliano Assante almost 4 years ago
- Related to Feature #1445: Enhance search results visualization added
#32
Updated by Massimiliano Assante almost 4 years ago
- Related to Feature #1444: Provided faceted search capabilities at the backend added
#34
Updated by Massimiliano Assante almost 4 years ago
- Related to Feature #1438: Remove Resource Registry dependency added
#35
Updated by Massimiliano Assante almost 4 years ago
- Related to deleted (Task #1899: Host the Sardara DB within the e-Infrastructure)
#36
Updated by Yannis Marketakis almost 4 years ago
- Related to Task #2246: Defining the requirements a draft design for supporting Data(set) Discovery added
#37
Updated by Valentina Marioli almost 4 years ago
- Related to Feature #2020: Zip the contents of a folder without including the folder itself added
#38
Updated by Valentina Marioli almost 4 years ago
- Related to Feature #2059: Zip a folder excluding specific subfolders added
#39
Updated by Valentina Marioli almost 4 years ago
- Related to Bug #453: Home Library: copying a read-only file to a shared folder added
#40
Updated by Valentina Marioli almost 4 years ago
- Related to Bug #2021: Bug removing multiple files added
#41
Updated by Valentina Marioli almost 4 years ago
- Related to Feature #1786: HomeLIbrary: Enhance Messages performance added
#42
Updated by Yannis Marketakis almost 4 years ago
February 2016 Activities¶
During this period the activities revolved around:
- Supporting of a full-text search mechanism over posts and comments (#2091)
- Defining the requirements for supporting data discovery services by exploiting semantic knowledge bases (#2246)
- Implementing new functionalities of the Home Library; support for zipping folder and excluding specific subfolders from the ZIP file (#2020, #2059)
- Fixing several issues of the Home Library:
#43
Updated by Yannis Marketakis over 3 years ago
#44
Updated by Massimiliano Assante over 3 years ago
- Related to Feature #2546: Endow Workspace Resources Explorer with filtering and display features added
#45
Updated by Yannis Marketakis over 3 years ago
#46
Updated by Panagiota Koltsida over 3 years ago
- Related to Feature #3914: Develop a portlet for managing oai-pmh sources added
#47
Updated by Panagiota Koltsida over 3 years ago
- Related to Feature #1442: Integrate OAI-PMH directly to harvesting/indexing mechanism added
#48
Updated by Massimiliano Assante over 3 years ago
Dear @marketak@ics.forth.gr as agreed during the last #PEC https://support.d4science.org/issues/2549 the activities we report in wp9 tasks as related tickets should be migrated to sub-tasks.
I am going to transform the current related activities that are not closed as sub-tasks. Please keep this change in mind for the future and upcoming activities reported under wp9 tasks T9.1
#49
Updated by Massimiliano Assante over 3 years ago
- Related to deleted (Task #2246: Defining the requirements a draft design for supporting Data(set) Discovery)
#51
Updated by Massimiliano Assante over 3 years ago
- Related to deleted (Feature #1440: Remove index ingestion dependency to TreeManager )
#52
Updated by Massimiliano Assante over 3 years ago
- Related to deleted (Feature #1442: Integrate OAI-PMH directly to harvesting/indexing mechanism)
#53
Updated by Massimiliano Assante over 3 years ago
- Related to deleted (Feature #1445: Enhance search results visualization )
#54
Updated by Massimiliano Assante over 3 years ago
- Related to deleted (Feature #1444: Provided faceted search capabilities at the backend)
#56
Updated by Massimiliano Assante over 3 years ago
- Related to deleted (Feature #1438: Remove Resource Registry dependency)
#57
Updated by Massimiliano Assante over 3 years ago
- Related to deleted (Feature #3914: Develop a portlet for managing oai-pmh sources)
#58
Updated by Massimiliano Assante over 3 years ago
- Related to deleted (Feature #2546: Endow Workspace Resources Explorer with filtering and display features)
#59
Updated by Massimiliano Assante over 3 years ago
- Related to deleted (Release #743: org.gcube.data-transfer.uri-resolver.1-4-0)
#60
Updated by Valentina Marioli over 3 years ago
- Related to Feature #2234: HomeLibrary: Enhance Upload File operation performance added
#61
Updated by Valentina Marioli over 3 years ago
- Related to Feature #2458: HL: add mime type to MimeTypeUtil added
#62
Updated by Valentina Marioli over 3 years ago
- Related to Feature #2646: HL: Remove portalLogin in UserManager methods added
#63
Updated by Valentina Marioli over 3 years ago
- Related to Feature #2505: Home Library Enhancement: getting zip file for list of WorkspaceItem added
#64
Updated by Valentina Marioli over 3 years ago
- Related to Feature #2765: HL: add multiple properties to WorkspaceItem constructor added
#65
Updated by Valentina Marioli over 3 years ago
- Related to Bug #2446: HL: renaming a file with an already existing name added
#66
Updated by Valentina Marioli over 3 years ago
- Related to Support #2109: Investigating delays retrieving items in light tree added
#67
Updated by Valentina Marioli over 3 years ago
- Related to Bug #2453: HL: Storage Exception not correctly propagated added
#68
Updated by Valentina Marioli over 3 years ago
- Related to Bug #2457: HL: wrong path for subfolders of shared folders added
#69
Updated by Valentina Marioli over 3 years ago
- Related to Bug #2650: HL: bug setting properties on workspaceItem added
#70
Updated by Yannis Marketakis over 3 years ago
May 2016 Activities¶
During this period the activities revolved around:
- Development of Matware plugins for supporting the transformation of data for the construction of GRSF (#3926)
- Development of new facilities and portlets for the gCube seach framework (#3914)
- Update the functionality of Workspace Resources Explorer with new features (i.e. sorting, filtering) (#2546) and new functionalities (i.e. search) (#4124)
#71
Updated by Yannis Marketakis over 3 years ago
- Due date changed from Jun 17, 2016 to Jul 15, 2016
due to changes in a related task
#72
Updated by Yannis Marketakis over 3 years ago
June 2016 Activities¶
During this period the activities revolved around:
- Development of MatWare plugins for supporting the construction of the GRSF KB (update plugins for FIRMS #3927, new plugins for RAM #3928, started developing plugins for FishSource #4284) (#3926)
- Finalized the new functionalities of Workspace Resources Explorer (#2546)
- A summary of the activities has been presented in the latest TCom. Furthermore the short-term plans (for the next 6 months) have been discussed in the latest TCom.
#73
Updated by Valentina Marioli over 3 years ago
- Related to Incident #4182: Upload to workspace from Share Updates storage download problem added
#74
Updated by Valentina Marioli over 3 years ago
- Related to Incident #4179: Workspace URL items not working added
#75
Updated by Valentina Marioli over 3 years ago
- Related to Bug #4139: Cannot obtain public URL for shared folders added
#76
Updated by Valentina Marioli over 3 years ago
- Related to Feature #4219: Use storage ID to download files from storage added
#77
Updated by Valentina Marioli over 3 years ago
- Related to Feature #4186: HL: Add time to live to cache added
#78
Updated by Valentina Marioli over 3 years ago
- Related to Feature #4216: Set a folder as System Folder added
#79
Updated by Valentina Marioli over 3 years ago
- Related to Bug #3425: Uploading a big file, size is not correctly calculated added
#80
Updated by Valentina Marioli over 3 years ago
- Related to Bug #3195: HL: Move operation does not update parent id immediately added
#81
Updated by Valentina Marioli over 3 years ago
- Related to Bug #2529: HomeLibrary: wrong mimetype in uploaded file added
#82
Updated by Valentina Marioli over 3 years ago
- Related to Bug #2718: HL: cannot delete multiple gCubeItems added
#83
Updated by Valentina Marioli over 3 years ago
- Related to Bug #2697: HL: moving a private folder containing shared folders added
#84
Updated by Valentina Marioli over 3 years ago
- Related to Task #2660: Workspace does not delete folders with subfolders added
#85
Updated by Valentina Marioli over 3 years ago
- Related to Incident #2443: BlueBRIDGE EAB VRE - Recently updated files is not working added
#86
Updated by Valentina Marioli over 3 years ago
- Related to Incident #2528: Workspace: Multiple upload does not suggest what to do with duplicates added
#87
Updated by Valentina Marioli over 3 years ago
- Related to Incident #2747: Messages Portlet: message status is always unread, for every message added
#88
Updated by Yannis Marketakis over 3 years ago
July and August 2016 Activities¶
During this period the activities revolved around:
- Development of MatWare plugins for supporting the construction of the GRSF KB (#3926); finalized development for some plugins (#3927) and continued working on others (#3928, #4284).
- Implementation of a new OAI-PMH harvester that will allow new sources to be harvested and made available through the infrastructure (#1442). Moreover a first version of a portlet for managing OAI-PMH sources has been developed (#3914).
#89
Updated by Nikolas Laskaris about 3 years ago
- Due date changed from Sep 20, 2016 to Sep 23, 2016
due to changes in a related task
#90
Updated by Yannis Marketakis about 3 years ago
September 2016 Activities¶
During this period the activities revolved around:
- Finalizing the development and testing of MatWare plugins for supporting the construction of the GRSF KB (#3928, #4284)
- Enhancements on Index and search facilities. More specifically: support harvesting data sources though OAI-PMH harvesting services and developing the corresponding portlet(#1440, #3914), support index fields groupings into semantically equal groups (#5129), support the provision of faceted searching (#1444), removed Resource Registry dependencies from Search, Index and DTS (#1438)
- Enhancing workspace explorer with new functionalities; in particular search facilities and loading resources from certain folders (#4124)
- Designing a front-end for MatWare (#4994)
- The storage manager was ported to the new Authorization 2 Framework (#4945) and a new feature allowing to temporary store files in a volatile area was implemented and released (#4839)
- On the HomeLibrary, a feature allowing Guest Access to Workspace Folders has been developed and released (read-only mode). The Workspace history keeps track of the information about these public access. (Feature #3782). HomeLibrary provides now support for the infrastructure Data Catalogue, methods to copy workspace files/folders in an ".catalogue" area before publishing such files on gCube Data Catalogue were developed and released. In addition, Home Library allows users to get a workspace item by catalogue ID and to get a list of catalogue items by workspace item ID.
#91
Updated by Massimiliano Assante about 3 years ago
- Related to Feature #4945: Pass StorageManager to Authorization 2.0 added
#92
Updated by Massimiliano Assante about 3 years ago
- Related to Feature #4839: Storage-manager: volatile area in a different backend added
#93
Updated by Massimiliano Assante about 3 years ago
- Related to Feature #5186: StorageManager: extend volatile suffix to smp and https protocols added
#94
Updated by Valentina Marioli about 3 years ago
- Related to Feature #3782: Access workspace using a guest user in read-only mode added
#95
Updated by Valentina Marioli about 3 years ago
- Related to Feature #5093: Show public folders in a special folder added
#96
Updated by Valentina Marioli about 3 years ago
- Related to Feature #5092: Adding Public Access to history added
#97
Updated by Yannis Marketakis about 3 years ago
- Due date changed from Sep 20, 2016 to Oct 28, 2016
due to changes in a related task
#98
Updated by Yannis Marketakis about 3 years ago
October 2016 Activities¶
During this period the activities revolved around:
- Finalized with the development activities of MatWare plugins (in particular FishSource plugin (#4284)). After that some new requirements have emerged and the FishSource services started exposing more data (i.e. more fields) so the corresponding plugin should be updated respectively to reflect those changes(#5524)
- extending the StorageManager for objects stored in the volatile area (#5186)
#99
Updated by Valentina Marioli about 3 years ago
- Related to Feature #5406: HomeLibrary: add support for conversation attachments added
#100
Updated by Yannis Marketakis about 3 years ago
- Due date changed from Oct 28, 2016 to Oct 31, 2016
due to changes in a related task
#101
Updated by Yannis Marketakis about 3 years ago
November 2016 activities¶
During this month the activities revolved around
- updated home library with various new functionalities. More specifically for supporting conversation attachments (#5406), supporting downloading an entire folder in zip format(#5623) and uploading a zip file (#5716), retrieving the publicly available URL of a file (#5723), copying files of a VRE folder in a specific catalogue before publishing (#6041). Finally various fixes for retrieving the proper list of VRE folders (#5831).
- performing various refactorings in the search system and the index mechanism (#5661). The main rationale of this activity is to improve and facilities and the portability of the index/search.
#102
Updated by Valentina Marioli about 3 years ago
- Related to Task #5623: HL Rest API: add a method to download a folder in zip format added
#103
Updated by Valentina Marioli about 3 years ago
- Related to Task #5716: HL Rest API: add a method to upload a zip file added
#104
Updated by Valentina Marioli about 3 years ago
- Related to Task #5723: HL Rest API: add a method to get the public URL of a file added
#105
Updated by Valentina Marioli about 3 years ago
- Related to Task #5831: HL Rest API: add MySpecialFolder (VRE Folders) to list servlet added
#106
Updated by Valentina Marioli about 3 years ago
- Related to Task #6041: Home Library: add a "catalogue" area for VRE folder added
#107
Updated by Yannis Marketakis almost 3 years ago
December 2016 & January 2017 Activities¶
During this period the activities revolved around:
- Finalized the work on MatWare plugins for fetching data from remote sources, so that they can be transformed and ingested into the GRSF KB (#3926).
- Performing various refactorings in the search system and the index mechanism (#5661). The main rationale of this activity is to improve and facilities and the portability of the index/search.
- Worked on fixing several incidents with the workspace portlet (#6536, #6130, #6168, #6214)
- Enhancements of the Home library for supporting files versioning (#5165)
- Preparation for the 1st periodic review.
#108
Updated by Valentina Marioli almost 3 years ago
- Related to Incident #6536: Workspace portlet: changing shared folder permissions reset the Shared Folder administrators added
#109
Updated by Valentina Marioli almost 3 years ago
- Related to Task #5165: Home Library should support versioning added
#110
Updated by Valentina Marioli almost 3 years ago
- Related to Incident #6130: Workspace is broken in production added
#111
Updated by Valentina Marioli almost 3 years ago
- Related to Incident #6168: Workspace portlet: search any term always return empty results added
#112
Updated by Valentina Marioli almost 3 years ago
- Related to Incident #6214: Workspace: Payload of Test Accounts 4 Portlet Testing Plans.txt in gCube VRE Folder not downloadable added
#113
Updated by Valentina Marioli almost 3 years ago
- Related to Task #6475: Undeploy gCubeApps/PGFA-UFMT VRE and deploy under D4Research VO added
#114
Updated by Yannis Marketakis almost 3 years ago
February 2017 activities¶
During this period the activities revolved around:
- Carrying out several enhancements in the Home Library for offering additional functionalities (i.e. versioning information and more informative versioning history) (#7236, #7237, #7238) and the Home Library API. (#7007, #7008, #7150)
- Preparation for the 4th TCom. In particular FORTH has prepared a proposal for the semantic enrichment of gCube Data Catalogue that will be presented and discussed in the forthcoming TCom.
#115
Updated by Valentina Marioli almost 3 years ago
- Related to Support #6851: Need further information to exploit Home Library REST API added
#116
Updated by Valentina Marioli almost 3 years ago
- Related to Task #7007: Add features to HL versioning added
#117
Updated by Valentina Marioli almost 3 years ago
- Related to Task #7008: Add versioning features to HL 2.0 API wiki added
#118
Updated by Valentina Marioli almost 3 years ago
- Related to Task #7100: Assistance in using HomeLibrary REST Interface added
#119
Updated by Valentina Marioli almost 3 years ago
- Related to Task #7150: Add cURL examples to HL Rest API wiki added
#120
Updated by Valentina Marioli almost 3 years ago
- Related to Task #7238: Convert not versionable nodes added
#121
Updated by Valentina Marioli almost 3 years ago
- Related to Task #7237: Get a single version added
#122
Updated by Valentina Marioli almost 3 years ago
- Related to Task #7236: Version history should return more information added
#123
Updated by Yannis Marketakis over 2 years ago
March 2017 activities¶
During this period the activities revolved around:
- Updating the search portlet for offering more functionalities and enhanced preview of results (#5772, #6134)
- Performing various refactorings in the search system and the index mechanism. The main rationale of this activity is to improve and facilities and the portability of the index/search. This included modifying the cluster mechanism (#5665), customizing the title and snippet for data sources (#7888), using title and snippets in the index so that they can be exploited during search (#7889), exploiting external resources (i.e. opensearch compliant) (#7890, #7891)
- preparing a draft design and requirements for the semantic enhancement of gCube Data Catalogue. FORTH presented and discussed it in the 4th TCom (https://goo.gl/0OX5hH)
#124
Updated by Yannis Marketakis over 2 years ago
April 2017 Activities¶
During this period the activities revolved around:
- Performing various refactorings in the search system and the index mechanism (#5661) for improving the search facilities and the portability of the index/search. More specifically various updates have been carried out for exploiting the titles and snippets in the index (#7888, #7889), for adding external sources (#7890, #7891) and for the search portlet (#5772, #7954, #7956).
- Updating Matware plugins for fetching data from FishSource (for the purposes of GRSF) with respect to the new JSON contents of the data source (#8278).
#125
Updated by Yannis Marketakis over 2 years ago
May 2017 Activities¶
During this period the activities revolved around:
- Refactoring the search system and the index mechanism (#5661) for improving the search facilities and the portability of the index/search. More specifically the activities focused on the new clients for search and index (#5662). Furthermore an OAI-PMH publisher service has been implemented that expose the indexed data sources records with respect to the OAI-PMH specification (#8528).
- Implementing a harvester for the RDF contents of the Data catalog (#8365).
- Identifying the datasets - the ones that are already indexed - that could be published in the data catalogue (#8715).
- Updating the functionality of several MatWare plugins, based on the new requirements/recommendations and the updated data sources (#8278, #8786).
#126
Updated by Yannis Marketakis over 2 years ago
June 2017 Activities¶
During this period the activities revolved around:
- defining the process for publishing the indexed data sources into the D4Science Resource Catalog (#8715).
- a new proposal for enhancing the data discovery facilities of the resource catalogue through the semantic enrichment and exploitation of the catalogue entries. The proposal has been presented and discussed in the 5th Tcom (https://goo.gl/cUYmMP).
#127
Updated by Yannis Marketakis over 2 years ago
#128
Updated by Fabio Sinibaldi about 2 years ago
- Related to Feature #9760: WS-Thredds synch folder integration added
#129
Updated by Fabio Sinibaldi about 2 years ago
- Related to Release #8772: org.gcube.data-transfer.sis-geotk-plugin.1-0-0 added
#130
Updated by Yannis Marketakis about 2 years ago
#131
Updated by Yannis Marketakis about 2 years ago
#133
Updated by Yannis Marketakis about 2 years ago
M27 - November 2017 activities¶
During this period the activities revolved around:
- Publishing the resources from the gcube search index to the resources catalog (#8715)
- proposal for enhancing the mappings between CKAN and RDF DCAT for exporting enriched RDF descriptions for the resource catalog (#10347)
#134
Updated by Yannis Marketakis almost 2 years ago
M28 - December 2017 activities¶
During this period the activities revolved around:
- Carrying out the required changes in the resource catalog and the index API for enabling the retrieval and publishing of the index data in the resource catalog (related tickets: #8715, #10596, #10725, #10735)
- Proposal for enhancing the mappings between CKAN and RDF DCAT for exporting enriched RDF descriptions for the resource catalog (#10347)
#135
Updated by Yannis Marketakis almost 2 years ago
#136
Updated by Pasquale Pagano over 1 year ago
- Status changed from In Progress to Closed