Project

General

Profile

Actions

Feature #19414

closed

Develop a method exposing figures on the "latest" 15 years publications

Added by Leonardo Candela about 4 years ago. Updated over 3 years ago.

Status:
Closed
Priority:
Normal
Target version:
Start date:
Jun 01, 2020
Due date:
% Done:

100%

Estimated time:

Description

The method, when invoked, will return the number of publications by type of the last 15 years - the ongoing year is always excluded.


Add

Subtasks


Add

Related issues

Related to ISTI Open Access - Feature #16846: Access to SOLR from Volpini's machinesClosedAndrea Dell'AmicoJun 03, 2019

Delete relationActions

Updated by Anonymous about 4 years ago

@leonardo.candela@isti.cnr.it

What do you intend with figure, an image?

Otherwise the totals can be obtained through the SOLR API:

curl "https://backend-openportal.isti.cnr.it/solr/PMF_index_isti_shard1_replica1/select?q=date%3A%5B2005+TO+2020%5D&rows=0&wt=json&indent=true&facet=true&facet.field=date&facet.mincount=1&facet.sort=index"

Updated by Leonardo Candela about 4 years ago

We need to make available a method that returns a JSON that for every year contains a list of pairs "publication type, number of publications".

This method is expected to be used by the forthcoming ISTI website.

Dunno whether the SOLR API are "open" to every client, to me the only client expected to use them should be OpenPortal ... anyway if opening SOLR API to everyone is not harmful we can proceed as you prefer.

Updated by Michele Artini about 4 years ago

The Solr Index Service is not OPEN to every client, but it was configured to be accessible from OpenPortal server, my ip address and some Volpini's machines.

Some months ago I sent to Federico a mail with some preconfigured queries.

I think that a beta version of the ISTI website already performs some queries to the Solr Index.

Updated by Leonardo Candela about 4 years ago

  • Status changed from New to In Progress
  • Assignee changed from Michele Artini to Federico Volpini
  • % Done changed from 0 to 90

@federico.volpini@isti.cnr.it please confirm whether the SOLR API call suggested by @michele.artini@isti.cnr.it is suitable or not.

Updated by Anonymous about 4 years ago

Hi,

we tried to use the curl command from the machine that hosts the new website (ut6.isti.cnr.it - ip:146.48.80.156) and this is the response:

curl: (7) couldn't connect to host

Giuseppe also tried with my ip address (146.48.84.238) and this is another response:

[1] 12409
[2] 12410
[3] 12411
[4] 12412
[5] 12413
[6] 12414
[7] 12415
curl: (7) Failed to connect to backend-openportal.isti.cnr.it port 443: Nessun instradamento per l'host
facet.sort=index: comando non trovato
facet.mincount=1: comando non trovato
facet.field=date: comando non trovato
[2] Completato rows=0
[3] Completato wt=json
[2] Completato rows=0
[3] Completato wt=json
[4] Completato indent=true
[5] Completato facet=true
[1] Uscita 7 curl https://backend-openportal.isti.cnr.it/solr/PMF_index_isti_shard1_replica1/select?q=date%3A%5B2005+TO+2020%5D
[2] Completato rows=0
[3] Completato wt=json
[4] Completato indent=true
[5] Completato facet=true
[6]- Uscita 127 facet.field=date
[7]+ Uscita 127 facet.mincount=1

Updated by Michele Artini about 4 years ago

@andrea.dellamico@isti.cnr.it Can you verify which addresses can access backend-openportal.isti.cnr.it via HTTPS ?

Updated by Andrea Dell'Amico about 4 years ago

Access is limited to the web portal, and your desktop IP address (that one should be removed).
I'm going to allow the two IP aaddresses listed in #19414#note-5

Updated by Anonymous about 4 years ago

To me you can limit the access only to ut6 (146.48.80.156).

Thanks :)

Updated by Andrea Dell'Amico about 4 years ago

OK, I remembered that we had this kind of discussion in the past, here: #16846. I suppose you changed your mind?

Actions #10

Updated by Andrea Dell'Amico about 4 years ago

  • Related to Feature #16846: Access to SOLR from Volpini's machines added

Updated by Andrea Dell'Amico about 4 years ago

Anonymous wrote:

To me you can limit the access only to ut6 (146.48.80.156).

Done.

Updated by Anonymous about 4 years ago

Tested from ut6, now it works.

Just one question: the now we have the result of all publications per year.

Is it possible to have the number of publications by typology per year?

Thank you very much in advance

output:
{
"responseHeader":{
"status":0,
"QTime":54,
"params":{
"q":"date:[2005 TO 2020]",
"facet.field":"date",
"indent":"true",
"facet.mincount":"1",
"rows":"0",
"wt":"json",
"facet":"true",
"facet.sort":"index"}},
"response":{"numFound":7597,"start":0,"docs":[]
},
"facet_counts":{
"facet_queries":{},
"facet_fields":{
"date":[
"2005",441,
"2006",514,
"2007",649,
"2008",494,
"2009",454,
"2010",488,
"2011",490,
"2012",441,
"2013",570,
"2014",594,
"2015",570,
"2016",546,
"2017",439,
"2018",399,
"2019",434,
"2020",74]},
"facet_dates":{},
"facet_ranges":{},
"facet_intervals":{},
"facet_heatmaps":{}}}

Updated by Michele Artini about 4 years ago

It is possible using the SOLR facet API, in particular using the facet.pivot parameter.

for example:

curl "https://backend-openportal.isti.cnr.it/solr/PMF_index_isti_shard1_replica1/select?q=date%3A%5B2005+TO+2020%5D&rows=0&wt=json&indent=true&facet=true&facet.pivot=date,type&facet.mincount=1&facet.sort=index"

Updated by Anonymous almost 4 years ago

Hi, thanks for all.

You can see the result here: https://ut6.isti.cnr.it/sitoisti/en/research/publications

Just another question, if possible.

In agreement with the Director, we'd like to insert another tab, containing this graph: https://openportal.isti.cnr.it/statistics/year-rights

It's possible, using the same SOLR service, to have access to the raw data?

Thanks in advice

Updated by Anonymous almost 4 years ago

Updated by Leonardo Candela over 3 years ago

  • Status changed from In Progress to Closed
  • % Done changed from 90 to 100

I would say that this task is complete.

Actions

Also available in: Atom PDF