Feature #4318

Storage-accounting: Integration with new accounting libs

Added by Roberto Cirillo over 3 years ago. Updated over 3 years ago.

Status:ClosedStart date:Jun 22, 2016
Priority:HighDue date:
Assignee:Alessandro Pieve% Done:

100%

Category:content-management
Sprint:zz - accounting-integration
Milestones:
Duration:

Description

The library storage-manager-trigger should be integrated with the new accounting libs:

document-store-lib           1.1.2
document-store-lib-couchbase 1.0.2
accounting-lib               2.2.0

mongoTrigger.log - storage accounting log with a test in devNext environement (2.49 MB) Roberto Cirillo, Jun 24, 2016 10:48 AM


Related issues

Related to gCube - Release #4536: org.gcube.content-management.storage-manager-trigger.1-5-0 Released Jun 29, 2016

History

#1 Updated by Roberto Cirillo over 3 years ago

  • Priority changed from Normal to High
  • Status changed from New to In Progress

#2 Updated by Roberto Cirillo over 3 years ago

  • % Done changed from 0 to 50

I see the following exception:

10127 [pool-4-thread-1] INFO  com.couchbase.client.core.message.cluster.SeedNodesRequest  - Unknown host  couchbase02-d-d4s.d4science.org in bootstrap list.
java.net.UnknownHostException:  couchbase02-d-d4s.d4science.org
    at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
    at java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:901)
    at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1295)
    at java.net.InetAddress.getAllByName0(InetAddress.java:1248)
    at java.net.InetAddress.getAllByName(InetAddress.java:1164)
    at java.net.InetAddress.getAllByName(InetAddress.java:1098)
    at java.net.InetAddress.getByName(InetAddress.java:1048)
    at com.couchbase.client.core.message.cluster.SeedNodesRequest.<init>(SeedNodesRequest.java:99)
    at com.couchbase.client.java.CouchbaseAsyncCluster.<init>(CouchbaseAsyncCluster.java:264)
    at com.couchbase.client.java.CouchbaseCluster.<init>(CouchbaseCluster.java:234)
    at com.couchbase.client.java.CouchbaseCluster.create(CouchbaseCluster.java:191)
    at com.couchbase.client.java.CouchbaseCluster.create(CouchbaseCluster.java:179)
    at org.gcube.documentstore.persistence.PersistenceCouchBase.prepareConnection(PersistenceCouchBase.java:100)
    at org.gcube.documentstore.persistence.PersistenceBackendFactory.discoverPersistenceBackend(PersistenceBackendFactory.java:125)
    at org.gcube.documentstore.persistence.PersistenceBackendFactory.rediscoverPersistenceBackend(PersistenceBackendFactory.java:180)
    at org.gcube.documentstore.persistence.PersistenceBackendRediscover.run(PersistenceBackendRediscover.java:38)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)
10534 [cb-io-1-1] INFO  com.couchbase.client.core.node.Node  - Connected to Node couchbase03-d-d4s.d4science.org
10534 [cb-io-1-2] INFO  com.couchbase.client.core.node.Node  - Connected to Node couchbase04-d-d4s.d4science.org
10536 [cb-io-1-3] INFO  com.couchbase.client.core.node.Node  - Connected to Node couchbase01-d-d4s.d4science.org
10972 [cb-computations-1] INFO  com.couchbase.client.core.config.ConfigurationProvider  - Opened bucket accounting_storage
10989 [cb-io-1-2] INFO  com.couchbase.client.core.node.Node  - Connected to Node couchbase02-d-d4s.d4science.org
10991 [cb-io-1-3] INFO  com.couchbase.client.core.node.Node  - Connected to Node couchbase05-d-d4s.d4science.org

but it seems correctly connected to couchbase02-d-d4s.d4science.org

#3 Updated by Roberto Cirillo over 3 years ago

  • Assignee changed from Roberto Cirillo to Alessandro Pieve

#4 Updated by Roberto Cirillo over 3 years ago

We have some problem with accounting in devNext environment. I assign this ticket to @alessandro.pieve@isti.cnr.it for further analysis.

#5 Updated by Roberto Cirillo over 3 years ago

#6 Updated by Alessandro Pieve over 3 years ago

  • % Done changed from 50 to 100
  • Status changed from In Progress to Feedback

Log and configuration were checked. Now storage accounting is working correctly
E.g.
"accounting_storage": {
"aggregated": true,
"consumerId": "rcirillo-test",
"creationTime": 1466778383236,
"dataType": "STORAGE",
"dataVolume": -438,
"endTime": 1466778383215,
"id": "f4340c40-c58b-4838-8ae5-f7bfc5b12eaf",
"operationCount": 2,
"operationResult": "SUCCESS",
"operationType": "DELETE",
"providerURI": "data.gcube.org",
"recordType": "StorageUsageRecord",
"resourceOwner": "rcirillo-test",
"resourceScope": "/gcube/devNext",
"resourceURI": "576d430bebdc8f71a7b9b715",
"scope": "/gcube/devNext",
"startTime": 1466778381896
}

#7 Updated by Roberto Cirillo over 3 years ago

  • Status changed from Feedback to Closed

#8 Updated by Roberto Cirillo over 3 years ago

  • Related to Release #4536: org.gcube.content-management.storage-manager-trigger.1-5-0 added

Also available in: Atom PDF