Project

General

Profile

Actions

Bug #11418

closed

HPSS 7.4.2 + JNI

Added by Chambon Bernard over 8 years ago. Updated over 8 years ago.

Status:
Resolved
Priority:
High
Assigned To:
Category:
-
Start date:
12/02/2015
Due date:
% Done:

0%

Estimated time:

Description

To uses HPSS 7.4.2.1, we must use libtirpc (-ltirpc provide in /lib64 son ccsvli10)
Doing this, unit C test is ok (see PS1) , but Java test (obviously with JNI) doesn't work (see PS2)
In consequence, treqs can't be used with HPSS 7.4.2

PS1

2015-12-02 09:34:02,853 INFO  MyHPSSAPITest - Running C++ tests
2015-12-02 09:34:02,853 INFO  MyHPSSAPITest - Running testGrantedConnection
2015-12-02 09:34:02,853 INFO  MyHPSSAPI - Login for user root ...
2015-12-02 09:34:02,853 DEBUG MyHPSSAPI - Using authentication method 'unix'
2015-12-02 09:34:02,853 INFO  MyHPSSAPI - User root successfully authenticated
2015-12-02 09:34:02,853 INFO  MyHPSSAPI - Logout ...
2015-12-02 09:34:02,853 INFO  MyHPSSAPITest - Successful end of testGrantedConnection
2015-12-02 09:34:02,853 INFO  MyHPSSAPI - Login for user root ...
2015-12-02 09:34:02,853 DEBUG MyHPSSAPI - Using authentication method 'unix'
2015-12-02 09:34:02,853 INFO  MyHPSSAPI - User root successfully authenticated
2015-12-02 09:34:02,853 INFO  MyHPSSAPITest - Running testGetNormalFileAttributes
2015-12-02 09:34:02,853 INFO  MyHPSSAPI - Getting file attributes from HPSS for /hpss/in2p3.fr/group/ccin2p3/run01/ccwl0689.1507_000010Mb_0005.dat ...
2015-12-02 09:34:02,921 DEBUG MyHPSSAPI - Mining attributes of file .../hpss/in2p3.fr/group/ccin2p3/run01/ccwl0689.1507_000010Mb_0005.dat
2015-12-02 09:34:02,921 DEBUG MyHPSSAPI - The filename /hpss/in2p3.fr/group/ccin2p3/run01/ccwl0689.1507_000010Mb_0005.dat is already on disk (higherStorageLevel = 0)
2015-12-02 09:34:02,921 DEBUG MyHPSSAPI - File attributes are : filesize 10485760 B (= 10240 KB or 10 MB), relPosition 13461, relPositionOffset 0, tapename JSZ00200, alreadyOnDisk true
2015-12-02 09:34:02,921 INFO  MyHPSSAPI - File attributes retrieved with success for file /hpss/in2p3.fr/group/ccin2p3/run01/ccwl0689.1507_000010Mb_0005.dat
2015-12-02 09:34:02,921 INFO  MyHPSSAPITest - Successful end of testGetNormalFileAttributes
2015-12-02 09:34:02,921 INFO  MyHPSSAPI - Logout ...
2015-12-02 09:34:02,922 INFO  MyHPSSAPITest - Running testPurgeNormalFile
2015-12-02 09:34:02,922 INFO  MyHPSSAPI - Login for user root ...
2015-12-02 09:34:02,922 DEBUG MyHPSSAPI - Using authentication method 'unix'
2015-12-02 09:34:02,922 INFO  MyHPSSAPI - User root successfully authenticated
2015-12-02 09:34:02,922 INFO  MyHPSSAPI - Start of purging file /hpss/in2p3.fr/group/ccin2p3/run01/ccwl0689.1507_000010Mb_0005.dat
2015-12-02 09:34:02,922 DEBUG MyHPSSAPI - Openning file via hpss_Open ...
2015-12-02 09:34:02,925 DEBUG MyHPSSAPI - Purging file via hpss_Purge ...
2015-12-02 09:34:02,957 DEBUG MyHPSSAPI - Closing file via hpss_Close ...
2015-12-02 09:34:02,957 INFO  MyHPSSAPI - Successful end of purging file /hpss/in2p3.fr/group/ccin2p3/run01/ccwl0689.1507_000010Mb_0005.dat it tooks 0 s
2015-12-02 09:34:02,958 INFO  MyHPSSAPI - Logout ...
2015-12-02 09:34:02,958 INFO  MyHPSSAPITest - Successful end of testPurgeNormalFile
2015-12-02 09:34:02,958 INFO  MyHPSSAPITest - Running testStageNormalFile
2015-12-02 09:34:02,958 INFO  MyHPSSAPI - Login for user root ...
2015-12-02 09:34:02,958 DEBUG MyHPSSAPI - Using authentication method 'unix'
2015-12-02 09:34:02,958 INFO  MyHPSSAPI - User root successfully authenticated
2015-12-02 09:34:02,958 INFO  MyHPSSAPI - Start of staging file /hpss/in2p3.fr/group/ccin2p3/run01/ccwl0689.1507_000010Mb_0005.dat
2015-12-02 09:34:02,958 DEBUG MyHPSSAPI - Openning file via hpss_Open ...
2015-12-02 09:34:02,960 DEBUG MyHPSSAPI - Staging file via hpss_Stage ...
2015-12-02 09:34:48,491 DEBUG MyHPSSAPI - Closing file via hpss_Close ...
2015-12-02 09:34:48,492 INFO  MyHPSSAPI - Successful end of staging file /hpss/in2p3.fr/group/ccin2p3/run01/ccwl0689.1507_000010Mb_0005.dat it tooks 46 s
2015-12-02 09:34:48,492 INFO  MyHPSSAPI - Logout ...
2015-12-02 09:34:48,492 INFO  MyHPSSAPITest - Successful end of testStageNormalFile
2015-12-02 09:34:48,492 INFO  MyHPSSAPITest - Running testPurgeNormalFile
2015-12-02 09:34:48,492 INFO  MyHPSSAPI - Login for user root ...
2015-12-02 09:34:48,492 DEBUG MyHPSSAPI - Using authentication method 'unix'
2015-12-02 09:34:48,492 INFO  MyHPSSAPI - User root successfully authenticated
2015-12-02 09:34:48,492 INFO  MyHPSSAPI - Start of purging file /hpss/in2p3.fr/group/ccin2p3/run01/ccwl0689.1507_000010Mb_0005.dat
2015-12-02 09:34:48,492 DEBUG MyHPSSAPI - Openning file via hpss_Open ...
2015-12-02 09:34:48,495 DEBUG MyHPSSAPI - Purging file via hpss_Purge ...
2015-12-02 09:34:48,498 DEBUG MyHPSSAPI - Closing file via hpss_Close ...
2015-12-02 09:34:48,498 INFO  MyHPSSAPI - Successful end of purging file /hpss/in2p3.fr/group/ccin2p3/run01/ccwl0689.1507_000010Mb_0005.dat it tooks 0 s
2015-12-02 09:34:48,498 INFO  MyHPSSAPI - Logout ...
2015-12-02 09:34:48,498 INFO  MyHPSSAPITest - Successful end of testPurgeNormalFile
2015-12-02 09:34:48,498 INFO  MyHPSSAPITest - C++ tests done

PS2

2015-12-02 09:48:43,228 [main] INFO  f.i.c.storage.myhpss.hsm.MyHPSSTest - Starting testGetNormalFileAttributes
2015-12-02 09:48:43,233 [main] INFO  f.i.cc.storage.myhpss.hsm.MyHPSS - Loading the HPSS native library 'MyHPSSLib'
2015-12-02 09:48:43,258 [main] INFO  f.i.cc.storage.myhpss.hsm.MyHPSS - HPSS native library has been successfully loaded
2015-12-02 09:49:45,275 [main] ERROR f.i.c.storage.myhpss.hsm.MyHPSSTest - rc = -5
2015-12-02 09:49:45,277 [main] INFO  f.i.c.storage.myhpss.hsm.MyHPSSTest - Ending testGetNormalFileAttributes

Actions #1

Updated by Chambon Bernard over 8 years ago

  • Assigned To set to Chambon Bernard
  • Priority changed from Normal to High
Actions #2

Updated by Chambon Bernard over 8 years ago

  • Subject changed from HPSS 742 + JNI to HPSS 7.4.2 + JNI
Actions #3

Updated by Chambon Bernard over 8 years ago

  • Status changed from New to Resolved

The failure was due to mismatch with libtirpc dynamic lib because rpc call have been change into HPPS for use that rpc frpm that lib instead of standard libc calls.

A workaround has been to force loading libtirpc before all other libs by using
setenv LD_PRELOAD /lib64/libtirpc.so.1
After that java unit test was ok

2015-12-02 14:45:03,458 [main] INFO  f.i.c.storage.myhpss.hsm.MyHPSSTest - Starting testGetNormalFileAttributes
2015-12-02 14:45:03,462 [main] INFO  f.i.cc.storage.myhpss.hsm.MyHPSS - Loading the HPSS native library 'MyHPSSLib'
2015-12-02 14:45:03,472 [main] INFO  f.i.cc.storage.myhpss.hsm.MyHPSS - HPSS native library has been successfully loaded
2015-12-02 14:45:03,550 [main] INFO  f.i.c.storage.myhpss.hsm.MyHPSSTest - Tapename = JSZ00700
2015-12-02 14:45:03,553 [main] INFO  f.i.c.storage.myhpss.hsm.MyHPSSTest - Ending testGetNormalFileAttributes

With details on native side :

2015-12-02 14:45:03,474 INFO  MyHPSSAPI - Login for user root ...
2015-12-02 14:45:03,474 DEBUG MyHPSSAPI - Using authentication method 'unix'
2015-12-02 14:45:03,474 INFO  MyHPSSAPI - User root successfully authenticated
2015-12-02 14:45:03,474 INFO  MyHPSSAPI - Getting file attributes from HPSS for /hpss/in2p3.fr/group/ccin2p3/treqs/ccdvli10.4616_10Mb.dat ...
2015-12-02 14:45:03,550 DEBUG MyHPSSAPI - Mining attributes of file .../hpss/in2p3.fr/group/ccin2p3/treqs/ccdvli10.4616_10Mb.dat
2015-12-02 14:45:03,550 DEBUG MyHPSSAPI - The filename /hpss/in2p3.fr/group/ccin2p3/treqs/ccdvli10.4616_10Mb.dat is already on disk (higherStorageLevel = 0)
2015-12-02 14:45:03,550 DEBUG MyHPSSAPI - File attributes are : filesize 10485760 B (= 10240 KB or 10 MB), relPosition 120, relPositionOffset 0, tapename JSZ00700, alreadyOnDisk true
2015-12-02 14:45:03,550 INFO  MyHPSSAPI - File attributes retrieved with success for file /hpss/in2p3.fr/group/ccin2p3/treqs/ccdvli10.4616_10Mb.dat
2015-12-02 14:45:03,553 INFO  MyHPSSAPI - Logout ...

Actions

Also available in: Atom PDF