[LU-9897] Tracking of lustre library improvements. Created: 21/Aug/17 Updated: 08/Dec/21 |
|
| Status: | Open |
| Project: | Lustre |
| Component/s: | None |
| Affects Version/s: | Lustre 2.11.0 |
| Fix Version/s: | None |
| Type: | Task | Priority: | Minor |
| Reporter: | James A Simmons | Assignee: | James A Simmons |
| Resolution: | Unresolved | Votes: | 0 |
| Labels: | always_except | ||
| Environment: |
Lustre utilities |
||
| Issue Links: |
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Sub-Tasks: |
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Rank (Obsolete): | 9223372036854775807 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Description |
|
Currently lustre has a large collection of user space libraries: libcfs.a We really only need two libraries. One being liblnetconfg and the second liblustreapi.so. libptlctl.a should be replaced by liblnetconfig at this point and if we link liblustreapi.so into liblnetconfig.so then we don't need to embedded libcfs*.a into both libraries anymore. Along side this issue is the libyaml dependency. One project was going to introduce JSON support for HSM and then discussion happened at one LUG developers day if we should also move liblnetconfig to libjson as well. So the question becomes do we support both JSON and YAML or drop one of them. YAML/JSON also looks to becoming a hard requirement with some purposed work for using it for setting striping in liblustreapi. Lastly is tracking of the work to change the license to LGPL. |
| Comments |
| Comment by Amir Shehata (Inactive) [ 21/Aug/17 ] |
|
Currently all of Lustre uses YAML. We shouldn't be moving only the lnetconfig stuff to JSON. Also what are the justification of moving away from YAML? It's very simple in the way it's being used in both LNet config and Lustre. So my question is it really worth moving all the existing tested code to JSON? or should HSM simply use YAML? Not to mention the backwards compatibility issues when you remove YAML support (YAML is being used in LNet config from 2.7 and earlier for luster). Are we then going to keep both? My vote is to get HSM to use YAML. Are there technical reasons it can't? |
| Comment by Amir Shehata (Inactive) [ 21/Aug/17 ] |
|
Another issue that might not be visible externally yet, is that there are 100s of tests that test DLC, mulit-rial, dynamic discovery, which I'm currently working on integrating into the lustre/tests. They all use YAML. We're talking about a significant effort there to move all those tests to JSON. |
| Comment by James A Simmons [ 21/Aug/17 ] |
|
Please read the thread in LU-6081. Lets see if libjyaml can now address those issues to consider moving HSM to YAML. I just like to see what the path forward is. One issue which bites people is that the build process for lnet will complete when libyaml-devel is missing. People will build lustre and scratch their head wondering why lnetctl doesn't build. At this point libyaml MUST become a hard requirement. |
| Comment by Gerrit Updater [ 28/Aug/17 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: https://review.whamcloud.com/28752 |
| Comment by Gerrit Updater [ 24/Oct/17 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/28752/ |
| Comment by James A Simmons [ 24/Oct/17 ] |
|
Still more work to be done so please keep this open. |
| Comment by Gerrit Updater [ 22/Nov/17 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: https://review.whamcloud.com/30204 |
| Comment by Gerrit Updater [ 01/Dec/17 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/30204/ |
| Comment by Thomas Stibor [ 01/Dec/17 ] |
|
Hi James, just wanted to compile Lustre client with dlc support and saw the option is removed and by default activated when yaml-devel is found. Shouldn't --disable/enable-dlc be also removed here:
>grep -r "disable-dlc" .
./lustre-dkms_pre-build.sh: --disable-manpages --disable-dlc
./config/lustre-build.m4: --enable-dlc | --disable-dlc ) ;;
Cheers Thomas
|
| Comment by James A Simmons [ 01/Dec/17 ] |
|
Ugh, the disable-dlc was missed. I will submit a patch which will fix this. |
| Comment by James A Simmons [ 15/Jan/18 ] |
|
The disable-dlc issues have been fixed with the patch landed for |
| Comment by Gerrit Updater [ 05/Jul/19 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: https://review.whamcloud.com/35422 |
| Comment by Gerrit Updater [ 16/Jul/19 ] |
|
James Simmons (jsimmons@infradead.org) uploaded a new patch: https://review.whamcloud.com/35531 |
| Comment by Gerrit Updater [ 09/Aug/19 ] |
|
Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/35531/ |
| Comment by Gerrit Updater [ 30/Aug/19 ] |
|
Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/36010 |
| Comment by Gerrit Updater [ 30/Aug/19 ] |
|
Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/36016 |
| Comment by Gerrit Updater [ 07/Sep/19 ] |
|
Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/36010/ |
| Comment by Gerrit Updater [ 12/Sep/19 ] |
|
Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/36016/ |
| Comment by Gerrit Updater [ 04/Jun/20 ] |
|
James Simmons (jsimmons@infradead.org) uploaded a new patch: https://review.whamcloud.com/38825 |
| Comment by Gerrit Updater [ 10/Jun/20 ] |
|
Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/38825/ |
| Comment by Gerrit Updater [ 12/Jun/20 ] |
|
James Simmons (jsimmons@infradead.org) uploaded a new patch: https://review.whamcloud.com/38921 |
| Comment by Gerrit Updater [ 19/Jun/20 ] |
|
Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/38921/ |
| Comment by Gerrit Updater [ 13/Jul/20 ] |
|
Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/39347 |
| Comment by Gerrit Updater [ 30/Jun/21 ] |
|
Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/39347/ |
| Comment by Gerrit Updater [ 28/Aug/21 ] |
|
"James Simmons <jsimmons@infradead.org>" uploaded a new patch: https://review.whamcloud.com/44778 |
| Comment by Gerrit Updater [ 11/Sep/21 ] |
|
"Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/44778/ |
| Comment by Gerrit Updater [ 08/Dec/21 ] |
|
"James Simmons <jsimmons@infradead.org>" uploaded a new patch: https://review.whamcloud.com/45793 |