[LU-6215] Sync Lustre external tree with lustre linux kernel client Created: 05/Feb/15 Updated: 15/Mar/19 Resolved: 18/Jun/17 |
|
| Status: | Resolved |
| Project: | Lustre |
| Component/s: | None |
| Affects Version/s: | Lustre 2.8.0 |
| Fix Version/s: | None |
| Type: | Improvement | Priority: | Major |
| Reporter: | James A Simmons | Assignee: | Oleg Drokin |
| Resolution: | Duplicate | Votes: | 0 |
| Labels: | patch, upstream | ||
| Issue Links: |
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Epic/Theme: | upstream | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Rank (Obsolete): | 17387 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Description |
|
This is for book keeping all the work that is being done to bring the Intel branch into sync with what is upstream in the linux kernel. Also at the same ensure important changes upstream get merged back into the Intel branch. |
| Comments |
| Comment by Doug Oucharek (Inactive) [ 06/Feb/15 ] |
|
So is the work under this ticket for both upstream and downstream? |
| Comment by Oleg Drokin [ 06/Feb/15 ] |
|
It needs to be in-sync mostly. |
| Comment by Gerrit Updater [ 03/Mar/15 ] |
|
Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: http://review.whamcloud.com/13956 |
| Comment by Andreas Dilger [ 03/Mar/15 ] |
|
Note that I've updated https://wiki.hpdd.intel.com/display/PUB/Commit+Comments to describe requirements for patches ported to/from the upstream kernel, so that we keep them consistent and able to trace patches between Lustre and the kernel. |
| Comment by Gerrit Updater [ 08/Mar/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/13956/ |
| Comment by Gerrit Updater [ 09/Mar/15 ] |
|
Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: http://review.whamcloud.com/14013 |
| Comment by Gerrit Updater [ 26/Apr/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/14598 |
| Comment by Gerrit Updater [ 04/May/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/14662 |
| Comment by Gerrit Updater [ 04/May/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/14664 |
| Comment by Gerrit Updater [ 05/May/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/14669 |
| Comment by Gerrit Updater [ 05/May/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/14681 |
| Comment by Gerrit Updater [ 05/May/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/14683 |
| Comment by James A Simmons [ 05/May/15 ] |
|
As you can see I pushed several patches. I think it will cover Ubuntu 15 support but I haven't got a setup yet to try it out. Still more patches are needed to bring us in line with greg's lustre-staging tree but we are almost there. |
| Comment by Gerrit Updater [ 20/May/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/14662/ |
| Comment by Gerrit Updater [ 28/May/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/14664/ |
| Comment by Gerrit Updater [ 05/Jun/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/14598/ |
| Comment by Gerrit Updater [ 05/Jun/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/14669/ |
| Comment by Gerrit Updater [ 06/Jun/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/15165 |
| Comment by Gerrit Updater [ 08/Jun/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/15182 |
| Comment by James A Simmons [ 08/Jun/15 ] |
|
Last patch has been pushed that is needed to allow master testing against the linux staging tree. |
| Comment by Gerrit Updater [ 19/Jun/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/14683/ |
| Comment by Gerrit Updater [ 19/Jun/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/14681/ |
| Comment by Gerrit Updater [ 09/Aug/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/15165/ |
| Comment by Gerrit Updater [ 19/Aug/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/15182/ |
| Comment by James A Simmons [ 19/Aug/15 ] |
|
With the latest patch landing masters client support is up to an 4.1 linux kernel now. |
| Comment by Gerrit Updater [ 21/Aug/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16049 |
| Comment by James A Simmons [ 21/Aug/15 ] |
|
Linux kernel version 4.2 will soon be release so its time for updates. |
| Comment by Gerrit Updater [ 24/Aug/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16069 |
| Comment by Gerrit Updater [ 27/Aug/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16118 |
| Comment by Gerrit Updater [ 27/Aug/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16119 |
| Comment by Gerrit Updater [ 29/Aug/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16049/ |
| Comment by Gerrit Updater [ 01/Sep/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16069/ |
| Comment by Gerrit Updater [ 02/Sep/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16119/ |
| Comment by Gerrit Updater [ 02/Sep/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16118/ |
| Comment by James A Simmons [ 04/Sep/15 ] |
|
With the release of 4.2 a few more patches are now need. 1) misc_deregister no longer returns a int |
| Comment by Gerrit Updater [ 04/Sep/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16275 |
| Comment by Gerrit Updater [ 04/Sep/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16278 |
| Comment by James A Simmons [ 04/Sep/15 ] |
|
One last patch to go. In the upstream client Al Viro ripped out the THREAD_SIZE handling in ll_follow_link. Should we do the same thing> |
| Comment by Alexander Boyko [ 05/Sep/15 ] |
This patch introduce a regression. It checks ib_cq_init_attr at configure path, but use it later for a ib_create_cq. It is wrong way, because ib_cq_init_attr and ib_create_cq modification was added at kernel by different commits. So kernel could have ib_cq_init_attr patch, but ib_create_cq() prototype does not include ib_cq_init_attr as parameter. |
| Comment by James A Simmons [ 05/Sep/15 ] |
|
Yes it was two separate commits which were committed together on the same day. True it is possible a future distribution could include only one of those patches. I have seen strange things with some distribution. |
| Comment by James A Simmons [ 09/Sep/15 ] |
|
Alex I looked into different OFED stacks and saw the tendency is to keep the kernel headers in sync with the latest kernels but the source code itself is a few versions behind. I did run into the issue due to this, sigh |
| Comment by Gerrit Updater [ 09/Sep/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16342 |
| Comment by Gerrit Updater [ 11/Sep/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16376 |
| Comment by Gerrit Updater [ 15/Sep/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16275/ |
| Comment by Gerrit Updater [ 15/Sep/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16342/ |
| Comment by James A Simmons [ 17/Sep/15 ] |
|
For 4.3-rc1 the return value for seq_print has been removed |
| Comment by Gerrit Updater [ 22/Sep/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16376/ |
| Comment by Gerrit Updater [ 26/Sep/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16649 |
| Comment by Gerrit Updater [ 06/Oct/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16278/ |
| Comment by James A Simmons [ 06/Oct/15 ] |
|
Latest landing enabled kernel 4.2.1 client support. One patch outstanding that enables server side, using ZFS, support for 4.2.1 kernels. |
| Comment by Gerrit Updater [ 07/Oct/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16649/ |
| Comment by James A Simmons [ 07/Oct/15 ] |
|
With the latest merge Lustre clients and Lustre servers using the latest ZFS can now work with linux kernel versions up to 4.2.1 |
| Comment by Andreas Dilger [ 08/Oct/15 ] |
|
James, it would be useful to add this information to the lustre/ChangeLog file - separately for the client and server, and making it clear that the server support is only for ZFS and not ldiskfs (due to the lack of ldiskfs patch series). |
| Comment by Gerrit Updater [ 08/Oct/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16767 |
| Comment by Gerrit Updater [ 08/Oct/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16769 |
| Comment by James A Simmons [ 09/Oct/15 ] |
|
Andreas I did push a patch for the ChangeLog. Bob was surprise that no lbuild changes was included due to no setup for this. Is it okay to push a patch with no lbuild support? Also now that we support 4.2.1 perhaps it is time to look at adding new kernel testing to the matrix. |
| Comment by Andreas Dilger [ 11/Oct/15 ] |
|
I don't think the ability of Lustre to build against a certain kernel depends on lbuild support for same. I never use lbuild locally, just "make" or "make rpms" and leave the kernel alone. |
| Comment by Gerrit Updater [ 14/Oct/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16767/ |
| Comment by Gerrit Updater [ 24/Oct/15 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16933 |
| Comment by Gerrit Updater [ 30/Oct/15 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16769/ |
| Comment by Gerrit Updater [ 01/Mar/16 ] |
|
Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: http://review.whamcloud.com/18728 |
| Comment by Gerrit Updater [ 01/Mar/16 ] |
|
Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: http://review.whamcloud.com/18729 |
| Comment by Gerrit Updater [ 01/Mar/16 ] |
|
Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: http://review.whamcloud.com/18730 |
| Comment by Gerrit Updater [ 01/Mar/16 ] |
|
Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: http://review.whamcloud.com/18731 |
| Comment by Gerrit Updater [ 03/Mar/16 ] |
|
Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: http://review.whamcloud.com/18759 |
| Comment by Gerrit Updater [ 03/Mar/16 ] |
|
Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: http://review.whamcloud.com/18760 |
| Comment by James A Simmons [ 03/Mar/16 ] |
|
Thanks Li for finishing off the 4.4 kernel support |
| Comment by Gerrit Updater [ 23/Mar/16 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/18728/ |
| Comment by Gerrit Updater [ 23/Mar/16 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/18729/ |
| Comment by Gerrit Updater [ 23/Mar/16 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/18730/ |
| Comment by Gerrit Updater [ 28/Mar/16 ] |
|
Dmitry Eremin (dmitry.eremin@intel.com) uploaded a new patch: http://review.whamcloud.com/19168 |
| Comment by Gerrit Updater [ 29/Mar/16 ] |
|
Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: http://review.whamcloud.com/19185 |
| Comment by Gerrit Updater [ 29/Mar/16 ] |
|
Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: http://review.whamcloud.com/19186 |
| Comment by Andreas Dilger [ 31/Mar/16 ] |
|
What do people think about having a separate LU ticket for each upstream kernel (e.g. "Build client with 4.3 kernel", "Build client with Linux 4.4 kernel", etc)? That would allow closing the ticket when the code is known to build with that particular kernel, and would go into the release tracker, instead of keeping this ticket open for multiple releases. Also, as a reminder, please remember to update lustre/ChangeLog for the "vanilla Linux" client build version in the last patch of the series for that kernel so that it is clear to users which kernels the client can build with. |
| Comment by Gerrit Updater [ 06/Apr/16 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16933/ |
| Comment by James A Simmons [ 22/Apr/16 ] |
|
I took your advise Andreas and opened a new ticket for 4.5 kernel support. Since many patches are in flight and ready to land for 4.4 I left this attached to this ticket. |
| Comment by Gerrit Updater [ 28/Apr/16 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/18731/ |
| Comment by Gerrit Updater [ 28/Apr/16 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/19185/ |
| Comment by Gerrit Updater [ 28/Apr/16 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/18759/ |
| Comment by Gerrit Updater [ 29/Apr/16 ] |
|
Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: http://review.whamcloud.com/19890 |
| Comment by Gerrit Updater [ 08/May/16 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/19890/ |
| Comment by Gerrit Updater [ 16/May/16 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/19186/ |
| Comment by Gerrit Updater [ 27/May/16 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/19168/ |
| Comment by Gerrit Updater [ 01/Jun/16 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/20543 |
| Comment by Gerrit Updater [ 05/Jul/16 ] |
|
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/20543/ |
| Comment by Jian Yu [ 19/Jul/16 ] |
|
Hi James, |
| Comment by Andreas Dilger [ 19/Jul/16 ] |
|
If all of the current patches are landed, it would be best to close this bug for 2.9.0 and open a new one for 2.10.0 (linked to this one). That makes it a lot easier to track. |
| Comment by James A Simmons [ 19/Jul/16 ] |
|
I first need to open the new ticket and add all the open links on this ticket to that new one. |
| Comment by Peter Jones [ 03/Aug/16 ] |
|
I cannot mark the ticket as resolved because it has technical tasks still open so I have removed the 2.9 fixversion. IMHO the best thing to do from a tracking point of view would be to have a ticket for each kernel version so it is really clear to understand which patches are needed for a given kernel version. |
| Comment by James A Simmons [ 08/Aug/16 ] |
|
Future kernel patches are being directed to separate tickets. Currently kernel 4.5 support is being done under |
| Comment by Gerrit Updater [ 17/Aug/16 ] |
|
James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/21970 |
| Comment by James A Simmons [ 17/Aug/16 ] |
|
My bad. Wrong ticket number was used by mistake. Now its under |
| Comment by James A Simmons [ 18/Jun/17 ] |
|
Its no longer easy to see what work is left so I started a new ticket to track the remaining work, |