[LU-15975] Statahead_V1 Features

• Status: Resolved
• Project: Lustre
• Type: Epic
• Priority: Major
• Reporter: Xing Huang
• Assignee: Xing Huang
• Resolution: Done
• Labels: hxr, statahead_v1
• Epic Name: Statahead_V1 Features

Description

The Epic is used to track this several features that will be delivered in Lustre 2.16

LU-14139    batched statahead processing
LU-14393    protocol: basic batching processing framework
LU-15550    ptlrpc: retry mechanism for overflowed batched RPCs
LU-15562    statahead: using try lock for batched RPCs
LU-16096 recovery: handle compatibility during upgrade for new replay data format

The four tickets' patches are listed in the comments.

More detailed description of these components is included in the referenced LU tickets.

Issue Links

• is related to: LU-16096 recovery: handle compatibility durin...
• is related to: LU-14139 batched statahead processing
• is related to: LU-14393 Batching Processing Framework for Lustre
• is related to: LU-15550 WBC: retry the batched RPC when the r...
• is related to: LU-15562 statahead: using try lock for batched...

Comments

[Li Xi]

Patches for this feature:

https://review.whamcloud.com/#/c/46549/ LU-15562 statahead: using try lock for batched RPCs
https://review.whamcloud.com/#/c/46540/ LU-15550 ptlrpc: retry mechanism for overflowed batched RPCs
https://review.whamcloud.com/#/c/43707/ LU-14139 ptlrpc: grow PtlRPC properly when prepare sub request
https://review.whamcloud.com/#/c/41220/ LU-14139 statahead: add test for batch statahead processing
https://review.whamcloud.com/#/c/40945/ LU-14139 ptlrpc: grow reply buffer properly for batch request
https://review.whamcloud.com/#/c/40943/ LU-14139 statahead: add stats for batch RPC requests
https://review.whamcloud.com/#/c/41378/ LU-14393 protocol: basic batching processing framework
https://review.whamcloud.com/#/c/48261/ LU-16096 recovery: upgrade reply data after recovery finish
https://review.whamcloud.com/#/c/48228/ LU-14393 recovery: reply reconstruction for batched RPCs
https://review.whamcloud.com/#/c/40720/ LU-14139 statahead: batched statahead processing
https://review.whamcloud.com/#/c/46309/ LU-14139 statahead: add total hit/miss count stats
https://review.whamcloud.com/#/c/45648/ LU-14139 llite: simplify callback handling for async getattr

[Xing Huang]

1 patch passed Jenkins and Maloo's verification, and needs to specify code reviewer before code-review; other 9 patches needs addressing the failures reported by Jenkins or Maloo.

[Xing Huang]

This week all the 10 patches passed Jenkins test, and need addressing Maloo failures.

[Xing Huang]

All the 10 patches passed Jenkins test, and 2 of them passed Maloo test this week, and the other 8 patches need to address Maloo failures.

[Xing Huang]

2 patches(#45648 #46309) are ready to land, 1 patch(#41378) is being review, and the other 7 patches need to address Maloo failures.

[Xing Huang]

2 patches(#45648 #46309) are merged this week;
1 patch(#41378) is being reviewed again;
and the other 7 patches need to address Maloo failures.

[Xing Huang]

2 patches(#45648 #46309) are merged;
5 patches(#41378 #40720 #40943 #40945 #41220) are being reviewed;
The other 3 patches need to address Maloo failures.

[Xing Huang]

the statuses of the 10 patches listed in this Epic are:
2 patches(#45648 #46309) are merged;
1 patches(#46549) passed Maloo test again and is being reviewed.
The other 7 patches($40720 #40943 #40945 #41220 #43707 #41378 #46540) have Maloo failures.

[Xing Huang]

The statuses of the 10 patches listed in this Epic are:
2 patches(#45648 #46309) are merged;
7 patches($40720 #40945 #41220 #43707 #41378 #46540#46549) passed Maloo test again and are being reviewed
The other patch(#40943) has Maloo failures.

[Xing Huang]

The statuses of the 10 patches listed in Epic LU-15975 are:
2 patches(#45648 #46309) are merged;
8 patches($40720 #40943 #40945 #41220 #43707 #41378 #46540 #46549) passed Maloo tests and are being reviewed.
BTW, WC Checkpatch required the biggest patch(#41378) needs to be rebased.

[Xing Huang]

2022-11-19:
The statuses of the 10 patches listed in Epic LU-15975 are:
2 patches(#45648 #46309) are merged;
The core patch(#41378) passed code-review this week and being updated.
7 patches($40720 #40943 #40945 #41220 #43707 #46540 #46549) passed Maloo tests and are being reviewed.

[Xing Huang]

2022-11-26:
The statuses of the 10 patches listed in Epic LU-15975 are:
2 patches(#45648 #46309) are merged.
The core patch(#41378) is ready to land.
7 patches($40720 #40943 #40945 #41220 #43707 #46540 #46549) are being reviewed.

[Xing Huang]

#40720 relys on the following two patch, add them to this epic:
https://review.whamcloud.com/#/c/48261/ LU-16096 recovery: upgrade reply data after recovery finish
https://review.whamcloud.com/#/c/48228/ LU-14393 recovery: reply reconstruction for batched RPCs

[Xing Huang]

2023-01-28:
#41378 and #48228 landed to master this week.
The statuses of the 12 patches listed in the ticket are:
4 patches(#45648 #46309 #41378 #48228) landed.
1 patch(#48261) is ready to land(on master-next branch).
7 patches(#40720 #40943 #40945 #41220 #43707 #46540 #46549) are being reviewed, some of these patches were reviewed by Andreas.

[Xing Huang]

2023-02-06:
3 patches(#41378 #48261 #48228) landed recent two weeks, the remain 7 patches were updated or rebased last week.
The statuses of the 12 patches listed in Epic LU-15975 are:
5 patches(#45648 #46309 #41378 #48261 #48228) are merged.
7 patches(#40720 #40943 #40945 #41220 #43707 #46540 #46549) are to be reviewed.

[Xing Huang]

2023-03-18:
The statuses of the 12 patches listed in this are:
5 patches(#45648 #46309 #41378 #48261 #48228) are merged.
5 patches(#40720 #40943 #40945 #43707 #46540) are being reviewed.
1 patch(#46549) passed code-review and is waiting for the above Statahead patches.
1 patch(#41220) is rejected by code-review.

[Xing Huang]

2023-04-03:
The statuses of the 12 patches listed in this epic are:
5 patches(#45648 #46309 #41378 #48261 #48228) are merged.
1 patch(#40720) is ready to land(not in master-next)
1 patch(#40943) passed code-review, but needs to be rebased.
3 patches(#40945 #43707 #46549 ) passed code-review and are depending on the above Statahead patches.
1 patch(#46540) is being reviewed.
1 patch(#41220) has Maloo failures.

[Xing Huang]

2023-04-15:
The statuses of the 12 patches listed in this epic are:
6 patches(#45648 #46309 #41378 #48261 #48228 #40720) are merged.
3 patches(#40943 #41220 #46540) are being reviewed.
2 patches(#40945 #43707) have Maloo failures.
1 patch(#46549) has Jenkins errors.
We will focus on (#40943 #40945 #43707) next week.

[Xing Huang]

2023-04-29:
The statuses of the 12 patches listed in this epic are:
10 patches(#45648 #46309 #41378 #48261 #48228 #40720 #40943 #40945 #43707 #41220) are merged.
1 patch(#46540) is ready to land(on master-next branch)
1 patch(#46549) has Maloo failures.

[Xing Huang]

2023-05-27:
The statuses of the 12 patches listed in this epic are:
11 patches(#45648 #46309 #41378 #48261 #48228 #40720 #40943 #40945 #43707 #41220 #46540) are merged.
1 patch(#46549) is ready to land(on master-next branch).

[Xing Huang]

2023-06-01:
The statuses of the 12 patches listed in this epic are:
All 12 patches(#45648 #46309 #41378 #48261 #48228 #40720 #40943 #40945 #43707 #41220 #46540 #46549) landed to master.

[Xing Huang]

Landed for 2.16