Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UCT/RC/DC: Fix iface tx ops buffer overflow - v1.5.x #3188

Merged
merged 2 commits into from
Feb 8, 2019

Conversation

brminich
Copy link
Contributor

@brminich brminich commented Feb 7, 2019

What

Fix for iface tx ops buffer overflow.

Why ?

RC iface allocates buffer for tx op completions, which is used by zcopy and flush operations.
While max number of simultaneous zcopy operations is limited by CQ length, flushes are not limited at all. Since iface buffer for op completions fits just CQ length elements, it can be easily overflowed.

How ?

Use separate memory pool for flush operations with non NULL completions.

NOTE: this is not a cherry-pick from #3172, because of different UCT/IB code base

Use separate memory pool for flush operations with completions to avoid
iface tx ops buffer overflow.
@swx-jenkins1
Copy link

Test PASSed.
See http://bgate.mellanox.com/jenkins/job/gh-ucx-pr/5997/ for details.

@mellanox-github
Copy link
Contributor

Test PASSed.
See http://hpc-master.lab.mtl.com:8080/job/hpc-ucx-pr/8704/ for details (Mellanox internal link).

@brminich
Copy link
Contributor Author

brminich commented Feb 8, 2019

@yosefe

@yosefe yosefe merged commit 5fc3f06 into openucx:v1.5.x Feb 8, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants