Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

prov/efa, fabtests/efa: Only test inter_min_read_write_size for for emulated write path #10411

Merged
merged 3 commits into from
Sep 26, 2024

Conversation

shijin-aws
Copy link
Contributor

FI_EFA_INTER_MIN_READ_WRITE_SIZE is only applied to emulated write protocols. When efa device support rdma write,
rdma write will be always used.
This PR introduces a efa_rdma_checker.c code to check efa device's rdma read/write capability on a given platform, and
skip inter_min_read_write_size test in fabtests if the device support rdma-write.

@shijin-aws shijin-aws force-pushed the inter_min_read_write_size branch 2 times, most recently from 02c8f98 to 54622cb Compare September 24, 2024 23:57
@shijin-aws
Copy link
Contributor Author

AWS CI failure is real

prov/efa/src/efa_rdma_checker.o: In function `main':

/home/ec2-user/PortaFiducia/build/libraries/libfabric/pr10411-dso/source/libfabric/fabtests/prov/efa/src/efa_rdma_checker.c:71: undefined reference to `efadv_query_device'

collect2: error: ld returned 1 exit status

make[1]: *** [prov/efa/src/fi_efa_rdma_checker] Error 1

Need to fix

@shijin-aws shijin-aws force-pushed the inter_min_read_write_size branch 2 times, most recently from 9817513 to d84773f Compare September 25, 2024 15:47
@shijin-aws
Copy link
Contributor Author

@j-xiong could u review 6901162 ?

if HAVE_EFADV
prov_efa_src_fi_efa_rdma_checker_SOURCES = \
prov/efa/src/efa_rdma_checker.c
prov_efa_src_fi_efa_rdma_checker_LDADD = libfabtests.la
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's dubious to me whether LDADD is needed.

Reading https://www.gnu.org/software/automake/manual/html_node/Linking.html I think we can do prov_efa_src_fi_efa_rdma_checker_LDFLAGS = -lefa and get rid of configure.m4

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good call out, It works for me. I added LDFLAGS and dropped 6901162.

This code checks whether efa device support rdma read or write
capability.

Signed-off-by: Shi Jin <sjina@amazon.com>
The env inter_min_read_write_size only applies to emulated write path.
If the efa device supports RDMA write, device RDMA write will always be used.

Signed-off-by: Shi Jin <sjina@amazon.com>
…rite is on

FI_EFA_INTER_MIN_READ_WRITE_SIZE is only applied to emulated write protocols.
When efa device supports rdma write, rdma write should always be used.

Signed-off-by: Shi Jin <sjina@amazon.com>
@shijin-aws
Copy link
Contributor Author

@j-xiong could u review 6901162 ?

I dropped this commit, it should be a pure efa change now.

@j-xiong
Copy link
Contributor

j-xiong commented Sep 25, 2024

@shijin-aws While I was reviewing that one the power went out. Good to see it has been dropped.

@shijin-aws shijin-aws merged commit 0dcaceb into ofiwg:main Sep 26, 2024
13 of 21 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants