Open MPI logo

Open MPI Development Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Development mailing list

Subject: Re: [OMPI devel] [PATCH] fix mx btl_bandwidth
From: Jeff Squyres (jsquyres_at_[hidden])
Date: 2010-09-03 08:03:31


Thanks; committed in r23712.

Can you file CMRs for 1.4 and 1.5? Thanks.

On Sep 3, 2010, at 3:53 AM, Brice Goglin wrote:

> For some reason, the MX btl sets btl_bandwidth in megabits/s instead of
> megabytes/s. So we get crazy btl_weights in case of heterogeneous
> multirail. And --mca btl_mx_bandwidth <width> cannot work around the
> problem (it probably doesn't help because it's overriden by the runtime
> link width detection anyway?).
>
> Signed-off-by: Brice Goglin <Brice.Goglin_at_[hidden]>
>
> Index: ompi/mca/btl/mx/btl_mx_component.c
> ===================================================================
> --- ompi/mca/btl/mx/btl_mx_component.c (révision 23711)
> +++ ompi/mca/btl/mx/btl_mx_component.c (copie de travail)
> @@ -159,7 +159,7 @@
> MCA_BTL_FLAGS_PUT |
> MCA_BTL_FLAGS_SEND |
> MCA_BTL_FLAGS_RDMA_MATCHED);
> - mca_btl_mx_module.super.btl_bandwidth = 2000;
> + mca_btl_mx_module.super.btl_bandwidth = 250;
> mca_btl_mx_module.super.btl_latency = 5;
> mca_btl_base_param_register(&mca_btl_mx_component.super.btl_version,
> &mca_btl_mx_module.super);
> @@ -357,7 +357,7 @@
> mx_btl->mx_endpoint = mx_endpoint;
> mx_btl->mx_endpoint_addr = mx_endpoint_addr;
>
> - mx_btl->super.btl_bandwidth = 2000; /* whatever */
> + mx_btl->super.btl_bandwidth = 250; /* whatever */
> mx_btl->super.btl_latency = 10;
> #if defined(MX_HAS_NET_TYPE)
> {
> @@ -370,11 +370,11 @@
> } else {
> if( MX_SPEED_2G == value ) {
> mx_unique_network_id |= 0xaa000000;
> - mx_btl->super.btl_bandwidth = 2000;
> + mx_btl->super.btl_bandwidth = 250;
> mx_btl->super.btl_latency = 5;
> } else if( MX_SPEED_10G == value ) {
> mx_unique_network_id |= 0xbb000000;
> - mx_btl->super.btl_bandwidth = 10000;
> + mx_btl->super.btl_bandwidth = 1250;
> mx_btl->super.btl_latency = 3;
> } else {
> mx_unique_network_id |= 0xcc000000;
>
>
> <fix_btl_bandwidths.patch>_______________________________________________
> devel mailing list
> devel_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/devel

-- 
Jeff Squyres
jsquyres_at_[hidden]
For corporate legal information go to:
http://www.cisco.com/web/about/doing_business/legal/cri/