Re: [ofa-general] InfiniBand/iWARP/RDMA merge plans for 2.6.26 (what'sin infiniband.git)

From: Richard Frank
Date: Fri Apr 04 2008 - 15:27:56 EST


> We want to add send with invalidate & mask compare and swap.
> Eli will be able to send the patches next week and since they are
> small I think they can be in for 2.6.26

We are very interested in these new operations and are moving in the direction of tightly integrating RDMA along with atomics (if available) into Oracle. We plan on testing some early prototypes of the these in the few months.

Send with invalidate is an exact match for our current RDS V3 rdma driver - and should be more efficient than the current background syncing of the tpt to ensure keys are invalidated.

We intend on exposing the atomics via the RDS driver along with simple low level rdma operations to Oracle's internal clients. If Oracle is running over a transport which exports atomics and rdma - Oracle will see a dramatic performance boost for several database operations.

Roland Dreier wrote:
> We want to add send with invalidate & mask compare and swap.
> Eli will be able to send the patches next week and since they are
> small I think they can be in for 2.6.26

Send with invalidate should be OK. Let's see about the masked atomics
stuff -- we have a ton of new verbs and I think we might want to slow
down and make sure it all makes sense.

> What about the split CQ for UD mode? It's improved the IPoIB
> performance for small messages significantly.

Oh yeah... I'll try to get that in too.

> mlx4- we plan to send patches for the low level driver only to enable
> mlx4_en. These only affect our low level driver.

No problem in principle, let's see the actual patches.

> I think we should try to push for XEC in 2.6.26 since there are
> already MPI implementation that use it and this ties them to use OFED
> only.
> Also this feature is stable and now being defined in IBTA
> Not taking it causing changes between OFED and the kernel and your
> libibverbs and we wish to avoid such gaps.
> Is there any thing we can do to help and make it into 2.6.26?

I don't have a good feeling that the user-kernel interface is well
thought out, so I want to consider XRC + ehca LL stuff + new iWARP verbs
and make sure we have something that makes sense for the future.

- R.
_______________________________________________
general mailing list
general@xxxxxxxxxxxxxxxxxxxxx
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general

To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/