From koop at cse.ohio-state.edu Fri May 2 16:30:15 2008 From: koop at cse.ohio-state.edu (Matthew Koop) Date: Fri May 2 16:30:26 2008 Subject: [mvapich-discuss] race in mvapich-0.9.9 cm_create_rc_qp() with viadev.connections==NULL In-Reply-To: Message-ID: John, We've now fixed this issue in the MVAPICH SVN (trunk and 1.0 branches). It will be in the upcoming MVAPICH minor release as well. For 0.9.9 your suggested fix should work there as well. Thanks again for pointing this issue out. Matt On Wed, 23 Apr 2008, Matthew Koop wrote: > John, > > Thanks for reporting this problem and looking into a possible solution. > This does appear to be a race condition in the initialization of > viadev.connections. We'll add this as a bug report and fix this in the > very near future. > > Thanks again, > > Matt > > On Tue, 22 Apr 2008, John Hawkes wrote: > > > I've encountered a race condition in mvapich-0.9.9 (also exists in > > mvapich-1.0) in cm_create_rc_qp() (mpid/ch_gen2/cm.c). On occasion, > > under conditions of dozens of threads starting up, cm_create_rc_qp() > > encounters viadev.connections==NULL. > > > > I believe the problem stems from the ordering of initialization. The > > main viainit.c calls: > > if (MPICM_Connect_UD(viadev.ud_qpn_table, viadev.lid_table)) { > > error_abort_all(GEN_EXIT_ERR, "MPICM_Connect_UD"); > > } > > and soon thereafter it initializes viadev.connections. Meanwhile, > > MPICM_Connect_UD() has done a pthread_create() of cm_completion_handler > > (). That concurrently executing thread handles incoming messages, one > > of which may get to cm_accept(), which then calls cm_create_rc_qp(), > > which may dereference viadev.connections before the main thread has > > initialized it. > > > > I seem to be able to avoid this race condition by moving the call to > > MPICM_Connect_UD() to follow the initialization of viadev.connections. > > Does this fix create other problems that my current testing has not yet > > encountered? > > > > John Hawkes > > jhawkes@PenguinComputing.com > > > > _______________________________________________ > > mvapich-discuss mailing list > > mvapich-discuss@cse.ohio-state.edu > > http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss > > > > _______________________________________________ > mvapich-discuss mailing list > mvapich-discuss@cse.ohio-state.edu > http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss > From sridharj at cse.ohio-state.edu Fri May 2 16:36:13 2008 From: sridharj at cse.ohio-state.edu (Jaidev Sridhar) Date: Fri May 2 16:36:25 2008 Subject: [mvapich-discuss] Re: rsh problem (fwd) In-Reply-To: References: Message-ID: <20080502203613.GA29743@mu.cse.ohio-state.edu> Hi Tai, | Hi, | I have a problem when running mvapich-0.9.9, I built mvapich using the TCP interface. When compiling using mpif90 I have no problem but when I try to run it with 4 processors I encounter an error message. | er@AI03170801 <145> $MPIRUN -np 4 imslmpi | Trying krb4 rsh... | krb_sendauth failed: You have no tickets cached | trying normal rsh (/usr/bin/rsh) | localhost.localdomain: Connection refused This looks like a problem with rsh setup. Can you check if password-less rsh works? If it doesn't, you might want to try the steps mentioned at http://www.beowulf.org/archive/2005-July/013409.html -Jaidev | p0_24371: p4_error: Child process exited while making connection to remote proc | ess on AI03170801: 0 | I'm running on redhat5 enterprise using pgi compiler. How do I resolve this issue? | | Thank you | Tai From keshetti85-student at yahoo.co.in Mon May 5 07:01:07 2008 From: keshetti85-student at yahoo.co.in (Keshetti Mahesh) Date: Mon May 5 08:17:45 2008 Subject: [mvapich-discuss] Using RDMA CM with MVAPICH2 Message-ID: <829ded920805050401v16961f10y4cae507d58c74cfe@mail.gmail.com> Hi all, I want to use the RDMA CM option of MVAPICH2. The procedure described in the user guide is not much informative. Can anyone here give me the detailed procedure for using the RDMA CM option. Also, I'll be glad if some one can give me a document describing how it works in detail. Actually I have some doubts like, how the IP addresses (???) are resolved into IB addresses and what happens in the case of nodes two HCAs (or 1 HCA with two ports) ? In the MVAPICH2 user guide it is mentioned that "RDMA CM device needs to be setup, configured with an IP address and connected to the network". Is this same as configuring IPoIB device ? -Mahesh From keshetti85-student at yahoo.co.in Mon May 5 08:24:07 2008 From: keshetti85-student at yahoo.co.in (Keshetti Mahesh) Date: Mon May 5 08:24:19 2008 Subject: [mvapich-discuss] Using RDMA CM with MVAPICH2 Message-ID: <829ded920805050524p545cd1fcie583c732c8dd92ca@mail.gmail.com> Hi all, I want to use the RDMA CM option of MVAPICH2. The procedure described in the user guide is not much informative. Can anyone here give me the detailed procedure for using the RDMA CM option. Also, I'll be glad if some one can give me a document describing how it works in detail. Actually I have some doubts like, how the IP addresses (???) are resolved into IB addresses and what happens in the case of nodes two HCAs (or 1 HCA with two ports) ? In the MVAPICH2 user guide it is mentioned that "RDMA CM device needs to be setup, configured with an IP address and connected to the network". Is this same as configuring IPoIB device ? -Mahesh From panda at cse.ohio-state.edu Mon May 5 08:24:20 2008 From: panda at cse.ohio-state.edu (Dhabaleswar Panda) Date: Mon May 5 08:24:33 2008 Subject: [mvapich-discuss] Using RDMA CM with MVAPICH2 In-Reply-To: <829ded920805050401v16961f10y4cae507d58c74cfe@mail.gmail.com> Message-ID: RDMA CM is designed by OpenFabrics. MVAPICH2 uses this. If you post your questions to OpenFabrics General mailing list, the designers of RDMA CM component will be able to provide detailed answers regarding how it works. DK On Mon, 5 May 2008, Keshetti Mahesh wrote: > Hi all, > > I want to use the RDMA CM option of MVAPICH2. The procedure described > in the user guide is not much informative. Can anyone here give me the detailed > procedure for using the RDMA CM option. Also, I'll be glad if some one can give > me a document describing how it works in detail. > Actually I have some doubts like, how the IP addresses (???) are > resolved into IB > addresses and what happens in the case of nodes two HCAs (or 1 HCA > with two ports) ? > > In the MVAPICH2 user guide it is mentioned that "RDMA CM device needs > to be setup, > configured with an IP address and connected to the network". Is this > same as configuring > IPoIB device ? > > -Mahesh > _______________________________________________ > mvapich-discuss mailing list > mvapich-discuss@cse.ohio-state.edu > http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss > From keshetti85-student at yahoo.co.in Tue May 6 05:21:08 2008 From: keshetti85-student at yahoo.co.in (Keshetti Mahesh) Date: Tue May 6 05:21:25 2008 Subject: [mvapich-discuss] Using RDMA CM with MVAPICH2 In-Reply-To: <829ded920805050529k19dee08o3ad19ce9d07bd2ca@mail.gmail.com> References: <829ded920805050401v16961f10y4cae507d58c74cfe@mail.gmail.com> <829ded920805050529k19dee08o3ad19ce9d07bd2ca@mail.gmail.com> Message-ID: <829ded920805060221lc3b5f77safacf8a8ad299b33@mail.gmail.com> I'vecouple of more questions to ask you. Below are the steps mentioned in MVAPICH user guide for running MPI application with RDMA CM support. *? Setup the RDMA CM device: RDMA CM device needs to be setup, configured with an IP address and connected to the network.* I have two machines (n0 and n1)connected with one ethernet interface and 2 IB interfaces in each. And /etc/hosts on both machines is like below. 192.168.3.1 n0 192.168.3.2 n1 172.131.15.1 n0_ib0 172.131.15.2 n0_ib1 172.131.15.3 n1_ib0 172.131.15.4 n1_ib0 Now If I want to run an MPI job on both of the nodes what should I mention in the *'hostfile'* given to MPI ("n0, n1" or "n0_ib0, n1_ib0 ... " ) ? *? Setup the Local Address File: Create the file (/etc/mv2.conf) with the local IP address to be used by RDMA CM. $ echo 10.1.1.1 >> /etc/mv2.conf* Why is this file (/etc/mv2.conf) required ? Is it required to be present on all nodes? -Mahesh -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20080506/d7e8f6bd/attachment.html From forum.san at gmail.com Tue May 6 00:27:49 2008 From: forum.san at gmail.com (Sangamesh B) Date: Tue May 6 08:05:45 2008 Subject: [mvapich-discuss] caused collective abort of all ranks + signal 9 Message-ID: Hi all, *I got some problem, can someone help me on this issue.* *The scenario is : We have a Rocks(4.2) cluster with 12 nodes. We installed Infiniband cards newly in 5 nodes(Masternode doesn't have IB card). Installation of OFED is successful and IP got assigned.* *I installed Mvapich2 in that and created password free environment from computenode-0-8 to 12(the nodes which have IB card). So far everything is fine, And the MPD is booting up also. * *I've compiled a sample MPI program and tried to execute it and I got the following kind of results:* Scenario 1: Using root to execute Hellow.o (compiled with mvapich2-mpicc) [root@compute-0-8 test]# /opt/mvapich2_ps/bin/mpiexec -np 2 /test/Hellow.o Hello world from process 0 of 2 Hello world from process 1 of 2 rank 1 in job 8 compute-0-8.local_34399 caused collective abort of all ranks exit status of rank 1: killed by signal 9 rank 0 in job 8 compute-0-8.local_34399 caused collective abort of all ranks exit status of rank 0: killed by signal 9 Scenario 2: Using user id (srinu) to execute the same file. [srinu@compute-0-8 test]$ /opt/mvapich2_ps/bin/mpiexec -np 2 /test/Hellow.o libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. This will severely limit memory registrations. libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. This will severely limit memory registrations. Fatal error in MPI_Init: Other MPI error, error stack: MPIR_Init_thread(259)....: Initialization failed MPID_Init(102)...........: channel initialization failed MPIDI_CH3_Init(178)......: MPIDI_CH3I_RMDA_init(208): Failed to Initialize HCA type rdma_iba_hca_init(645)...: cannot create cq Fatal error in MPI_Init: Other MPI error, error stack: MPIR_Init_thread(259)....: Initialization failed MPID_Init(102)...........: channel initialization failed MPIDI_CH3_Init(178)......: MPIDI_CH3I_RMDA_init(208): Failed to Initialize HCA type rdma_iba_hca_init(645)...: cannot create cq rank 1 in job 9 compute-0-8.local_34399 caused collective abort of all ranks exit status of rank 1: return code 1 For 2nd scenario, I found solution from net such as ulimit ?l unlimited. But further, this also produced same error as of 1st scenario. Can someone solve this error? Thanks in advance, Sangamesh -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20080506/a68ccbda/attachment.html From narravul at cse.ohio-state.edu Tue May 6 09:50:48 2008 From: narravul at cse.ohio-state.edu (Sundeep Narravula) Date: Tue May 6 09:51:00 2008 Subject: [mvapich-discuss] Using RDMA CM with MVAPICH2 In-Reply-To: <829ded920805060221lc3b5f77safacf8a8ad299b33@mail.gmail.com> Message-ID: Hi Mahesh, Thanks for trying out our RDMA CM support. My answers are inline. > I'vecouple of more questions to ask you. > > Below are the steps mentioned in MVAPICH user guide for > running MPI application with RDMA CM support. > > *• Setup the RDMA CM device: RDMA CM device needs to be > setup, configured with an IP address and connected to the network.* > > I have two machines (n0 and n1)connected with one ethernet interface > and 2 IB interfaces in each. And /etc/hosts on both machines is like > below. > > 192.168.3.1 n0 > 192.168.3.2 n1 > 172.131.15.1 n0_ib0 > 172.131.15.2 n0_ib1 > 172.131.15.3 n1_ib0 > 172.131.15.4 n1_ib0 > > Now If I want to run an MPI job on both of the nodes what should I > mention in the *'hostfile'* given to MPI ("n0, n1" or "n0_ib0, n1_ib0 ... " > ) ? You can use any one of these pairs in your hostfile. i.e. using n0 and n1 should work fine. > *• Setup the Local Address File: Create the file (/etc/mv2.conf) with the > local IP address to be used by RDMA CM. > $ echo 10.1.1.1 >> /etc/mv2.conf* > > Why is this file (/etc/mv2.conf) required ? Is it required to be present on > all nodes? The local rdma-cm device that the mpi library needs to use is specified in the /etc/mv2.conf file. The file needs to be on all the machines. --Sundeep. > > -Mahesh > From koop at cse.ohio-state.edu Tue May 6 11:45:11 2008 From: koop at cse.ohio-state.edu (Matthew Koop) Date: Tue May 6 11:45:23 2008 Subject: [mvapich-discuss] caused collective abort of all ranks + signal 9 In-Reply-To: Message-ID: Sangamesh, Can you run any of the included benchmarks with the OFED package? Try running the ibv_rc_pingpoing test between nodes in your system to first make sure the fabric is healthy. Also, can you give us some additional information on your setup? What type of cards are these? Also, how did you set the 'ulimit -l unlimited'. We suggest placing it in /etc/init.d/sshd on all nodes and restarting sshd (and mpd). This will ensure that the processes started will inherit the modified ulimit settings. Thanks, Matt On Tue, 6 May 2008, Sangamesh B wrote: > Hi all, > > > *I got some problem, can someone help me on this issue.* > > *The scenario is : We have a Rocks(4.2) cluster with 12 nodes. We installed > Infiniband cards newly in 5 nodes(Masternode doesn't have IB card). > Installation of OFED is successful and IP got assigned.* > > *I installed Mvapich2 in that and created password free environment from > computenode-0-8 to 12(the nodes which have IB card). So far everything is > fine, And the MPD is booting up also. * > > *I've compiled a sample MPI program and tried to execute it and I got the > following kind of results:* > > Scenario 1: Using root to execute Hellow.o (compiled with mvapich2-mpicc) > > [root@compute-0-8 test]# /opt/mvapich2_ps/bin/mpiexec -np 2 /test/Hellow.o > Hello world from process 0 of 2 > Hello world from process 1 of 2 > rank 1 in job 8 compute-0-8.local_34399 caused collective abort of all > ranks > exit status of rank 1: killed by signal 9 > rank 0 in job 8 compute-0-8.local_34399 caused collective abort of all > ranks > exit status of rank 0: killed by signal 9 > > Scenario 2: Using user id (srinu) to execute the same file. > > [srinu@compute-0-8 test]$ /opt/mvapich2_ps/bin/mpiexec -np 2 /test/Hellow.o > libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. > This will severely limit memory registrations. > libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. > This will severely limit memory registrations. > Fatal error in MPI_Init: > Other MPI error, error stack: > MPIR_Init_thread(259)....: Initialization failed > MPID_Init(102)...........: channel initialization failed > MPIDI_CH3_Init(178)......: > MPIDI_CH3I_RMDA_init(208): Failed to Initialize HCA type > rdma_iba_hca_init(645)...: cannot create cq > Fatal error in MPI_Init: > Other MPI error, error stack: > MPIR_Init_thread(259)....: Initialization failed > MPID_Init(102)...........: channel initialization failed > MPIDI_CH3_Init(178)......: > MPIDI_CH3I_RMDA_init(208): Failed to Initialize HCA type > rdma_iba_hca_init(645)...: cannot create cq > rank 1 in job 9 compute-0-8.local_34399 caused collective abort of all > ranks > exit status of rank 1: return code 1 > > For 2nd scenario, I found solution from net such as ulimit –l unlimited. > But further, this also produced same error as of 1st scenario. > Can someone solve this error? > > Thanks in advance, > > Sangamesh > From srikanth.gumma at Locuz.com Tue May 6 22:42:50 2008 From: srikanth.gumma at Locuz.com (Srikanth Gumma) Date: Tue May 6 22:43:32 2008 Subject: [mvapich-discuss] Execution problem Message-ID: <004a01c8afec$0bd63730$2382a590$@gumma@locuz.com> Skipped content of type multipart/alternative-------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 47069 bytes Desc: not available Url : http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20080507/f9eac213/attachment-0001.png -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/jpeg Size: 3194 bytes Desc: not available Url : http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20080507/f9eac213/attachment-0001.jpe From srikanth.gumma at Locuz.com Tue May 6 22:49:25 2008 From: srikanth.gumma at Locuz.com (Srikanth Gumma) Date: Tue May 6 22:49:56 2008 Subject: [mvapich-discuss] Execution problem Message-ID: <005101c8afec$f769d530$e63d7f90$@gumma@locuz.com> Hello, I got some problem, can somebody help on this issue. The scenario is : We have a Rocks(4.2) cluster with 12 nodes. We installed PCI-Ex Infiniband cards newly in 5 nodes(Masternode doesn?t have IB card). Installation of OFED is successful and IP got assigned. I installed Mvapich2 in that and created password free environment from computenode-0-8 to 12(the nodes which have IB card).? So far everything is fine, And the MPD is booting up also. I?ve compiled a sample MPI program and tried to execute it and I got the following kind of results: Scenario 1: Using root to execute Hellow.o (compiled with mvapich2-mpicc) [root@compute-0-8 test]# /opt/mvapich2_ps/bin/mpiexec -np 2 /test/Hellow.o Hello world from process 0 of 2 Hello world from process 1 of 2 rank 1 in job 8? compute-0-8.local_34399?? caused collective abort of all ranks ? exit status of rank 1: killed by signal 9 rank 0 in job 8? compute-0-8.local_34399?? caused collective abort of all ranks ? exit status of rank 0: killed by signal 9 Scenario 2: Using user id (srinu) to execute the same file. [srinu@compute-0-8 test]$ /opt/mvapich2_ps/bin/mpiexec -np 2 /test/Hellow.o libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. ??? This will severely limit memory registrations. libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. ??? This will severely limit memory registrations. Fatal error in MPI_Init: Other MPI error, error stack: MPIR_Init_thread(259)....: Initialization failed MPID_Init(102)...........: channel initialization failed MPIDI_CH3_Init(178)......: MPIDI_CH3I_RMDA_init(208): Failed to Initialize HCA type rdma_iba_hca_init(645)...: cannot create cq Fatal error in MPI_Init: Other MPI error, error stack: MPIR_Init_thread(259)....: Initialization failed MPID_Init(102)...........: channel initialization failed MPIDI_CH3_Init(178)......: MPIDI_CH3I_RMDA_init(208): Failed to Initialize HCA type rdma_iba_hca_init(645)...: cannot create cq rank 1 in job 9? compute-0-8.local_34399?? caused collective abort of all ranks ? exit status of rank 1: return code 1 I believe there should be some kind of permissions or configuration to be changed such that the problem will get resolved. So far I?m unable to resolve the issue If some of you knows and fix/workaround for the above situation please suggest me the same. Any Help is appreciated. Srikanth Gumma Locuz Enterprise Solutions Pvt Ltd #20, Alfa Centere, VS Layout Intermediate Ring Road Bangalore 560047 Ph: +91-80-41314747 From jbernstein at penguincomputing.com Tue May 6 23:11:04 2008 From: jbernstein at penguincomputing.com (Joshua Bernstein) Date: Tue May 6 23:12:18 2008 Subject: [mvapich-discuss] Execution problem In-Reply-To: <005101c8afec$f769d530$e63d7f90$@gumma@locuz.com> References: <005101c8afec$f769d530$e63d7f90$@gumma@locuz.com> Message-ID: Hi Srikanth, On May 6, 2008, at 7:49 PM, Srikanth Gumma wrote: > libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. > This will severely limit memory registrations. > libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. This tells me that perhaps you, as a user aren't able to lock as much memory as required to startup the job. Can you give it a shot as root? In BASH you, as root, can adjust your ulimit to unlimited to see if the problem goes away: # ulimit -l unlimited If this works, then you need to adjust /etc/security/limits.conf and relogin to enable the change. -Joshua Bernstein Software Engineer Penguin Computing From Bill.Riner at comcast.net Tue May 6 20:15:12 2008 From: Bill.Riner at comcast.net (Bill Riner) Date: Tue May 6 23:20:18 2008 Subject: [mvapich-discuss] IBV_EVENT_QP_LAST_WQE_REACHED error Message-ID: <20080507001459.A899B2A0065@barracuda2.cse.ohio-state.edu> We upgraded from IBGold to OFED 1.2.5.5 and we also get the "Got FATAL event IBV_EVENT_QP_LAST_WQE_REACHED" error that's discussed in this thread: http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/2007-October/001139 .html [0:compute-0-23.local] Abort: [0] Got FATAL event IBV_EVENT_QP_LAST_WQE_REACHED, code=16 at line 2555 in file viacheck.c The particular code worked fine before the upgrade. The error doesn't occur when using just one processor. MPICH works fine on any number of processors. The OSU and Intel MPI benchmarks work fine. Other MPI codes work fine also. We're using MVAPICH 0.9.9 that came with OFED. Has this been resolved? -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20080506/6bda7a16/attachment.html From keshetti85-student at yahoo.co.in Wed May 7 00:30:18 2008 From: keshetti85-student at yahoo.co.in (Keshetti Mahesh) Date: Wed May 7 00:30:31 2008 Subject: [mvapich-discuss] Using RDMA CM with MVAPICH2 In-Reply-To: References: <829ded920805060221lc3b5f77safacf8a8ad299b33@mail.gmail.com> Message-ID: <829ded920805062130s89f7e1eyaee3b4f6a5ab55ac@mail.gmail.com> > Hi Mahesh, > > Thanks for trying out our RDMA CM support. My answers are inline. > Thanks Sundeep for replying. I've successfully tested RDMA CM support of MVAPICH2 and it worked fine. As far as I know, not many people are using the RDMA CM support of MVAPICH2. So I want to ask you whether using RDMA CM support have any impact on the performance of the MPI application AND How stable is the RDMA CM support code of MVAPICH2 ? -Mahesh From srikanth.gumma at Locuz.com Wed May 7 01:33:55 2008 From: srikanth.gumma at Locuz.com (Srikanth Gumma) Date: Wed May 7 01:34:23 2008 Subject: [mvapich-discuss] Execution problem In-Reply-To: References: <005101c8afec$f769d530$e63d7f90$@gumma@locuz.com> Message-ID: <005601c8b003$f25a8c30$d70fa490$@gumma@locuz.com> Hi Joshua, I tried with ulimit -l unlimited, But it didn't work Please let me know any other options Regards Srikanth -----Original Message----- From: Joshua Bernstein [mailto:jbernstein@penguincomputing.com] Sent: Wednesday, May 07, 2008 8:41 AM To: Srikanth Gumma Cc: mvapich-discuss@cse.ohio-state.edu Subject: Re: [mvapich-discuss] Execution problem Hi Srikanth, On May 6, 2008, at 7:49 PM, Srikanth Gumma wrote: > libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. > This will severely limit memory registrations. > libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. This tells me that perhaps you, as a user aren't able to lock as much memory as required to startup the job. Can you give it a shot as root? In BASH you, as root, can adjust your ulimit to unlimited to see if the problem goes away: # ulimit -l unlimited If this works, then you need to adjust /etc/security/limits.conf and relogin to enable the change. -Joshua Bernstein Software Engineer Penguin Computing From Craig.Tierney at noaa.gov Wed May 7 11:09:04 2008 From: Craig.Tierney at noaa.gov (Craig Tierney) Date: Wed May 7 11:09:18 2008 Subject: [mvapich-discuss] Execution problem In-Reply-To: <005601c8b003$f25a8c30$d70fa490$%gumma@locuz.com> References: <005101c8afec$f769d530$e63d7f90$%gumma@locuz.com> <005601c8b003$f25a8c30$d70fa490$%gumma@locuz.com> Message-ID: <4821C610.3080503@noaa.gov> Srikanth Gumma wrote: > Hi Joshua, > > I tried with ulimit -l unlimited, But it didn't work > > Please let me know any other options > Where did you put the ulimit command? If you put it right before the mpirun command, that won't help. It needs to be in your environment on the remote nodes. You should put it in your .cshrc/.bashrc. Are you using a batch system (like SGE)? Craig > Regards > Srikanth > > -----Original Message----- > From: Joshua Bernstein [mailto:jbernstein@penguincomputing.com] > Sent: Wednesday, May 07, 2008 8:41 AM > To: Srikanth Gumma > Cc: mvapich-discuss@cse.ohio-state.edu > Subject: Re: [mvapich-discuss] Execution problem > > Hi Srikanth, > > On May 6, 2008, at 7:49 PM, Srikanth Gumma wrote: > >> libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. >> This will severely limit memory registrations. >> libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. > > This tells me that perhaps you, as a user aren't able to lock as much > memory as required to startup the job. Can you give it a shot as root? > > In BASH you, as root, can adjust your ulimit to unlimited to see if > the problem goes away: > > # ulimit -l unlimited > > If this works, then you need to adjust /etc/security/limits.conf and > relogin to enable the change. > > -Joshua Bernstein > Software Engineer > Penguin Computing > > _______________________________________________ > mvapich-discuss mailing list > mvapich-discuss@cse.ohio-state.edu > http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss > -- Craig Tierney (craig.tierney@noaa.gov) From koop at cse.ohio-state.edu Wed May 7 11:48:31 2008 From: koop at cse.ohio-state.edu (Matthew Koop) Date: Wed May 7 11:48:42 2008 Subject: [mvapich-discuss] IBV_EVENT_QP_LAST_WQE_REACHED error In-Reply-To: <20080507001459.A899B2A0065@barracuda2.cse.ohio-state.edu> Message-ID: Bill, The error described in the link you gave was the result of some 'fork's or system calls in the code (that did a fork). Does your code contain any system calls or forks? If so, please look at section 7.1.2 of the user guide: https://mvapich.cse.ohio-state.edu/support/mvapich_user_guide.html Also, you may want to consider upgrading to OFED 1.3 and MVAPICH 1.0, which has additional scalability and stability enhancements. Let us know how things go. Thanks, Matt On Tue, 6 May 2008, Bill Riner wrote: > We upgraded from IBGold to OFED 1.2.5.5 and we also get the "Got FATAL event > IBV_EVENT_QP_LAST_WQE_REACHED" error that's discussed in this thread: > > > > http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/2007-October/001139 > .html > > > > [0:compute-0-23.local] Abort: [0] Got FATAL event > IBV_EVENT_QP_LAST_WQE_REACHED, code=16 > > at line 2555 in file viacheck.c > > > > The particular code worked fine before the upgrade. The error doesn't occur > when using just one processor. MPICH works fine on any number of > processors. The OSU and Intel MPI benchmarks work fine. Other MPI codes > work fine also. We're using MVAPICH 0.9.9 that came with OFED. > > > > Has this been resolved? > > > > > > From rcbord at wm.edu Wed May 7 12:47:51 2008 From: rcbord at wm.edu (rcbord@wm.edu) Date: Wed May 7 13:33:40 2008 Subject: [mvapich-discuss] MPI_Cart_Create Message-ID: Hi, I am having an issue with the MVAPICH-0.9.9 compiled with PGI-7.0 with ofed 1.2 for infinaband. We have be able to use it for 6 months without any problem. I tried to port a users fortran code that runs under solaris-sparc without any problems. The code is fairly vanilla fotran-90 with mpi I know because I wrote it. When I tried to port it to the Linux Cluster it hangs a mpisendrecv function. I included a simple test code that shows that the new communicator (comm2d) returned by the MPI_Cart_create function has multiple values. Same code run on the sun sparc cluster returns a single value. I am guessing it could be how I compiled MVAPICH, but have tried a few more flags without any success. I tried this with MVAPICH2 also and got the same error, but I compiled it in a similar fashion. Could it be a PGI problem? Has anyone else seen this? Thanks for any help! Program mpicart ! With input files ! Conversion of efit2d.f90 to 3d JPB 11-2007 Implicit none include "mpif.h" Interface Subroutine read_model(Pdim0,Pdim1) Integer, Intent(out) ::Pdim0,Pdim1 end Subroutine read_model end Interface Double Precision :: t1,t2 ! ! define MPI variables ! Integer :: Pid, N_proc, ierr Integer :: comm2d = 0 Integer :: status Integer :: period(2),Pdim_size(2),coords(2) Integer :: nbrleft,nbrright,nbrtop,nbrbottom Integer :: Pdim0, Pdim1 Integer :: i, t, numt call MPI_INIT(ierr) call MPI_COMM_RANK(MPI_COMM_WORLD,Pid,ierr) call MPI_COMM_SIZE(MPI_COMM_WORLD,N_proc,ierr) if (Pid .EQ. 0) then call read_model(Pdim0,Pdim1) end if ! ! Broad cast input parameters values to all processors ! call MPI_Bcast(Pdim0,1,MPI_INTEGER,0, & & MPI_COMM_WORLD,ierr) call MPI_Bcast(Pdim1,1,MPI_INTEGER,0, & & MPI_COMM_WORLD,ierr) call MPI_BARRIER(MPI_COMM_WORLD,ierr) Pdim_size(1) = Pdim0 Pdim_size(2) = Pdim1 period(1) = 0 period(2) = 0 call MPI_Dims_create(N_proc,2,Pdim_size,ierr) call MPI_Cart_create(MPI_COMM_WORLD,2,Pdim_size,period,.true.,comm2d,ierr) do i = 0,N_proc-1 if (Pid == i) then write(*,*) 'pid ',Pid,' mpi_comm_2d ',comm2d end if end do call MPI_BARRIER(MPI_COMM_WORLD,ierr) call MPI_Comm_free(comm2d,ierr) call MPI_FINALIZE(ierr) end program mpicart ###################### OUTPUT ######################### Model parameters for mpicart test Processor Topology is ( 3 by 4 ) pid 0 mpi_comm_2d 140 pid 11 mpi_comm_2d 138 pid 2 mpi_comm_2d 140 pid 4 mpi_comm_2d 140 pid 6 mpi_comm_2d 140 pid 8 mpi_comm_2d 140 pid 3 mpi_comm_2d 138 pid 10 mpi_comm_2d 140 pid 1 mpi_comm_2d 138 pid 5 mpi_comm_2d 138 pid 7 mpi_comm_2d 138 pid 9 mpi_comm_2d 138 Chris Bording Application Analyst High Performance Computing Group Information Technology The College of William and Mary (757)-221-3488 rcbord@wm.edu From Frank.Leers at Sun.COM Wed May 7 13:34:56 2008 From: Frank.Leers at Sun.COM (Frank Leers) Date: Wed May 7 13:35:40 2008 Subject: [mvapich-discuss] Sun Studio build mvapich1 Message-ID: Hi, I am attempting to build mvapich 1 with Studio12 and am not having much success. Could someone have a look and point out the err of my ways? A couple of things jump out at me - checking for cc... no checking whether the Fortran 77 compiler (/opt/apps/sun/sunstudio12/ bin/f77 -L/opt/ofed/lib64 ) works... no OFED 1.2.5-5 was built with gnu, is that a problem? I've modified the make_mvapich.gen2 as follows: 18,25c18,24 < STUDIOHOME=/opt/apps/sun/sunstudio12 < IBHOME=${IBHOME:-/opt/ofed} < IBHOME_LIB=${IBHOME_LIB:-/opt/ofed/lib64} < PREFIX=${PREFIX:-/tmp/mvapich-1.0-2008-02-28} < export CC=${CC:-$STUDIOHOME/bin/cc} < export CXX=${CXX:-$STUDIOHOME/bin/CC} < export F77=${F77:-$STUDIOHOME/bin/f77} < export F90=${F90:-$STUDIOHOME/bin/f90} --- > IBHOME=${IBHOME:-/usr/local/ofed} > IBHOME_LIB=${IBHOME_LIB:-/usr/local/ofed/lib64} > PREFIX=${PREFIX:-/usr/local/mvapich} > export CC=${CC:-gcc} > export CXX=${CXX:-g++} > export F77=${F77:-g77} > export F90=${F90:-} thanks, -frank [mvapich-1.0-2008-02-28]# ./make.mvapich.gen2.studio12 Configuring MVAPICH... Configuring with args --with-device=ch_gen2 --with-arch=LINUX -prefix=/ tmp/mvapich-1.0-2008-02-28 --with-romio --without-mpe -lib=-L/opt/ofed/ lib64 -Wl,-rpath=/opt/ofed/lib64 -libverbs -libumad -lpthread Configuring MPICH Version 1.2.7 (release) of : 2005/06/22 16:33:49 Make will not build MPE routines checking whether filesystem respects case in file names... yes checking for current directory name... /tmp/mvapich1/ mvapich-1.0-2008-02-28 checking for install checking for ranlib checking for gnumake... yes using --no-print-directory checking whether make supports include... yes checking for OSF V3 make... no checking for virtual path format... VPATH checking whether /opt/apps/sun/sunstudio12/bin/CC returns correct error code... yes checking whether selected C++ compiler can compile iostream.h... yes Include C++ bindings for MPI from http://www.osl.iu.edu/research/mpi2c++ Send bug reports about the C++ to mpi2cpp-devel@osl.iu.edu checking for cc... no checking whether the compiler /opt/apps/sun/sunstudio12/bin/cc accepts ANSI prototypes... yes checking for /opt/apps/sun/sunstudio12/bin/f77... found /opt/apps/sun/ sunstudio12/bin/f77 (1) checking for ar... found /usr/bin/ar (ar) checking for whether compiler works... yes checking whether the compiler /opt/apps/sun/sunstudio12/bin/cc accepts ## for concatenation in cpp... yes checking whether the compiler /opt/apps/sun/sunstudio12/bin/cc accepts const modifier... yes checking for extension on executables... none checking how to run the C preprocessor checking for AIX checking for minix/config.h checking for volatile... yes Running device-specific setup program setup_ch_gen2 starts... -D_X86_64_ -D_AMD_QUAD_CORE_ - DEARLY_SEND_COMPLETION -DMEMORY_SCALE -DVIADEV_RPUT_SUPPORT -D_SMP_ - D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/opt/ofed/include -O3 About to do ch_gen2 device Configuring ch_gen2 subsystem... No addition setup since mpd is not enabled Use ${exec_prefix}/bin to set up variables MPIBOOT and MPIUNBOOT checking whether cross-compiling... no checking for gethrtime... no checking for clock_gettime... no checking for clock_getres... no checking for how many arguments gettimeofday takes... two - whew checking for signal.h... yes checking for sigaction... yes checking for for struct sigaction... yes checking for weak symbol support... pragma weak checking whether weak symbols are visible to other files... yes checking for remsh... no checking for rsh... found /usr/kerberos/bin/rsh (rsh) checking for perl5... no checking for perl... found /usr/bin/perl (perl) checking for byte ordering... little endian checking for uname... yes checking for netdb.h... yes checking for gethostbyname... yes checking whether C++ compiler also has gethostbyname... yes checking whether Fortran programs can link with needed C functions... yes checking whether C++ programs can link with needed C functions... yes checking for catopen... yes checking for catclose... yes checking for catgets... yes checking for gencat... found /usr/bin/gencat (1) checking for nl_types.h... yes checking for ANSI C header files checking for stdlib.h... yes checking for string.h... yes checking for unistd.h... yes checking for stdarg.h... yes checking whether stdarg is oldstyle... hmm, warnings from compiler. Trying newstyle checking whether stdarg is correct... yes checking whether programs using stdarg link... yes checking for malloc return type... void checking for system... yes checking for nice... yes checking for strdup... yes checking for memory.h... yes checking for sys/ioctl.h... yes checking for sys/sockio.h... no checking whether the compiler /opt/apps/sun/sunstudio12/bin/cc runs... yes checking whether the compiler /opt/apps/sun/sunstudio12/bin/f77 runs... yes checking for correct handling of conditionals...... yes checking for correct handling of conditionals part 2 ...... yes checking for correct handling of #elif... yes checking that constant folding in arrays works... yes checking that structs are handled properly... yes checking that compiler truncates unsigned char correctly ...... yes checking that compiler/hardware has commutative arithmetic ...... yes checking that compiler assigns to char correctly ...... yes checking that compiler does not call unknown routines for long doubles... yes checking that compiler accepts args correctly ...... yes checking whether ranlib works... yes checking for broken handling of common symbols... no checking for ar... found /usr/bin/ar (1) checking for size of void *... 8 checking for pointers greater than 32 bits... yes checking for size of int... 4 checking for int large enough for pointers... no checking for C integer type for MPI_Aint... checking for size of long... 8 C integer type for MPI_Aint is... long checking for long long... yes checking whether compiler can handle loops with long long... yes checking for long double... yes checking for size of double... 8 checking for size of long double... 16 checking for structure alignment... largest checking for sync... found /bin/sync (1) checking whether mpich can be used as the library name... yes Configuring Fortran subsystem Configure in /tmp/mvapich1/mvapich-1.0-2008-02-28/src/fortran creating cache ./config.cache checking for cc... /opt/apps/sun/sunstudio12/bin/cc checking whether the C compiler (/opt/apps/sun/sunstudio12/bin/cc - D_X86_64_ -D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H ) works... yes checking whether the C compiler (/opt/apps/sun/sunstudio12/bin/cc - D_X86_64_ -D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H ) is a cross-compiler... no checking whether the C compiler sets its return status correctly... yes checking whether we are using GNU C... no checking for working const... yes checking whether the Fortran 77 compiler (/opt/apps/sun/sunstudio12/ bin/f77 -L/opt/ofed/lib64 ) works... no configure: error: installation or configuration problem: Fortran 77 compiler cannot create executables. Error configuring the Fortran subsystem! Turning off Fortran support Configuring ROMIO, for support of MPI-IO checking whether compiler allows define a(b) a(b,__LINE__)... yes Configuring with args --with-mpi=mpich --cache-file=/dev/null checking for architecture... LINUX ROMIO home directory is /tmp/mvapich1/mvapich-1.0-2008-02-28/romio checking for ranlib... ranlib checking for gcc... /opt/apps/sun/sunstudio12/bin/cc checking for C compiler default output file name... a.out checking whether the C compiler works... yes checking whether we are cross compiling... no checking for suffix of executables... checking for suffix of object files... o checking whether we are using the GNU C compiler... no checking whether /opt/apps/sun/sunstudio12/bin/cc accepts -g... yes checking for /opt/apps/sun/sunstudio12/bin/cc option to accept ANSI C... none needed checking whether we are using the GNU Fortran 77 compiler... no checking whether /opt/apps/sun/sunstudio12/bin/f77 accepts -g... yes checking how to run the C preprocessor... /opt/apps/sun/sunstudio12/ bin/cc -E checking for memalign... yes checking Fortran external names Fortran externals have a trailing underscore and are lowercase checking for inline... inline checking how to run the C preprocessor... /opt/apps/sun/sunstudio12/ bin/cc -E checking for egrep... grep -E checking for ANSI C header files... yes checking for sys/types.h... yes checking for sys/stat.h... yes checking for stdlib.h... yes checking for string.h... yes checking for memory.h... yes checking for strings.h... yes checking for inttypes.h... yes checking for stdint.h... yes checking for unistd.h... yes checking for unistd.h... (cached) yes checking fcntl.h usability... yes checking fcntl.h presence... yes checking for fcntl.h... yes checking malloc.h usability... yes checking malloc.h presence... yes checking for malloc.h... yes checking stddef.h usability... yes checking stddef.h presence... yes checking for stddef.h... yes checking for int... yes checking size of int... 4 checking for void*... yes checking size of void*... 8 checking for int large enough for pointers... no checking for long long... yes checking size of long long... 8 checking for extension for Fortran 90 programs... f90 checking for Fortran 90 KIND parameter for 8-byte integers... 8 checking for weak symbol support... pragma weak checking that weak symbols are visible to other files... yes checking whether struct flock compatible with MPI_Offset... yes checking configured file systems... testfs ufs nfs configure: WARNING: File locks may not work with NFS. See the Installation and users manual for instructions on testing and if necessary fixing this checking for library containing pthread_create... -lpthread checking for library containing aio_write... -lrt checking signal.h usability... yes checking signal.h presence... yes checking for signal.h... yes checking if aio.h exists and can be compiled... yes checking if sys/aio.h exists and can be compiled... no checking whether aio routines can be used... yes checking for obsolete two-argument aio_write... no checking for obsolete two-argument aio_suspend... no checking for aio_fildes member of aiocb structure... yes checking for aio_whence member of aiocb structure... no checking for aio_handle member of aiocb structure... no checking for aio_reqprio member of aiocb structure... yes checking for aio_sigevent member of aiocb structure... yes checking sys/vfs.h usability... yes checking sys/vfs.h presence... yes checking for sys/vfs.h... yes checking sys/param.h usability... yes checking sys/param.h presence... yes checking for sys/param.h... yes checking sys/mount.h usability... yes checking sys/mount.h presence... yes checking for sys/mount.h... yes checking sys/statvfs.h usability... yes checking sys/statvfs.h presence... yes checking for sys/statvfs.h... yes checking whether struct statfs properly defined... yes checking for f_fstypename member of statfs structure... no checking for sys/stat.h... (cached) yes checking for sys/types.h... (cached) yes checking for unistd.h... (cached) yes checking for stat... yes checking for st_fstype member of stat structure... no checking for sys/types.h... (cached) yes checking for sys/statvfs.h... (cached) yes checking for sys/vfs.h... (cached) yes checking for statvfs... yes checking for f_basetype member of statvfs structure... no checking for unistd.h... (cached) yes checking for large file defines... yes checking whether off64_t is an scalar type... yes checking for strerror... yes checking for doctext... no checking for strdup... no checking for lstat... no checking for readlink... no checking for fsync... no checking for ftruncate... no setting CC to /tmp/mvapich1/mvapich-1.0-2008-02-28/bin/mpicc setting F77 to /opt/apps/sun/sunstudio12/bin/f77 setting TEST_CC to /tmp/mvapich1/mvapich-1.0-2008-02-28/bin/mpicc setting TEST_F77 to /tmp/mvapich1/mvapich-1.0-2008-02-28/bin/mpif77 setting CFLAGS to -D_X86_64_ -D_AMD_QUAD_CORE_ - DEARLY_SEND_COMPLETION -DMEMORY_SCALE -DVIADEV_RPUT_SUPPORT -D_SMP_ - D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/opt/ofed/include -O3 - DHAVE_MPICHCONF_H -D_X86_64_ -D_AMD_QUAD_CORE_ - DEARLY_SEND_COMPLETION -DMEMORY_SCALE -DVIADEV_RPUT_SUPPORT -D_SMP_ - D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/opt/ofed/include -O3 - DHAVE_MPICHCONF_H -DFORTRANUNDERSCORE -D_LARGEFILE64_SOURCE - D_FILE_OFFSET_BITS=64 -DHAVE_ROMIOCONF_H setting USER_CFLAGS to setting USER_FFLAGS to configure: creating ./config.status config.status: creating Makefile config.status: creating localdefs config.status: creating mpi-io/Makefile config.status: creating mpi2-other/info/Makefile config.status: creating mpi2-other/array/Makefile config.status: creating adio/common/Makefile config.status: creating test/Makefile config.status: creating test/misc.c config.status: creating test/large_file.c config.status: creating test/runtests config.status: creating util/romioinstall config.status: creating include/mpio.h config.status: creating include/mpiof.h config.status: creating adio/ad_nfs/Makefile config.status: creating adio/ad_ufs/Makefile config.status: creating adio/ad_panfs/Makefile config.status: creating adio/ad_xfs/Makefile config.status: creating adio/ad_sfs/Makefile config.status: creating adio/ad_pfs/Makefile config.status: creating adio/ad_testfs/Makefile config.status: creating adio/ad_pvfs/Makefile config.status: creating adio/ad_pvfs2/Makefile config.status: creating adio/ad_gridftp/Makefile config.status: creating adio/ad_lustre/Makefile config.status: creating mpi-io/fortran/Makefile config.status: creating mpi2-other/info/fortran/Makefile config.status: creating mpi2-other/array/fortran/Makefile config.status: creating test/fmisc.f config.status: creating test/fcoll_test.f config.status: creating test/pfcoll_test.f config.status: creating test/fperf.f config.status: creating mpi-io/glue/mpich2/Makefile config.status: creating mpi-io/glue/mpich1/Makefile config.status: creating mpi-io/glue/default/Makefile config.status: creating adio/include/romioconf.h config.status: executing default-1 commands Finished configuring ROMIO checking whether head command is broken... no creating config.status creating Makefile creating util/Makefile creating examples/Makefile creating src/pt2pt/Makefile creating src/coll/Makefile creating src/context/Makefile creating src/dmpi/Makefile creating src/env/Makefile creating src/topol/Makefile creating src/profile/Makefile creating src/coll2/Makefile creating src/util/Makefile creating src/infoexport/Makefile creating examples/basic/Makefile creating src/misc2/Makefile creating src/external/Makefile creating mpichconf.h creating util/mpicc creating util/mpicxx creating util/mpiinstall creating util/mpirun creating util/mpichlib.conf creating util/mpiman creating util/chkserv creating util/chkmachine creating util/tstmachines creating include/mpidefs.h creating include/mpif.f90 Configuring the test suite... Configuring with args -basecc=/opt/apps/sun/sunstudio12/bin/cc -cc=/ tmp/mvapich1/mvapich-1.0-2008-02-28/bin/mpicc -make=make --no-print- directory -device=ch_gen2 -mpichpath=/tmp/mvapich1/ mvapich-1.0-2008-02-28/bin --enable-boot -cflags=-D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -nof77 --enable-io Don't build the tests that need Fortran checking whether cross-compiling... no checking whether the compiler /opt/apps/sun/sunstudio12/bin/cc runs... yes checking for gnumake... no checking whether make supports include... yes checking for OSF V3 make... no checking for virtual path format... VPATH checking for stdlib.h... yes checking for unistd.h... yes checking for string.h... yes checking for stdarg is correct... yes checking for long double... yes checking for long long... yes checking whether compiler can handle loops with long long... yes checking whether the compiler /opt/apps/sun/sunstudio12/bin/cc accepts ANSI prototypes... yes checking for signal.h... yes checking for sigaction... yes checking for sleep... yes checking for sysconf... yes creating config.status creating Makefile creating pt2pt/Makefile creating coll/Makefile creating topol/Makefile creating context/Makefile creating env/Makefile creating profile/Makefile creating io/Mfile creating pt2pt/runtests creating coll/runtests creating topol/runtests creating context/runtests creating command/runtests creating env/runtests creating profile/runtests creating io/rtest creating io/misc.c creating io/fmisc.f creating io/fcoll_test.f creating io/pfcoll_test.f creating io/large_file.c creating io/fperf.f Configuring the performance tests ... Configure in /tmp/mvapich1/mvapich-1.0-2008-02-28/examples/perftest creating cache ./config.cache checking for a BSD compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking whether make --no-print-directory sets ${MAKE}... yes checking for working aclocal... found checking for working autoconf... found checking for working automake... found checking for working autoheader... found checking for working makeinfo... found checking whether clock skew breaks make... no checking whether make supports include... yes checking whether make allows comments in actions... yes checking for virtual path format... VPATH checking whether make sets CFLAGS... yes checking for cit... no checking for gnuplot... gnuplot checking how to run the C preprocessor... /opt/apps/sun/sunstudio12/ bin/cc -E checking whether C compiler accepts option -O4 -Ofast... no checking whether C compiler accepts option -Ofast... no checking whether C compiler accepts option -fast... yes checking whether routines compiled with -fast can be linked with ones compiled without -fast... yes checking for library containing fabs... -lm checking for ANSI C header files... yes checking for sys/time.h... yes checking for stdlib.h... yes checking for string.h... yes checking whether time.h and sys/time.h may both be included... yes checking whether struct tm is in sys/time.h or time.h... time.h checking for working const... yes checking for restrict... restrict checking for long long... yes updating cache ./config.cache creating ./config.status creating Makefile creating mpptestconf.h creating mpid/ch_gen2/Makefile creating mpid/tests/Makefile creating mpichconf.h mpichconf.h is unchanged *# ---> *# You should register your copy of MPICH with us by sending mail *# to majordomo@mcs.anl.gov containing the message *# subscribe mpi-users *# This will allow us to notify you of new releases of MPICH. *# *# You can also check the MPICH home page at *# http://www.mcs.anl.gov/mpi/mpich *# ---< Configuration completed. Building MVAPICH... cleaning directory mpi-io cleaning directory adio/common cleaning directory mpi-io/glue/mpich1 cleaning directory adio/ad_testfs cleaning directory adio/ad_ufs cleaning directory adio/ad_nfs cleaning directory mpi-io/fortran cleaning directory test rm -f .P* PI* *.o rm -f simple perf async coll_test coll_perf misc file_info excl large_array atomicity noncontig i_noncontig noncontig_coll split_coll shared_fp large_file psimple error status noncontig_coll2 fcoll_test fperf fmisc pfcoll_test cleaning src/pt2pt rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/pt2pt/*.o cleaning src/env rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/env/*.o cleaning src/dmpi rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/dmpi/*.o cleaning src/util rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/util/*.o cleaning src/context rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/context/*.o cleaning src/coll rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/coll/*.o cleaning src/topol rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/topol/*.o cleaning src/profile rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/profile/*.o cleaning src/misc2 rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/misc2/*.o cleaning src/external rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/external/*.o cleaning mpid/ch_gen2 /bin/rm -f *.o *.d *~ viainit.o viasend.o viarecv.o viacheck.o viapriv.o viaparam.o viutil.o vbuf.o cm_user.o mpid_init.o mpid_send.o mpid_recv.o cm.o mpid_hsend.o mpid_hrecv.o mpid_pack.o cmnargs.o mpid_misc.o dreg.o mpid_smpi.o collutils.o intra_rdma_barrier.o mpid_mcast.o mcst_grp.o ibmcgrp.o crc32h.o avl.o mem_hooks.o viacoalesce.o shmem_coll.o async_progress.o \ queue.o sbcnst2.o tr2.o queue.c sbcnst2.c tr2.c sbcnst2.h tr2.h core ibmcgrp/*.o ibmcgrp/ibmcgrp \ /tmp/mvapich1/mvapich-1.0-2008-02-28/bin/ibmcgrp make --no-print-directory -C process clean rm -f *.o mpirun_rsh mpispawn minidaemon_client pmgr_collective_client.o pmgr_collective_common.o minidaemon.o mpirun_util.o cleaning examples rm -f sendchar *.o Making clean in directory test Making clean in directory pt2pt Making clean in directory coll Making clean in directory topol Making clean in directory env Making clean in directory context Making clean in directory profile Making clean in directory io Making clean in directory perftest test -z "mpptest goptest buflimit " || rm -f mpptest goptest buflimit rm -f *.o core *.core rm -f tunepkt pktuse copytest vectest stress ctest cluster tcomm rm -f work.pc work.pcl cleaning examples/basic rm -f work.pc work.pcl rm -f *.o *~ PI* cpi systest srtest fpi cpilog cpi_autolog hello++ iotest pi3f90 upshot rdb.* startup.* core rm -f hello++.ti hello++.ii cleaning examples/test/pt2pt cleaning examples/test/coll cleaning examples/test/topol cleaning examples/test/context cleaning examples/test/env cleaning examples/test/profile cleaning examples/test Making clean in directory pt2pt Making clean in directory coll Making clean in directory topol Making clean in directory env Making clean in directory context Making clean in directory profile Making clean in directory io cleaning examples/perftest test -z "mpptest goptest buflimit " || rm -f mpptest goptest buflimit rm -f *.o core *.core rm -f tunepkt pktuse copytest vectest stress ctest cluster tcomm rm -f work.pc work.pcl cleaning src/infoexport rm -f *.o rm -f *.i rm -f *.s rm -f *.cxx.log rm -f *.cxx.errors rm -f libtvmpich.so.1.0 rm -f libtvmpich.so* rm -f /tmp/mvapich1/mvapich-1.0-2008-02-28/src/infoexport/*.o rm -f *~ *.o aditest1 aditest2 aditest3 aditest4 aditest5 aditest6 aditest7 aditest8 aditest9 aditest10 aditest11 aditest12 aditest13 timers trunc rm -f /tmp/mvapich1/mvapich-1.0-2008-02-28/lib/lib*.a rm -f /tmp/mvapich1/mvapich-1.0-2008-02-28/lib/shared/lib*.so* make --no-print-directory mpi-modules make --no-print-directory mpilib for file in queue.c sbcnst2.c tr2.c sbcnst2.h tr2.h ; do \ if [ ! -s $file ] ; then \ ln -s ../util/$file; \ fi; \ done making mpir in directory mpid/ch_gen2 for file in queue.c sbcnst2.c tr2.c sbcnst2.h tr2.h ; do \ if [ ! -s $file ] ; then \ ln -s ../util/$file; \ fi; \ done /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c viainit.c "ib_init.h", line 12: warning: initializer does not fit or is out of range: -1 "ib_init.h", line 34: warning: improper pointer/integer combination: op "<" "viainit.c", line 149: warning: argument #3 is incompatible with prototype: prototype: pointer to const struct {array[16] of unsigned long __bits} : "/usr/include/sched.h", line 76 argument : pointer to unsigned long "viainit.c", line 162: warning: argument #3 is incompatible with prototype: prototype: pointer to const struct {array[16] of unsigned long __bits} : "/usr/include/sched.h", line 76 argument : pointer to unsigned long "viainit.c", line 556: warning: argument #3 is incompatible with prototype: prototype: pointer to function(pointer to void) returning pointer to void : "/usr/include/pthread.h", line 163 argument : pointer to void "viainit.c", line 792: warning: implicit function declaration: init_apm_lock "viainit.c", line 990: warning: argument mismatch "viainit.c", line 1158: warning: implicit function declaration: reload_alternate_path "viainit.c", line 1221: warning: argument #3 is incompatible with prototype: prototype: pointer to function(pointer to void) returning pointer to void : "/usr/include/pthread.h", line 163 argument : pointer to void "viainit.c", line 1345: warning: argument mismatch /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c viasend.c "viasend.c", line 145: warning: implicit function declaration: viadev_post_send_async_qp "viasend.c", line 401: warning: argument mismatch "viasend.c", line 703: warning: argument mismatch /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c viarecv.c "viarecv.c", line 263: warning: argument mismatch /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c viacheck.c "viacheck.c", line 571: warning: argument mismatch "viacheck.c", line 1824: warning: argument mismatch "viacheck.c", line 1846: warning: argument mismatch "viacheck.c", line 1861: warning: argument mismatch "viacheck.c", line 2260: warning: implicit function declaration: perform_manual_apm "viacheck.c", line 2856: warning: implicit function declaration: reload_alternate_path /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c viapriv.c "viapriv.c", line 649: warning: implicit function declaration: perform_manual_apm /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c viaparam.c "/opt/ofed/include/infiniband/common.h", line 60: warning: implicit function declaration: bswap_64 "/opt/ofed/include/infiniband/umad.h", line 72: warning: zero or negative subscript /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c viutil.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c vbuf.c "vbuf.c", line 125: warning: argument mismatch "vbuf.c", line 283: warning: argument mismatch "vbuf.c", line 442: warning: argument mismatch "vbuf.c", line 488: warning: argument mismatch "vbuf.c", line 491: warning: argument mismatch "vbuf.c", line 492: warning: argument mismatch /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c cm_user.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c mpid_init.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c mpid_send.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c mpid_recv.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c cm.c "ib_init.h", line 12: warning: initializer does not fit or is out of range: -1 "ib_init.h", line 34: warning: improper pointer/integer combination: op "<" "cm.c", line 176: warning: pointer to void or function used in arithmetic "cm.c", line 265: warning: implicit function declaration: reload_alternate_path "cm.c", line 677: warning: statement not reached "cm.c", line 735: warning: pointer to void or function used in arithmetic "cm.c", line 735: warning: pointer to void or function used in arithmetic "cm.c", line 744: warning: pointer to void or function used in arithmetic "cm.c", line 757: warning: statement not reached "cm.c", line 830: warning: pointer to void or function used in arithmetic "cm.c", line 830: warning: pointer to void or function used in arithmetic "cm.c", line 925: warning: pointer to void or function used in arithmetic "cm.c", line 1006: warning: pointer to void or function used in arithmetic /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c mpid_hsend.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c mpid_hrecv.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c mpid_pack.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c cmnargs.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c mpid_misc.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c dreg.c "dreg.c", line 132: warning: initializer does not fit or is out of range: -1 "dreg.c", line 780: warning: argument mismatch /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c mpid_smpi.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c collutils.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c intra_rdma_barrier.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c mpid_mcast.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c mcst_grp.c "mcst_grp.c", line 338: warning: empty translation unit /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c ibmcgrp.c "ibmcgrp.c", line 480: warning: empty translation unit /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c crc32h.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c avl.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c mem_hooks.c "mem_hooks.c", line 34: warning: assignment type mismatch: pointer to function(pointer to void, unsigned long) returning int "=" pointer to void /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c viacoalesce.c "viacoalesce.c", line 70: warning: argument mismatch "viacoalesce.c", line 97: warning: argument mismatch "viacoalesce.c", line 167: warning: argument mismatch "viacoalesce.c", line 231: warning: argument mismatch "viacoalesce.c", line 235: warning: argument mismatch /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c shmem_coll.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c async_progress.c "ib_init.h", line 12: warning: initializer does not fit or is out of range: -1 "ib_init.h", line 34: warning: improper pointer/integer combination: op "<" "async_progress.c", line 102: warning: function expects to return value: atomic_send_or_queue "async_progress.c", line 112: warning: implicit function declaration: perform_manual_apm "async_progress.c", line 686: warning: argument #3 is incompatible with prototype: prototype: pointer to function(pointer to void) returning pointer to void : "/usr/include/pthread.h", line 163 argument : pointer to void "async_progress.c", line 841: warning: implicit function declaration: reload_alternate_path /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c queue.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c sbcnst2.c /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/mvapich1/ mvapich-1.0-2008-02-28/include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/ include -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I/tmp/ mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE - DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 - DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ - D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE - DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/ opt/ofed/include -O3 -DHAVE_MPICHCONF_H -I/tmp/mvapich1/ mvapich-1.0-2008-02-28 -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ ch_gen2 -I. -c tr2.c ar crl /tmp/mvapich1/mvapich-1.0-2008-02-28/lib/libmpich.a viainit.o viasend.o viarecv.o viacheck.o viapriv.o viaparam.o viutil.o vbuf.o cm_user.o mpid_init.o mpid_send.o mpid_recv.o cm.o mpid_hsend.o mpid_hrecv.o mpid_pack.o cmnargs.o mpid_misc.o dreg.o mpid_smpi.o collutils.o intra_rdma_barrier.o mpid_mcast.o mcst_grp.o ibmcgrp.o crc32h.o avl.o mem_hooks.o viacoalesce.o shmem_coll.o async_progress.o queue.o sbcnst2.o tr2.o cd process && make --no-print-directory &&\ install -m 755 mpirun_rsh mpispawn minidaemon_client /tmp/mvapich1/ mvapich-1.0-2008-02-28/bin /opt/apps/sun/sunstudio12/bin/cc -DLD_LIBRARY_PATH_MPI=\"/tmp/ mvapich-1.0-2008-02-28/lib/shared\" -DMPI_PREFIX=\"/tmp/ mvapich-1.0-2008-02-28/\" -DPARAM_GLOBAL=\"/tmp/mvapich-1.0-2008-02-28/ etc/mvapich.conf\" -DVAPI -D_SMP_ -DUSE_SSH -c -o pmgr_collective_common.o pmgr_collective_common.c /opt/apps/sun/sunstudio12/bin/cc -DLD_LIBRARY_PATH_MPI=\"/tmp/ mvapich-1.0-2008-02-28/lib/shared\" -DMPI_PREFIX=\"/tmp/ mvapich-1.0-2008-02-28/\" -DPARAM_GLOBAL=\"/tmp/mvapich-1.0-2008-02-28/ etc/mvapich.conf\" -DVAPI -D_SMP_ -DUSE_SSH -c -o pmgr_collective_mpirun.o pmgr_collective_mpirun.c "pmgr_collective_mpirun.c", line 75: warning: pointer to void or function used in arithmetic "pmgr_collective_mpirun.c", line 97: warning: pointer to void or function used in arithmetic "pmgr_collective_mpirun.c", line 98: warning: pointer to void or function used in arithmetic "pmgr_collective_mpirun.c", line 250: warning: pointer to void or function used in arithmetic "pmgr_collective_mpirun.c", line 263: warning: pointer to void or function used in arithmetic "pmgr_collective_mpirun.c", line 269: warning: pointer to void or function used in arithmetic /opt/apps/sun/sunstudio12/bin/cc -DLD_LIBRARY_PATH_MPI=\"/tmp/ mvapich-1.0-2008-02-28/lib/shared\" -DMPI_PREFIX=\"/tmp/ mvapich-1.0-2008-02-28/\" -DPARAM_GLOBAL=\"/tmp/mvapich-1.0-2008-02-28/ etc/mvapich.conf\" -DVAPI -D_SMP_ -DUSE_SSH -c -o minidaemon.o minidaemon.c "minidaemon.c", line 267: warning: argument mismatch "minidaemon.c", line 300: warning: argument mismatch "minidaemon.c", line 407: warning: argument mismatch "minidaemon.c", line 430: warning: argument mismatch "minidaemon.c", line 455: warning: argument mismatch "minidaemon.c", line 542: warning: argument mismatch "minidaemon.c", line 552: warning: argument mismatch "minidaemon.c", line 560: warning: argument mismatch "minidaemon.c", line 591: warning: pointer to void or function used in arithmetic "minidaemon.c", line 679: warning: argument mismatch "minidaemon.c", line 781: warning: enum type mismatch: op "=" "minidaemon.c", line 812: warning: argument mismatch "minidaemon.c", line 842: warning: enum type mismatch: op "=" "minidaemon.c", line 854: warning: enum type mismatch: op "=" "minidaemon.c", line 1072: warning: argument mismatch "minidaemon.c", line 1114: warning: argument mismatch "minidaemon.c", line 1130: warning: argument mismatch "minidaemon.c", line 1213: warning: argument mismatch "minidaemon.c", line 1214: warning: enum type mismatch: op "=" "minidaemon.c", line 1222: warning: argument mismatch "minidaemon.c", line 1244: warning: argument mismatch "minidaemon.c", line 1247: warning: argument mismatch "minidaemon.c", line 1278: warning: argument mismatch "minidaemon.c", line 1281: warning: argument mismatch "minidaemon.c", line 1288: warning: argument mismatch "minidaemon.c", line 1309: warning: argument mismatch "minidaemon.c", line 1369: warning: argument mismatch "minidaemon.c", line 1417: warning: argument mismatch "minidaemon.c", line 1443: warning: argument mismatch "minidaemon.c", line 1492: warning: argument mismatch "minidaemon.c", line 1533: warning: argument mismatch /opt/apps/sun/sunstudio12/bin/cc -DLD_LIBRARY_PATH_MPI=\"/tmp/ mvapich-1.0-2008-02-28/lib/shared\" -DMPI_PREFIX=\"/tmp/ mvapich-1.0-2008-02-28/\" -DPARAM_GLOBAL=\"/tmp/mvapich-1.0-2008-02-28/ etc/mvapich.conf\" -DVAPI -D_SMP_ -DUSE_SSH -c -o mpirun_util.o mpirun_util.c "mpirun_util.c", line 25: warning: implicit function declaration: vsnprintf "mpirun_util.c", line 33: warning: implicit function declaration: perror "mpirun_util.c", line 77: warning: implicit function declaration: strlen "mpirun_util.c", line 84: warning: implicit function declaration: strcat /opt/apps/sun/sunstudio12/bin/cc -DLD_LIBRARY_PATH_MPI=\"/tmp/ mvapich-1.0-2008-02-28/lib/shared\" -DMPI_PREFIX=\"/tmp/ mvapich-1.0-2008-02-28/\" -DPARAM_GLOBAL=\"/tmp/mvapich-1.0-2008-02-28/ etc/mvapich.conf\" -DVAPI -D_SMP_ -DUSE_SSH mpirun_rsh.c pmgr_collective_common.o pmgr_collective_mpirun.o minidaemon.o mpirun_util.o -lm -o mpirun_rsh "mpirun_rsh.c", line 579: warning: implicit function declaration: pmgr_processops mpirun_rsh.o(.text+0xf1b): In function `main': : undefined reference to `env2int' mpirun_rsh.o(.text+0x70cc): In function `mpispawn_checkin': : undefined reference to `env2int' make[4]: *** [mpirun_rsh] Error 1 make[3]: *** [mpirun_rsh] Error 2 Exit status from make was 2 make[2]: *** [mpilib] Error 1 make[1]: *** [mpi-modules] Error 2 make: *** [mpi] Error 2 Failure in building MVAPICH. Please file an error report to mvapich-discuss@cse.ohio-state.edu with all your log files. From mamidala at cse.ohio-state.edu Wed May 7 13:51:20 2008 From: mamidala at cse.ohio-state.edu (amith rajith mamidala) Date: Wed May 7 13:51:32 2008 Subject: [mvapich-discuss] MPI_Cart_Create In-Reply-To: Message-ID: Hi, Can you try these two options? 1. use MVAPICH-1.0 and see if you are seeing the issue. 2.Can you run the code by passing the environment variable: VIADEV_USE_SHMEM_COLL=0 with mvapich Thanks, Amith On Wed, 7 May 2008 rcbord@wm.edu wrote: > Hi, > I am having an issue with the MVAPICH-0.9.9 compiled with PGI-7.0 with > ofed 1.2 for infinaband. We have be able to use it for 6 months without > any problem. I tried to port a users fortran code that runs under > solaris-sparc without any problems. The code is fairly vanilla fotran-90 > with mpi I know because I wrote it. When I tried to port it to the Linux > Cluster it hangs a mpisendrecv function. I included a simple test code > that shows that the new communicator (comm2d) returned by the > MPI_Cart_create function has multiple values. Same code run on the > sun sparc cluster returns a single value. I am guessing it could be how > I compiled MVAPICH, but have tried a few more flags without any success. > I tried this with MVAPICH2 also and got the same error, but I compiled it > in a similar fashion. Could it be a PGI problem? > > > Has anyone else seen this? Thanks for any help! > > Program mpicart > ! With input files > ! Conversion of efit2d.f90 to 3d JPB 11-2007 > > Implicit none > > include "mpif.h" > > Interface > Subroutine read_model(Pdim0,Pdim1) > Integer, Intent(out) ::Pdim0,Pdim1 > end Subroutine read_model > end Interface > > Double Precision :: t1,t2 > ! > ! define MPI variables > ! > Integer :: Pid, N_proc, ierr > Integer :: comm2d = 0 > Integer :: status > Integer :: period(2),Pdim_size(2),coords(2) > Integer :: nbrleft,nbrright,nbrtop,nbrbottom > Integer :: Pdim0, Pdim1 > Integer :: i, t, numt > > call MPI_INIT(ierr) > call MPI_COMM_RANK(MPI_COMM_WORLD,Pid,ierr) > call MPI_COMM_SIZE(MPI_COMM_WORLD,N_proc,ierr) > > if (Pid .EQ. 0) then > call read_model(Pdim0,Pdim1) > > end if > ! > ! Broad cast input parameters values to all processors > ! > call MPI_Bcast(Pdim0,1,MPI_INTEGER,0, & > & MPI_COMM_WORLD,ierr) > call MPI_Bcast(Pdim1,1,MPI_INTEGER,0, & > & MPI_COMM_WORLD,ierr) > > call MPI_BARRIER(MPI_COMM_WORLD,ierr) > > Pdim_size(1) = Pdim0 > Pdim_size(2) = Pdim1 > > period(1) = 0 > period(2) = 0 > > call MPI_Dims_create(N_proc,2,Pdim_size,ierr) > > call MPI_Cart_create(MPI_COMM_WORLD,2,Pdim_size,period,.true.,comm2d,ierr) > do i = 0,N_proc-1 > if (Pid == i) then > write(*,*) 'pid ',Pid,' mpi_comm_2d ',comm2d > end if > end do > > call MPI_BARRIER(MPI_COMM_WORLD,ierr) > call MPI_Comm_free(comm2d,ierr) > call MPI_FINALIZE(ierr) > > end program mpicart > > ###################### OUTPUT ######################### > > Model parameters for mpicart test > > Processor Topology is ( 3 by 4 ) > > pid 0 mpi_comm_2d 140 > pid 11 mpi_comm_2d 138 > pid 2 mpi_comm_2d 140 > pid 4 mpi_comm_2d 140 > pid 6 mpi_comm_2d 140 > pid 8 mpi_comm_2d 140 > pid 3 mpi_comm_2d 138 > pid 10 mpi_comm_2d 140 > pid 1 mpi_comm_2d 138 > pid 5 mpi_comm_2d 138 > pid 7 mpi_comm_2d 138 > pid 9 mpi_comm_2d 138 > > > Chris Bording > Application Analyst > High Performance Computing Group > Information Technology > The College of William and Mary > (757)-221-3488 > rcbord@wm.edu > _______________________________________________ > mvapich-discuss mailing list > mvapich-discuss@cse.ohio-state.edu > http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss > From narravul at cse.ohio-state.edu Wed May 7 14:52:55 2008 From: narravul at cse.ohio-state.edu (Sundeep Narravula) Date: Wed May 7 14:53:05 2008 Subject: [mvapich-discuss] Using RDMA CM with MVAPICH2 In-Reply-To: <829ded920805062130s89f7e1eyaee3b4f6a5ab55ac@mail.gmail.com> Message-ID: Hi Mahesh, > Thanks Sundeep for replying. I've successfully tested RDMA CM support of > MVAPICH2 and it worked fine. Good to know that your installation went fine. > As far as I know, not many people are using the RDMA CM support of MVAPICH2. > So I want to ask you whether using RDMA CM support have any impact > on the performance of the MPI application AND How stable is the RDMA CM > support code of MVAPICH2 ? You should not see any performance changes while using RDMA CM. RDMA CM is used in connection setup only and does not impact the rest of the application execution. We have fully tested RDMA CM code at our end. This has been in our release for some time now and should be quite stable. Also, RDMA CM-based iWARP support provided by MVAPICH2 is being used/tested by others as well. Hope that helps. --Sundeep. > > -Mahesh > From rcbord at wm.edu Wed May 7 15:18:38 2008 From: rcbord at wm.edu (rcbord@wm.edu) Date: Wed May 7 15:18:52 2008 Subject: [mvapich-discuss] MPI_Cart_Create In-Reply-To: References: Message-ID: Hi Amith, I addedd the VIADEV_USE_SHMEM_COLL=0 to the mvapich environment module and that worked as far as the new communicators all have the same value but there is still something wrong. Tried the full code and still hanging at the same mpi_sendrecv. What does the VIADEV_USE_SHMEM_COLL do? Did a little digging so now MPI_sendrecv is changing the values of destination and source values. Tried mvapich-1.0 but am getting an error with mpiexec... mpiexec: Warning: ib.c: protocol version 8 not known, but might still work. mpiexec: Error: ib.c: mixed version executables (6 and 8), no hope. Chris On Wed, 7 May 2008, amith rajith mamidala wrote: > Hi, > > Can you try these two options? > > 1. use MVAPICH-1.0 and see if you are seeing the issue. > > 2.Can you run the code by passing the environment variable: > VIADEV_USE_SHMEM_COLL=0 with mvapich > > > Thanks, > Amith > > > On Wed, 7 May 2008 rcbord@wm.edu wrote: >>> Hi, >> I am having an issue with the MVAPICH-0.9.9 compiled with PGI-7.0 with >> ofed 1.2 for infinaband. We have be able to use it for 6 months without >> any problem. I tried to port a users fortran code that runs under >> solaris-sparc without any problems. The code is fairly vanilla fotran-90 >> with mpi I know because I wrote it. When I tried to port it to the Linux >> Cluster it hangs a mpisendrecv function. I included a simple test code >> that shows that the new communicator (comm2d) returned by the >> MPI_Cart_create function has multiple values. Same code run on the >> sun sparc cluster returns a single value. I am guessing it could be how >> I compiled MVAPICH, but have tried a few more flags without any success. >> I tried this with MVAPICH2 also and got the same error, but I compiled it >> in a similar fashion. Could it be a PGI problem? >> >> >> Has anyone else seen this? Thanks for any help! >> >> Program mpicart >> ! With input files >> ! Conversion of efit2d.f90 to 3d JPB 11-2007 >> >> Implicit none >> >> include "mpif.h" >> >> Interface >> Subroutine read_model(Pdim0,Pdim1) >> Integer, Intent(out) ::Pdim0,Pdim1 >> end Subroutine read_model >> end Interface >> >> Double Precision :: t1,t2 >> ! >> ! define MPI variables >> ! >> Integer :: Pid, N_proc, ierr >> Integer :: comm2d = 0 >> Integer :: status >> Integer :: period(2),Pdim_size(2),coords(2) >> Integer :: nbrleft,nbrright,nbrtop,nbrbottom >> Integer :: Pdim0, Pdim1 >> Integer :: i, t, numt >> >> call MPI_INIT(ierr) >> call MPI_COMM_RANK(MPI_COMM_WORLD,Pid,ierr) >> call MPI_COMM_SIZE(MPI_COMM_WORLD,N_proc,ierr) >> >> if (Pid .EQ. 0) then >> call read_model(Pdim0,Pdim1) >> >> end if >> ! >> ! Broad cast input parameters values to all processors >> ! >> call MPI_Bcast(Pdim0,1,MPI_INTEGER,0, & >> & MPI_COMM_WORLD,ierr) >> call MPI_Bcast(Pdim1,1,MPI_INTEGER,0, & >> & MPI_COMM_WORLD,ierr) >> >> call MPI_BARRIER(MPI_COMM_WORLD,ierr) >> >> Pdim_size(1) = Pdim0 >> Pdim_size(2) = Pdim1 >> >> period(1) = 0 >> period(2) = 0 >> >> call MPI_Dims_create(N_proc,2,Pdim_size,ierr) >> >> call MPI_Cart_create(MPI_COMM_WORLD,2,Pdim_size,period,.true.,comm2d,ierr) >> do i = 0,N_proc-1 >> if (Pid == i) then >> write(*,*) 'pid ',Pid,' mpi_comm_2d ',comm2d >> end if >> end do >> >> call MPI_BARRIER(MPI_COMM_WORLD,ierr) >> call MPI_Comm_free(comm2d,ierr) >> call MPI_FINALIZE(ierr) >> >> end program mpicart >> >> ###################### OUTPUT ######################### >> >> Model parameters for mpicart test >> >> Processor Topology is ( 3 by 4 ) >> >> pid 0 mpi_comm_2d 140 >> pid 11 mpi_comm_2d 138 >> pid 2 mpi_comm_2d 140 >> pid 4 mpi_comm_2d 140 >> pid 6 mpi_comm_2d 140 >> pid 8 mpi_comm_2d 140 >> pid 3 mpi_comm_2d 138 >> pid 10 mpi_comm_2d 140 >> pid 1 mpi_comm_2d 138 >> pid 5 mpi_comm_2d 138 >> pid 7 mpi_comm_2d 138 >> pid 9 mpi_comm_2d 138 >> >> >> Chris Bording >> Application Analyst >> High Performance Computing Group >> Information Technology >> The College of William and Mary >> (757)-221-3488 >> rcbord@wm.edu >> _______________________________________________ >> mvapich-discuss mailing list >> mvapich-discuss@cse.ohio-state.edu >> http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss >> > > > From Shuichi.Ihara at Sun.COM Thu May 8 00:24:31 2008 From: Shuichi.Ihara at Sun.COM (Shuichi Ihara) Date: Thu May 8 00:24:56 2008 Subject: [mvapich-discuss] Sun Studio build mvapich1 In-Reply-To: References: Message-ID: <4822807F.2010100@Sun.COM> Hi Frank, I have been successful to build mvapich-1.0 with SunStudio12 on the CentOS5.1 I did to pick up a mvapich spec file from the ofed-1.3 and same modifications for the SunStudio, then built it. Please see the attached diffs of specfile. Thanks, -Ihara Frank Leers wrote: > Hi, > > I am attempting to build mvapich 1 with Studio12 and am not having much > success. Could someone have a look and point out the err of my ways? > > A couple of things jump out at me - > > checking for cc... no > checking whether the Fortran 77 compiler > (/opt/apps/sun/sunstudio12/bin/f77 -L/opt/ofed/lib64 ) works... no > > OFED 1.2.5-5 was built with gnu, is that a problem? > > I've modified the make_mvapich.gen2 as follows: > > 18,25c18,24 > < STUDIOHOME=/opt/apps/sun/sunstudio12 > < IBHOME=${IBHOME:-/opt/ofed} > < IBHOME_LIB=${IBHOME_LIB:-/opt/ofed/lib64} > < PREFIX=${PREFIX:-/tmp/mvapich-1.0-2008-02-28} > < export CC=${CC:-$STUDIOHOME/bin/cc} > < export CXX=${CXX:-$STUDIOHOME/bin/CC} > < export F77=${F77:-$STUDIOHOME/bin/f77} > < export F90=${F90:-$STUDIOHOME/bin/f90} > --- > > IBHOME=${IBHOME:-/usr/local/ofed} > > IBHOME_LIB=${IBHOME_LIB:-/usr/local/ofed/lib64} > > PREFIX=${PREFIX:-/usr/local/mvapich} > > export CC=${CC:-gcc} > > export CXX=${CXX:-g++} > > export F77=${F77:-g77} > > export F90=${F90:-} > > > thanks, > > -frank > > > [mvapich-1.0-2008-02-28]# ./make.mvapich.gen2.studio12 > Configuring MVAPICH... > Configuring with args --with-device=ch_gen2 --with-arch=LINUX > -prefix=/tmp/mvapich-1.0-2008-02-28 --with-romio --without-mpe > -lib=-L/opt/ofed/lib64 -Wl,-rpath=/opt/ofed/lib64 -libverbs -libumad > -lpthread > Configuring MPICH Version 1.2.7 (release) of : 2005/06/22 16:33:49 > Make will not build MPE routines > checking whether filesystem respects case in file names... yes > checking for current directory name... /tmp/mvapich1/mvapich-1.0-2008-02-28 > checking for install > checking for ranlib > checking for gnumake... yes using --no-print-directory > checking whether make supports include... yes > checking for OSF V3 make... no > checking for virtual path format... VPATH > checking whether /opt/apps/sun/sunstudio12/bin/CC returns correct error > code... yes > checking whether selected C++ compiler can compile iostream.h... yes > > Include C++ bindings for MPI from http://www.osl.iu.edu/research/mpi2c++ > Send bug reports about the C++ to mpi2cpp-devel@osl.iu.edu > > checking for cc... no > checking whether the compiler /opt/apps/sun/sunstudio12/bin/cc accepts > ANSI prototypes... yes > checking for /opt/apps/sun/sunstudio12/bin/f77... found > /opt/apps/sun/sunstudio12/bin/f77 (1) > checking for ar... found /usr/bin/ar (ar) > checking for whether compiler works... yes > checking whether the compiler /opt/apps/sun/sunstudio12/bin/cc accepts > ## for concatenation in cpp... yes > checking whether the compiler /opt/apps/sun/sunstudio12/bin/cc accepts > const modifier... yes > checking for extension on executables... none > checking how to run the C preprocessor > checking for AIX > checking for minix/config.h > checking for volatile... yes > Running device-specific setup program > setup_ch_gen2 starts... -D_X86_64_ -D_AMD_QUAD_CORE_ > -DEARLY_SEND_COMPLETION -DMEMORY_SCALE -DVIADEV_RPUT_SUPPORT -D_SMP_ > -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE -I/opt/ofed/include -O3 > About to do ch_gen2 device > Configuring ch_gen2 subsystem... > No addition setup since mpd is not enabled > Use ${exec_prefix}/bin to set up variables MPIBOOT and MPIUNBOOT > checking whether cross-compiling... no > checking for gethrtime... no > checking for clock_gettime... no > checking for clock_getres... no > checking for how many arguments gettimeofday takes... two - whew > checking for signal.h... yes > checking for sigaction... yes > checking for for struct sigaction... yes > checking for weak symbol support... pragma weak > checking whether weak symbols are visible to other files... yes > checking for remsh... no > checking for rsh... found /usr/kerberos/bin/rsh (rsh) > checking for perl5... no > checking for perl... found /usr/bin/perl (perl) > checking for byte ordering... little endian > checking for uname... yes > checking for netdb.h... yes > checking for gethostbyname... yes > checking whether C++ compiler also has gethostbyname... yes > checking whether Fortran programs can link with needed C functions... yes > checking whether C++ programs can link with needed C functions... yes > checking for catopen... yes > checking for catclose... yes > checking for catgets... yes > checking for gencat... found /usr/bin/gencat (1) > checking for nl_types.h... yes > checking for ANSI C header files > checking for stdlib.h... yes > checking for string.h... yes > checking for unistd.h... yes > checking for stdarg.h... yes > checking whether stdarg is oldstyle... hmm, warnings from compiler. > Trying newstyle > checking whether stdarg is correct... yes > checking whether programs using stdarg link... yes > checking for malloc return type... void > checking for system... yes > checking for nice... yes > checking for strdup... yes > checking for memory.h... yes > checking for sys/ioctl.h... yes > checking for sys/sockio.h... no > checking whether the compiler /opt/apps/sun/sunstudio12/bin/cc runs... yes > checking whether the compiler /opt/apps/sun/sunstudio12/bin/f77 runs... yes > checking for correct handling of conditionals...... yes > checking for correct handling of conditionals part 2 ...... yes > checking for correct handling of #elif... yes > checking that constant folding in arrays works... yes > checking that structs are handled properly... yes > checking that compiler truncates unsigned char correctly ...... yes > checking that compiler/hardware has commutative arithmetic ...... yes > checking that compiler assigns to char correctly ...... yes > checking that compiler does not call unknown routines for long > doubles... yes > checking that compiler accepts args correctly ...... yes > checking whether ranlib works... yes > checking for broken handling of common symbols... no > checking for ar... found /usr/bin/ar (1) > checking for size of void *... 8 > checking for pointers greater than 32 bits... yes > checking for size of int... 4 > checking for int large enough for pointers... no > checking for C integer type for MPI_Aint... > checking for size of long... 8 > C integer type for MPI_Aint is... long > checking for long long... yes > checking whether compiler can handle loops with long long... yes > checking for long double... yes > checking for size of double... 8 > checking for size of long double... 16 > checking for structure alignment... largest > checking for sync... found /bin/sync (1) > checking whether mpich can be used as the library name... yes > Configuring Fortran subsystem > Configure in /tmp/mvapich1/mvapich-1.0-2008-02-28/src/fortran creating > cache ./config.cache > checking for cc... /opt/apps/sun/sunstudio12/bin/cc > checking whether the C compiler (/opt/apps/sun/sunstudio12/bin/cc > -D_X86_64_ -D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE > -DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE > -I/opt/ofed/include -O3 -DHAVE_MPICHCONF_H ) works... yes > checking whether the C compiler (/opt/apps/sun/sunstudio12/bin/cc > -D_X86_64_ -D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE > -DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE > -I/opt/ofed/include -O3 -DHAVE_MPICHCONF_H ) is a cross-compiler... no > checking whether the C compiler sets its return status correctly... yes > checking whether we are using GNU C... no > checking for working const... yes > checking whether the Fortran 77 compiler > (/opt/apps/sun/sunstudio12/bin/f77 -L/opt/ofed/lib64 ) works... no > configure: error: installation or configuration problem: Fortran 77 > compiler cannot create executables. > Error configuring the Fortran subsystem! > Turning off Fortran support > Configuring ROMIO, for support of MPI-IO > checking whether compiler allows define a(b) a(b,__LINE__)... yes > Configuring with args --with-mpi=mpich --cache-file=/dev/null > checking for architecture... LINUX > ROMIO home directory is /tmp/mvapich1/mvapich-1.0-2008-02-28/romio > checking for ranlib... ranlib > checking for gcc... /opt/apps/sun/sunstudio12/bin/cc > checking for C compiler default output file name... a.out > checking whether the C compiler works... yes > checking whether we are cross compiling... no > checking for suffix of executables... > checking for suffix of object files... o > checking whether we are using the GNU C compiler... no > checking whether /opt/apps/sun/sunstudio12/bin/cc accepts -g... yes > checking for /opt/apps/sun/sunstudio12/bin/cc option to accept ANSI C... > none needed > checking whether we are using the GNU Fortran 77 compiler... no > checking whether /opt/apps/sun/sunstudio12/bin/f77 accepts -g... yes > checking how to run the C preprocessor... > /opt/apps/sun/sunstudio12/bin/cc -E > checking for memalign... yes > checking Fortran external names > Fortran externals have a trailing underscore and are lowercase > checking for inline... inline > checking how to run the C preprocessor... > /opt/apps/sun/sunstudio12/bin/cc -E > checking for egrep... grep -E > checking for ANSI C header files... yes > checking for sys/types.h... yes > checking for sys/stat.h... yes > checking for stdlib.h... yes > checking for string.h... yes > checking for memory.h... yes > checking for strings.h... yes > checking for inttypes.h... yes > checking for stdint.h... yes > checking for unistd.h... yes > checking for unistd.h... (cached) yes > checking fcntl.h usability... yes > checking fcntl.h presence... yes > checking for fcntl.h... yes > checking malloc.h usability... yes > checking malloc.h presence... yes > checking for malloc.h... yes > checking stddef.h usability... yes > checking stddef.h presence... yes > checking for stddef.h... yes > checking for int... yes > checking size of int... 4 > checking for void*... yes > checking size of void*... 8 > checking for int large enough for pointers... no > checking for long long... yes > checking size of long long... 8 > checking for extension for Fortran 90 programs... f90 > checking for Fortran 90 KIND parameter for 8-byte integers... 8 > checking for weak symbol support... pragma weak > checking that weak symbols are visible to other files... yes > checking whether struct flock compatible with MPI_Offset... yes > checking configured file systems... testfs ufs nfs > configure: WARNING: File locks may not work with NFS. See the > Installation and > users manual for instructions on testing and if necessary fixing this > checking for library containing pthread_create... -lpthread > checking for library containing aio_write... -lrt > checking signal.h usability... yes > checking signal.h presence... yes > checking for signal.h... yes > checking if aio.h exists and can be compiled... yes > checking if sys/aio.h exists and can be compiled... no > checking whether aio routines can be used... yes > checking for obsolete two-argument aio_write... no > checking for obsolete two-argument aio_suspend... no > checking for aio_fildes member of aiocb structure... yes > checking for aio_whence member of aiocb structure... no > checking for aio_handle member of aiocb structure... no > checking for aio_reqprio member of aiocb structure... yes > checking for aio_sigevent member of aiocb structure... yes > checking sys/vfs.h usability... yes > checking sys/vfs.h presence... yes > checking for sys/vfs.h... yes > checking sys/param.h usability... yes > checking sys/param.h presence... yes > checking for sys/param.h... yes > checking sys/mount.h usability... yes > checking sys/mount.h presence... yes > checking for sys/mount.h... yes > checking sys/statvfs.h usability... yes > checking sys/statvfs.h presence... yes > checking for sys/statvfs.h... yes > checking whether struct statfs properly defined... yes > checking for f_fstypename member of statfs structure... no > checking for sys/stat.h... (cached) yes > checking for sys/types.h... (cached) yes > checking for unistd.h... (cached) yes > checking for stat... yes > checking for st_fstype member of stat structure... no > checking for sys/types.h... (cached) yes > checking for sys/statvfs.h... (cached) yes > checking for sys/vfs.h... (cached) yes > checking for statvfs... yes > checking for f_basetype member of statvfs structure... no > checking for unistd.h... (cached) yes > checking for large file defines... yes > checking whether off64_t is an scalar type... yes > checking for strerror... yes > checking for doctext... no > checking for strdup... no > checking for lstat... no > checking for readlink... no > checking for fsync... no > checking for ftruncate... no > setting CC to /tmp/mvapich1/mvapich-1.0-2008-02-28/bin/mpicc > setting F77 to /opt/apps/sun/sunstudio12/bin/f77 > setting TEST_CC to /tmp/mvapich1/mvapich-1.0-2008-02-28/bin/mpicc > setting TEST_F77 to /tmp/mvapich1/mvapich-1.0-2008-02-28/bin/mpif77 > setting CFLAGS to -D_X86_64_ -D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION > -DMEMORY_SCALE -DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 > -D_GNU_SOURCE -I/opt/ofed/include -O3 -DHAVE_MPICHCONF_H -D_X86_64_ > -D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE > -DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE > -I/opt/ofed/include -O3 -DHAVE_MPICHCONF_H -DFORTRANUNDERSCORE > -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64 -DHAVE_ROMIOCONF_H > setting USER_CFLAGS to > setting USER_FFLAGS to > configure: creating ./config.status > config.status: creating Makefile > config.status: creating localdefs > config.status: creating mpi-io/Makefile > config.status: creating mpi2-other/info/Makefile > config.status: creating mpi2-other/array/Makefile > config.status: creating adio/common/Makefile > config.status: creating test/Makefile > config.status: creating test/misc.c > config.status: creating test/large_file.c > config.status: creating test/runtests > config.status: creating util/romioinstall > config.status: creating include/mpio.h > config.status: creating include/mpiof.h > config.status: creating adio/ad_nfs/Makefile > config.status: creating adio/ad_ufs/Makefile > config.status: creating adio/ad_panfs/Makefile > config.status: creating adio/ad_xfs/Makefile > config.status: creating adio/ad_sfs/Makefile > config.status: creating adio/ad_pfs/Makefile > config.status: creating adio/ad_testfs/Makefile > config.status: creating adio/ad_pvfs/Makefile > config.status: creating adio/ad_pvfs2/Makefile > config.status: creating adio/ad_gridftp/Makefile > config.status: creating adio/ad_lustre/Makefile > config.status: creating mpi-io/fortran/Makefile > config.status: creating mpi2-other/info/fortran/Makefile > config.status: creating mpi2-other/array/fortran/Makefile > config.status: creating test/fmisc.f > config.status: creating test/fcoll_test.f > config.status: creating test/pfcoll_test.f > config.status: creating test/fperf.f > config.status: creating mpi-io/glue/mpich2/Makefile > config.status: creating mpi-io/glue/mpich1/Makefile > config.status: creating mpi-io/glue/default/Makefile > config.status: creating adio/include/romioconf.h > config.status: executing default-1 commands > Finished configuring ROMIO > checking whether head command is broken... no > creating config.status > creating Makefile > creating util/Makefile > creating examples/Makefile > creating src/pt2pt/Makefile > creating src/coll/Makefile > creating src/context/Makefile > creating src/dmpi/Makefile > creating src/env/Makefile > creating src/topol/Makefile > creating src/profile/Makefile > creating src/coll2/Makefile > creating src/util/Makefile > creating src/infoexport/Makefile > creating examples/basic/Makefile > creating src/misc2/Makefile > creating src/external/Makefile > creating mpichconf.h > creating util/mpicc > creating util/mpicxx > creating util/mpiinstall > creating util/mpirun > creating util/mpichlib.conf > creating util/mpiman > creating util/chkserv > creating util/chkmachine > creating util/tstmachines > creating include/mpidefs.h > creating include/mpif.f90 > Configuring the test suite... > Configuring with args -basecc=/opt/apps/sun/sunstudio12/bin/cc > -cc=/tmp/mvapich1/mvapich-1.0-2008-02-28/bin/mpicc -make=make > --no-print-directory -device=ch_gen2 > -mpichpath=/tmp/mvapich1/mvapich-1.0-2008-02-28/bin --enable-boot > -cflags=-D_X86_64_ -D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION > -DMEMORY_SCALE -DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 > -D_GNU_SOURCE -I/opt/ofed/include -O3 -DHAVE_MPICHCONF_H -nof77 --enable-io > Don't build the tests that need Fortran > checking whether cross-compiling... no > checking whether the compiler /opt/apps/sun/sunstudio12/bin/cc runs... yes > checking for gnumake... no > checking whether make supports include... yes > checking for OSF V3 make... no > checking for virtual path format... VPATH > checking for stdlib.h... yes > checking for unistd.h... yes > checking for string.h... yes > checking for stdarg is correct... yes > checking for long double... yes > checking for long long... yes > checking whether compiler can handle loops with long long... yes > checking whether the compiler /opt/apps/sun/sunstudio12/bin/cc accepts > ANSI prototypes... yes > checking for signal.h... yes > checking for sigaction... yes > checking for sleep... yes > checking for sysconf... yes > creating config.status > creating Makefile > creating pt2pt/Makefile > creating coll/Makefile > creating topol/Makefile > creating context/Makefile > creating env/Makefile > creating profile/Makefile > creating io/Mfile > creating pt2pt/runtests > creating coll/runtests > creating topol/runtests > creating context/runtests > creating command/runtests > creating env/runtests > creating profile/runtests > creating io/rtest > creating io/misc.c > creating io/fmisc.f > creating io/fcoll_test.f > creating io/pfcoll_test.f > creating io/large_file.c > creating io/fperf.f > Configuring the performance tests ... > Configure in /tmp/mvapich1/mvapich-1.0-2008-02-28/examples/perftest > creating cache ./config.cache > checking for a BSD compatible install... /usr/bin/install -c > checking whether build environment is sane... yes > checking whether make --no-print-directory sets ${MAKE}... yes > checking for working aclocal... found > checking for working autoconf... found > checking for working automake... found > checking for working autoheader... found > checking for working makeinfo... found > checking whether clock skew breaks make... no > checking whether make supports include... yes > checking whether make allows comments in actions... yes > checking for virtual path format... VPATH > checking whether make sets CFLAGS... yes > checking for cit... no > checking for gnuplot... gnuplot > checking how to run the C preprocessor... > /opt/apps/sun/sunstudio12/bin/cc -E > checking whether C compiler accepts option -O4 -Ofast... no > checking whether C compiler accepts option -Ofast... no > checking whether C compiler accepts option -fast... yes > checking whether routines compiled with -fast can be linked with ones > compiled without -fast... yes > checking for library containing fabs... -lm > checking for ANSI C header files... yes > checking for sys/time.h... yes > checking for stdlib.h... yes > checking for string.h... yes > checking whether time.h and sys/time.h may both be included... yes > checking whether struct tm is in sys/time.h or time.h... time.h > checking for working const... yes > checking for restrict... restrict > checking for long long... yes > updating cache ./config.cache > creating ./config.status > creating Makefile > creating mpptestconf.h > creating mpid/ch_gen2/Makefile > creating mpid/tests/Makefile > creating mpichconf.h > mpichconf.h is unchanged > *# ---> > *# You should register your copy of MPICH with us by sending mail > *# to majordomo@mcs.anl.gov containing the message > *# subscribe mpi-users > *# This will allow us to notify you of new releases of MPICH. > *# > *# You can also check the MPICH home page at > *# http://www.mcs.anl.gov/mpi/mpich > *# ---< > Configuration completed. > Building MVAPICH... > > cleaning directory mpi-io > > cleaning directory adio/common > > cleaning directory mpi-io/glue/mpich1 > > cleaning directory adio/ad_testfs > > cleaning directory adio/ad_ufs > > cleaning directory adio/ad_nfs > > cleaning directory mpi-io/fortran > > cleaning directory test > rm -f .P* PI* *.o > rm -f simple perf async coll_test coll_perf misc file_info excl > large_array atomicity noncontig i_noncontig noncontig_coll split_coll > shared_fp large_file psimple error status noncontig_coll2 fcoll_test > fperf fmisc pfcoll_test > > cleaning src/pt2pt > rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/pt2pt/*.o > cleaning src/env > rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/env/*.o > cleaning src/dmpi > rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/dmpi/*.o > cleaning src/util > rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/util/*.o > cleaning src/context > rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/context/*.o > cleaning src/coll > rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/coll/*.o > cleaning src/topol > rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/topol/*.o > cleaning src/profile > rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/profile/*.o > cleaning src/misc2 > rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/misc2/*.o > cleaning src/external > rm -f *.o *~ /tmp/mvapich1/mvapich-1.0-2008-02-28/src/external/*.o > cleaning mpid/ch_gen2 > /bin/rm -f *.o *.d *~ viainit.o viasend.o viarecv.o viacheck.o viapriv.o > viaparam.o viutil.o vbuf.o cm_user.o mpid_init.o mpid_send.o mpid_recv.o > cm.o mpid_hsend.o mpid_hrecv.o mpid_pack.o cmnargs.o mpid_misc.o dreg.o > mpid_smpi.o collutils.o intra_rdma_barrier.o mpid_mcast.o mcst_grp.o > ibmcgrp.o crc32h.o avl.o mem_hooks.o viacoalesce.o shmem_coll.o > async_progress.o \ > queue.o sbcnst2.o tr2.o queue.c sbcnst2.c tr2.c sbcnst2.h tr2.h core > ibmcgrp/*.o ibmcgrp/ibmcgrp \ > /tmp/mvapich1/mvapich-1.0-2008-02-28/bin/ibmcgrp > make --no-print-directory -C process clean > rm -f *.o mpirun_rsh mpispawn minidaemon_client pmgr_collective_client.o > pmgr_collective_common.o minidaemon.o mpirun_util.o > cleaning examples > rm -f sendchar *.o > > Making clean in directory test > > Making clean in directory pt2pt > > Making clean in directory coll > > Making clean in directory topol > > Making clean in directory env > > Making clean in directory context > > Making clean in directory profile > > Making clean in directory io > > Making clean in directory perftest > test -z "mpptest goptest buflimit " || rm -f mpptest goptest buflimit > rm -f *.o core *.core > rm -f tunepkt pktuse copytest vectest stress ctest cluster tcomm > rm -f work.pc work.pcl > cleaning examples/basic > rm -f work.pc work.pcl > rm -f *.o *~ PI* cpi systest srtest fpi cpilog cpi_autolog hello++ > iotest pi3f90 upshot rdb.* startup.* core > rm -f hello++.ti hello++.ii > cleaning examples/test/pt2pt > cleaning examples/test/coll > cleaning examples/test/topol > cleaning examples/test/context > cleaning examples/test/env > cleaning examples/test/profile > cleaning examples/test > > Making clean in directory pt2pt > > Making clean in directory coll > > Making clean in directory topol > > Making clean in directory env > > Making clean in directory context > > Making clean in directory profile > > Making clean in directory io > cleaning examples/perftest > test -z "mpptest goptest buflimit " || rm -f mpptest goptest buflimit > rm -f *.o core *.core > rm -f tunepkt pktuse copytest vectest stress ctest cluster tcomm > rm -f work.pc work.pcl > cleaning src/infoexport > rm -f *.o > rm -f *.i > rm -f *.s > rm -f *.cxx.log > rm -f *.cxx.errors > rm -f libtvmpich.so.1.0 > rm -f libtvmpich.so* > rm -f /tmp/mvapich1/mvapich-1.0-2008-02-28/src/infoexport/*.o > rm -f *~ *.o aditest1 aditest2 aditest3 aditest4 aditest5 aditest6 > aditest7 aditest8 aditest9 aditest10 aditest11 aditest12 aditest13 > timers trunc > rm -f /tmp/mvapich1/mvapich-1.0-2008-02-28/lib/lib*.a > rm -f /tmp/mvapich1/mvapich-1.0-2008-02-28/lib/shared/lib*.so* > make --no-print-directory mpi-modules > make --no-print-directory mpilib > for file in queue.c sbcnst2.c tr2.c sbcnst2.h tr2.h ; do \ > if [ ! -s $file ] ; then \ > ln -s ../util/$file; \ > fi; \ > done > > making mpir in directory mpid/ch_gen2 > for file in queue.c sbcnst2.c tr2.c sbcnst2.h tr2.h ; do \ > if [ ! -s $file ] ; then \ > ln -s ../util/$file; \ > fi; \ > done > /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/include > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/include > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE > -DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 > -DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ > -D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE > -DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE > -I/opt/ofed/include -O3 -DHAVE_MPICHCONF_H > -I/tmp/mvapich1/mvapich-1.0-2008-02-28 > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I. -c viainit.c > "ib_init.h", line 12: warning: initializer does not fit or is out of > range: -1 > "ib_init.h", line 34: warning: improper pointer/integer combination: op "<" > "viainit.c", line 149: warning: argument #3 is incompatible with prototype: > prototype: pointer to const struct {array[16] of unsigned long > __bits} : "/usr/include/sched.h", line 76 > argument : pointer to unsigned long > "viainit.c", line 162: warning: argument #3 is incompatible with prototype: > prototype: pointer to const struct {array[16] of unsigned long > __bits} : "/usr/include/sched.h", line 76 > argument : pointer to unsigned long > "viainit.c", line 556: warning: argument #3 is incompatible with prototype: > prototype: pointer to function(pointer to void) returning pointer to > void : "/usr/include/pthread.h", line 163 > argument : pointer to void > "viainit.c", line 792: warning: implicit function declaration: > init_apm_lock > "viainit.c", line 990: warning: argument mismatch > "viainit.c", line 1158: warning: implicit function declaration: > reload_alternate_path > "viainit.c", line 1221: warning: argument #3 is incompatible with > prototype: > prototype: pointer to function(pointer to void) returning pointer to > void : "/usr/include/pthread.h", line 163 > argument : pointer to void > "viainit.c", line 1345: warning: argument mismatch > /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/include > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/include > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE > -DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 > -DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ > -D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE > -DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE > -I/opt/ofed/include -O3 -DHAVE_MPICHCONF_H > -I/tmp/mvapich1/mvapich-1.0-2008-02-28 > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I. -c viasend.c > "viasend.c", line 145: warning: implicit function declaration: > viadev_post_send_async_qp > "viasend.c", line 401: warning: argument mismatch > "viasend.c", line 703: warning: argument mismatch > /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/include > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/include > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE > -DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 > -DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ > -D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE > -DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE > -I/opt/ofed/include -O3 -DHAVE_MPICHCONF_H > -I/tmp/mvapich1/mvapich-1.0-2008-02-28 > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 -I. -c viarecv.c > "viarecv.c", line 263: warning: argument mismatch > /opt/apps/sun/sunstudio12/bin/cc -DHAVE_CONFIG_H -I. > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/include > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/include > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/ch_gen2 > -I/tmp/mvapich1/mvapich-1.0-2008-02-28/mpid/util -DMPID_DEVICE_CODE > -DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -DHAVE_GETHOSTBYNAME=1 > -DMPID_DEBUG_NONE -DMPID_STAT_NONE -D_GNU_SOURCE -D_X86_64_ > -D_AMD_QUAD_CORE_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE > -DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DCH_GEN2 -D_GNU_SOURCE >