Comment 18 for bug 1071765

Revision history for this message
Olivier Mattelaer (olivier-mattelaer) wrote : Re: [Bug 1071765] MadGraph Crashes While Waiting for Filesystem Uodate

Hi Brian,

Thanks a lot for the tar ball.
Looks like that this is (at least very close to it) the version that CMS is using for their official generation.

The way to submit to the cluster is very close to the standard version:
(here is the diff)
[@Oliviers-MacBook-Pro ~]$ diff Downloads/MG5v1.4.8/madgraph/various/cluster.py Documents/eclipse/1.4.8.4/madgraph/various/cluster.py
562,564c562,564
< command = ['bsub',#'-o', stdout,
< '-J', me_dir] #,
< #'-e', stderr]
---
> command = ['bsub','-o', stdout,
> '-J', me_dir,
> '-e', stderr]

as you see the problem seems to be linked to the way to specify the path of the output file / error file

In most of the case, the stdout/stderr are redirected to /dev/null.
In all those case, (i.e. output/error file not specify) I have pass to the syntax specify in your version.

So this should allow you to finish the survey.
I'm not 100% sure that my modification will be enough for the submission which requires a specific output file.
But I hope so (if the problem is only because of /dev/null then it should be fine).

Those change will be merged in 1.5.5, which will be public in a couple of hours.

Thanks so much,

Olivier

On Nov 17, 2012, at 3:59 AM, Brian Dorney <email address hidden> wrote:

> Olivier,
>
> Sorry for the late response, it has been very busy here.
>
> It was brought to my attention that someone here at CERN has modified
> MadGraph to work on the clusters here. I've attached the tar file in case
> you had an interest in this.
>
> Best,
> -Brian
>
> On Thu, Nov 15, 2012 at 3:42 PM, Olivier Mattelaer <
> <email address hidden>> wrote:
>
>> Hi Brian,
>>
>> I suppose that you have give up on this right?
>> I will then close this ticket.
>>
>> Sorry for that,
>>
>> Olivier
>>
>> --
>> You received this bug notification because you are subscribed to the bug
>> report.
>> https://bugs.launchpad.net/bugs/1071765
>>
>> Title:
>> MadGraph Crashes While Waiting for Filesystem Uodate
>>
>> Status in The MadGraph Matrix Element Generator version 5:
>> New
>>
>> Bug description:
>> Dear Experts,
>>
>> I've been trying to run MadGraph in the command line via:
>>
>> bin/generate_events test_bjets3 -f
>>
>> And in debug mode via:
>> ./bin/madevent
>> generate_events test_bjets5 -f
>>
>> The jobs appear to submit correctly, and run on the cluster. But
>> crash on completion with the following error message:
>>
>> Command "generate_events test_bjets5 -f" interrupted with error:
>> IOError : [Errno 2] No such file or directory: '/afs/
>> cern.ch/user/d/dorney/scratch0/MadGraph/template_gridpack/work/MadGraph5_v1_5_2/bjets_yay/SubProcesses/P3_gg_bbxgg/G1/results.dat
>> '
>> Please report this bug on https://bugs.launchpad.net/madgraph5
>> More information is found in '/afs/
>> cern.ch/user/d/dorney/scratch0/MadGraph/template_gridpack/work/MadGraph5_v1_5_2/bjets_yay/test_bjets5_tag_1_debug.log
>> '.
>> Please attach this file to your report.
>>
>> I have tried making the replacement suggested in
>>
>> https://answers.launchpad.net/madgraph5/+question/208323
>>
>> to my cluster.py file under ../bjets_yay/bin/internal
>>
>> But this does not appear to solve the issue.
>>
>> Additionally, I do have GX style directories present in my
>> ../bjets_yay/Subprocesses/P*/ directory.
>>
>> Would appreciate any help/advice.
>>
>> I have attached the log file mentioned above.
>>
>> Best,
>> -Brian
>>
>> To manage notifications about this bug go to:
>> https://bugs.launchpad.net/madgraph5/+bug/1071765/+subscriptions
>>
>
>
> ** Attachment added: "MG5v1.4.8_CERN_11092012.tar.gz"
> https://bugs.launchpad.net/bugs/1071765/+attachment/3436442/+files/MG5v1.4.8_CERN_11092012.tar.gz
>
> --
> You received this bug notification because you are a member of MadTeam,
> which is subscribed to MadGraph5.
> https://bugs.launchpad.net/bugs/1071765
>
> Title:
> MadGraph Crashes While Waiting for Filesystem Uodate
>
> Status in The MadGraph Matrix Element Generator version 5:
> New
>
> Bug description:
> Dear Experts,
>
> I've been trying to run MadGraph in the command line via:
>
> bin/generate_events test_bjets3 -f
>
> And in debug mode via:
> ./bin/madevent
> generate_events test_bjets5 -f
>
> The jobs appear to submit correctly, and run on the cluster. But
> crash on completion with the following error message:
>
> Command "generate_events test_bjets5 -f" interrupted with error:
> IOError : [Errno 2] No such file or directory: '/afs/cern.ch/user/d/dorney/scratch0/MadGraph/template_gridpack/work/MadGraph5_v1_5_2/bjets_yay/SubProcesses/P3_gg_bbxgg/G1/results.dat'
> Please report this bug on https://bugs.launchpad.net/madgraph5
> More information is found in '/afs/cern.ch/user/d/dorney/scratch0/MadGraph/template_gridpack/work/MadGraph5_v1_5_2/bjets_yay/test_bjets5_tag_1_debug.log'.
> Please attach this file to your report.
>
> I have tried making the replacement suggested in
>
> https://answers.launchpad.net/madgraph5/+question/208323
>
> to my cluster.py file under ../bjets_yay/bin/internal
>
> But this does not appear to solve the issue.
>
> Additionally, I do have GX style directories present in my
> ../bjets_yay/Subprocesses/P*/ directory.
>
> Would appreciate any help/advice.
>
> I have attached the log file mentioned above.
>
> Best,
> -Brian
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/madgraph5/+bug/1071765/+subscriptions